Max level shown:
1 [ Oct 1 02:32:40 Enabled. ]
2 [ Oct 1 02:32:40 Rereading configuration. ]
3 [ Oct 1 02:32:43 Rereading configuration. ]
4 [ Oct 1 02:32:57 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/omicron-nexus/bin/nexus /var/svc/manifest/site/nexus/config.toml &"). ]
5 [ Oct 1 02:32:57 Method "start" exited with status 0. ]
6 note: configured to log to "/dev/stdout"
72024-10-01T02:32:57.778ZDEBGnexus: registered DTrace probes
82024-10-01T02:32:57.781ZINFOnexus: setting up nexus server file = nexus/src/lib.rs:74
92024-10-01T02:32:57.787ZINFOnexus (ServerContext): registering Oso class class = Action file = nexus/auth/src/authz/oso_generic.rs:68
102024-10-01T02:32:57.787ZINFOnexus (ServerContext): registering Oso class class = AnyActor file = nexus/auth/src/authz/oso_generic.rs:68
112024-10-01T02:32:57.787ZINFOnexus (ServerContext): registering Oso class class = AuthenticatedActor file = nexus/auth/src/authz/oso_generic.rs:68
122024-10-01T02:32:57.787ZINFOnexus (ServerContext): registering Oso class class = BlueprintConfig file = nexus/auth/src/authz/oso_generic.rs:68
132024-10-01T02:32:57.787ZINFOnexus (ServerContext): registering Oso class class = Database file = nexus/auth/src/authz/oso_generic.rs:68
142024-10-01T02:32:57.787ZINFOnexus (ServerContext): registering Oso class class = DnsConfig file = nexus/auth/src/authz/oso_generic.rs:68
152024-10-01T02:32:57.787ZINFOnexus (ServerContext): registering Oso class class = Fleet file = nexus/auth/src/authz/oso_generic.rs:68
162024-10-01T02:32:57.787ZINFOnexus (ServerContext): registering Oso class class = Inventory file = nexus/auth/src/authz/oso_generic.rs:68
172024-10-01T02:32:57.787ZINFOnexus (ServerContext): registering Oso class class = IpPoolList file = nexus/auth/src/authz/oso_generic.rs:68
182024-10-01T02:32:57.787ZINFOnexus (ServerContext): registering Oso class class = ConsoleSessionList file = nexus/auth/src/authz/oso_generic.rs:68
192024-10-01T02:32:57.787ZINFOnexus (ServerContext): registering Oso class class = DeviceAuthRequestList file = nexus/auth/src/authz/oso_generic.rs:68
202024-10-01T02:32:57.787ZINFOnexus (ServerContext): registering Oso class class = SiloCertificateList file = nexus/auth/src/authz/oso_generic.rs:68
212024-10-01T02:32:57.787ZINFOnexus (ServerContext): registering Oso class class = SiloIdentityProviderList file = nexus/auth/src/authz/oso_generic.rs:68
222024-10-01T02:32:57.787ZINFOnexus (ServerContext): registering Oso class class = SiloUserList file = nexus/auth/src/authz/oso_generic.rs:68
232024-10-01T02:32:57.787ZINFOnexus (ServerContext): registering Oso class class = Project file = nexus/auth/src/authz/oso_generic.rs:68
242024-10-01T02:32:57.787ZINFOnexus (ServerContext): registering Oso class class = Disk file = nexus/auth/src/authz/oso_generic.rs:68
252024-10-01T02:32:57.787ZINFOnexus (ServerContext): registering Oso class class = Snapshot file = nexus/auth/src/authz/oso_generic.rs:68
262024-10-01T02:32:57.787ZINFOnexus (ServerContext): registering Oso class class = ProjectImage file = nexus/auth/src/authz/oso_generic.rs:68
272024-10-01T02:32:57.787ZINFOnexus (ServerContext): registering Oso class class = Instance file = nexus/auth/src/authz/oso_generic.rs:68
282024-10-01T02:32:57.787ZINFOnexus (ServerContext): registering Oso class class = IpPool file = nexus/auth/src/authz/oso_generic.rs:68
292024-10-01T02:32:57.787ZINFOnexus (ServerContext): registering Oso class class = InstanceNetworkInterface file = nexus/auth/src/authz/oso_generic.rs:68
302024-10-01T02:32:57.787ZINFOnexus (ServerContext): registering Oso class class = Vpc file = nexus/auth/src/authz/oso_generic.rs:68
312024-10-01T02:32:57.788ZINFOnexus (ServerContext): registering Oso class class = VpcRouter file = nexus/auth/src/authz/oso_generic.rs:68
322024-10-01T02:32:57.788ZINFOnexus (ServerContext): registering Oso class class = RouterRoute file = nexus/auth/src/authz/oso_generic.rs:68
332024-10-01T02:32:57.788ZINFOnexus (ServerContext): registering Oso class class = VpcSubnet file = nexus/auth/src/authz/oso_generic.rs:68
342024-10-01T02:32:57.788ZINFOnexus (ServerContext): registering Oso class class = FloatingIp file = nexus/auth/src/authz/oso_generic.rs:68
352024-10-01T02:32:57.788ZINFOnexus (ServerContext): registering Oso class class = Image file = nexus/auth/src/authz/oso_generic.rs:68
362024-10-01T02:32:57.788ZINFOnexus (ServerContext): registering Oso class class = SiloImage file = nexus/auth/src/authz/oso_generic.rs:68
372024-10-01T02:32:57.788ZINFOnexus (ServerContext): registering Oso class class = AddressLot file = nexus/auth/src/authz/oso_generic.rs:68
382024-10-01T02:32:57.788ZINFOnexus (ServerContext): registering Oso class class = Blueprint file = nexus/auth/src/authz/oso_generic.rs:68
392024-10-01T02:32:57.788ZINFOnexus (ServerContext): registering Oso class class = LoopbackAddress file = nexus/auth/src/authz/oso_generic.rs:68
402024-10-01T02:32:57.788ZINFOnexus (ServerContext): registering Oso class class = Certificate file = nexus/auth/src/authz/oso_generic.rs:68
412024-10-01T02:32:57.788ZINFOnexus (ServerContext): registering Oso class class = ConsoleSession file = nexus/auth/src/authz/oso_generic.rs:68
422024-10-01T02:32:57.788ZINFOnexus (ServerContext): registering Oso class class = DeviceAuthRequest file = nexus/auth/src/authz/oso_generic.rs:68
432024-10-01T02:32:57.788ZINFOnexus (ServerContext): registering Oso class class = DeviceAccessToken file = nexus/auth/src/authz/oso_generic.rs:68
442024-10-01T02:32:57.788ZINFOnexus (ServerContext): registering Oso class class = PhysicalDisk file = nexus/auth/src/authz/oso_generic.rs:68
452024-10-01T02:32:57.788ZINFOnexus (ServerContext): registering Oso class class = Rack file = nexus/auth/src/authz/oso_generic.rs:68
462024-10-01T02:32:57.788ZINFOnexus (ServerContext): registering Oso class class = RoleBuiltin file = nexus/auth/src/authz/oso_generic.rs:68
472024-10-01T02:32:57.788ZINFOnexus (ServerContext): registering Oso class class = SshKey file = nexus/auth/src/authz/oso_generic.rs:68
482024-10-01T02:32:57.788ZINFOnexus (ServerContext): registering Oso class class = Silo file = nexus/auth/src/authz/oso_generic.rs:68
492024-10-01T02:32:57.788ZINFOnexus (ServerContext): registering Oso class class = SiloUser file = nexus/auth/src/authz/oso_generic.rs:68
502024-10-01T02:32:57.788ZINFOnexus (ServerContext): registering Oso class class = SiloGroup file = nexus/auth/src/authz/oso_generic.rs:68
512024-10-01T02:32:57.788ZINFOnexus (ServerContext): registering Oso class class = IdentityProvider file = nexus/auth/src/authz/oso_generic.rs:68
522024-10-01T02:32:57.788ZINFOnexus (ServerContext): registering Oso class class = SamlIdentityProvider file = nexus/auth/src/authz/oso_generic.rs:68
532024-10-01T02:32:57.788ZINFOnexus (ServerContext): registering Oso class class = Sled file = nexus/auth/src/authz/oso_generic.rs:68
542024-10-01T02:32:57.788ZINFOnexus (ServerContext): registering Oso class class = TufRepo file = nexus/auth/src/authz/oso_generic.rs:68
552024-10-01T02:32:57.788ZINFOnexus (ServerContext): registering Oso class class = TufArtifact file = nexus/auth/src/authz/oso_generic.rs:68
562024-10-01T02:32:57.788ZINFOnexus (ServerContext): registering Oso class class = Zpool file = nexus/auth/src/authz/oso_generic.rs:68
572024-10-01T02:32:57.788ZINFOnexus (ServerContext): registering Oso class class = Service file = nexus/auth/src/authz/oso_generic.rs:68
582024-10-01T02:32:57.788ZINFOnexus (ServerContext): registering Oso class class = UserBuiltin file = nexus/auth/src/authz/oso_generic.rs:68
592024-10-01T02:32:57.788ZINFOnexus (ServerContext): full Oso configuration config = #\n# Oso configuration for Omicron\n# This file is augmented by generated snippets.\n#\n\n#\n# ACTOR TYPES AND BASIC RULES\n#\n\n# `AnyActor` includes both authenticated and unauthenticated users.\nactor AnyActor {}\n\n# An `AuthenticatedActor` has an identity in the system. All of our operations\n# today require that an actor be authenticated.\nactor AuthenticatedActor {}\n\n# For any resource, `actor` can perform action `action` on it if they're\n# authenticated and their role(s) give them the corresponding permission on that\n# resource.\nallow(actor: AnyActor, action: Action, resource) if\n actor.authenticated and\n has_permission(actor.authn_actor.unwrap(), action.to_perm(), resource);\n\n# Define role relationships\nhas_role(actor: AuthenticatedActor, role: String, resource: Resource)\n\tif resource.has_role(actor, role);\n\n#\n# ROLES AND PERMISSIONS IN THE FLEET/SILO/PROJECT HIERARCHY\n#\n# We define the following permissions for most resources in the system:\n#\n# - "create_child": required to create child resources (of any type)\n#\n# - "list_children": required to list child resources (of all types) of a\n# resource\n#\n# - "modify": required to modify or delete a resource\n#\n# - "read": required to read a resource\n#\n# We define the following predefined roles for only a few high-level resources:\n# the Fleet (see below), Silo, Organization, and Project. The specific roles\n# are oriented around intended use-cases:\n#\n# - "admin": has all permissions on the resource\n#\n# - "collaborator": has "read", "list_children", and "create_child", plus\n# the "admin" role for child resources. The idea is that if you're an\n# Organization Collaborator, you have full control over the Projects within\n# the Organization, but you cannot modify or delete the Organization itself.\n#\n# - "viewer": has "read" and "list_children" on a resource\n#\n# Below the Project level, permissions are granted via roles at the Project\n# level. For example, for someone to be able to create, modify, or delete any\n# Instances, they must be granted project.collaborator, which means they can\n# create, modify, or delete _all_ resources in the Project.\n#\n# The complete set of predefined roles:\n#\n# - fleet.admin (superuser for the whole system)\n# - fleet.collaborator (can manage Silos)\n# - fleet.viewer (can read most non-siloed resources in the system)\n# - silo.admin (superuser for the silo)\n# - silo.collaborator (can create and own Organizations)\n# - silo.viewer (can read most resources within the Silo)\n# - organization.admin (complete control over an organization)\n# - organization.collaborator (can manage Projects)\n# - organization.viewer (can read most resources within the Organization)\n# - project.admin (complete control over a Project)\n# - project.collaborator (can manage all resources within the Project)\n# - project.viewer (can read most resources within the Project)\n#\n# Outside the Silo/Organization/Project hierarchy, we (currently) treat most\n# resources as nested under Fleet or else a synthetic resource (see below). We\n# do not yet support role assignments on anything other than Fleet, Silo,\n# Organization, or Project.\n#\n\n# "Fleet" is a global singleton representing the whole system. The name comes\n# from the idea described in RFD 24, but it's not quite right. This probably\n# should be more like "Region" or "AvailabilityZone". The precise boundaries\n# have not yet been figured out.\nresource Fleet {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\n\troles = [\n\t # Roles that can be attached by users\n\t "admin",\n\t "collaborator",\n\t "viewer",\n\n\t # Internal-only roles\n\t "external-authenticator"\n\t];\n\n\t# Roles implied by other roles on this resource\n\t"viewer" if "collaborator";\n\t"collaborator" if "admin";\n\n\t# Permissions granted directly by roles on this resource\n\t"list_children" if "viewer";\n\t"read" if "viewer";\n\t"create_child" if "collaborator";\n\t"modify" if "admin";\n}\n\n# For fleets specifically, roles can be conferred by roles on the user's Silo.\nhas_role(actor: AuthenticatedActor, role: String, _: Fleet) if\n\tsilo_role in actor.confers_fleet_role(role) and\n\thas_role(actor, silo_role, actor.silo.unwrap());\n\nresource Silo {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\troles = [ "admin", "collaborator", "viewer" ];\n\n\t# Roles implied by other roles on this resource\n\t"viewer" if "collaborator";\n\t"collaborator" if "admin";\n\n\t# Permissions granted directly by roles on this resource\n\t"list_children" if "viewer";\n\t"read" if "viewer";\n\n\t"create_child" if "collaborator";\n\t"modify" if "admin";\n\n\t# Permissions implied by roles on this resource's parent (Fleet). Fleet\n\t# privileges allow a user to see and potentially administer the Silo,\n\t# but they do not give anyone permission to look at anything inside the\n\t# Silo. To achieve this, we use permission rules here. (If we granted\n\t# Fleet administrators _roles_ on the Silo, then those would cascade\n\t# into the Silo as well.)\n\trelations = { parent_fleet: Fleet };\n\t"read" if "viewer" on "parent_fleet";\n\t"modify" if "collaborator" on "parent_fleet";\n\n\t# external authenticator has to create silo users\n\t"list_children" if "external-authenticator" on "parent_fleet";\n\t"create_child" if "external-authenticator" on "parent_fleet";\n}\n\nhas_relation(fleet: Fleet, "parent_fleet", silo: Silo)\n\tif silo.fleet = fleet;\n\n# As a special case, all authenticated users can read their own Silo. That's\n# not quite the same as having the "viewer" role. For example, they cannot list\n# Organizations in the Silo.\n#\n# One reason this is necessary is because if an unprivileged user tries to\n# create an Organization using "POST /organizations", they should get back a 403\n# (which implies they're able to see /organizations, which is essentially seeing\n# the Silo itself) rather than a 404. This behavior isn't a hard constraint\n# (i.e., you could reasonably get a 404 for an API you're not allowed to call).\n# Nor is the implementation (i.e., we could special-case this endpoint somehow).\n# But granting this permission is the simplest way to keep this endpoint's\n# behavior consistent with the rest of the API.\n#\n# This rule is also used to determine if a user can list the identity providers\n# in the Silo (which they should be able to), since that's predicated on being\n# able to read the Silo.\n#\n# It's unclear what else would break if users couldn't see their own Silo.\nhas_permission(actor: AuthenticatedActor, "read", silo: Silo)\n\tif silo in actor.silo;\n\nresource Project {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\troles = [ "admin", "collaborator", "viewer" ];\n\n\t# Roles implied by other roles on this resource\n\t"viewer" if "collaborator";\n\t"collaborator" if "admin";\n\n\t# Permissions granted directly by roles on this resource\n\t"list_children" if "viewer";\n\t"read" if "viewer";\n\t"create_child" if "collaborator";\n\t"modify" if "admin";\n\n\t# Roles implied by roles on this resource's parent (Silo)\n\trelations = { parent_silo: Silo };\n\t"admin" if "collaborator" on "parent_silo";\n\t"viewer" if "viewer" on "parent_silo";\n}\nhas_relation(silo: Silo, "parent_silo", project: Project)\n\tif project.silo = silo;\n\n#\n# GENERAL RESOURCES OUTSIDE THE SILO/PROJECT HIERARCHY\n#\n# Many resources use snippets of Polar generated by the `authz_resource!` Rust\n# macro. Some resources require custom Polar code. Those appear here.\n#\n\nresource Certificate {\n\tpermissions = [ "read", "modify" ];\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Fleet-level and silo-level roles both grant privileges on certificates.\n\t"read" if "admin" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"read" if "admin" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", certificate: Certificate)\n\tif certificate.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", certificate: Certificate)\n\tif certificate.silo.fleet = fleet;\n\nresource SiloUser {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\n\t# Fleet and Silo administrators can manage a Silo's users. This is one\n\t# of the only areas of Silo configuration that Fleet Administrators have\n\t# permissions on.\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\t"list_children" if "read" on "parent_silo";\n\t"read" if "read" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_silo";\n\t"list_children" if "read" on "parent_fleet";\n\t"read" if "read" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", user: SiloUser)\n\tif user.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", user: SiloUser)\n\tif user.silo.fleet = fleet;\n\n# authenticated actors have all permissions on themselves\nhas_permission(actor: AuthenticatedActor, _perm: String, silo_user: SiloUser)\n if actor.equals_silo_user(silo_user);\n\nhas_permission(actor: AuthenticatedActor, "read", silo_user: SiloUser)\n if silo_user.silo in actor.silo;\n\nresource SiloGroup {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\n\trelations = { parent_silo: Silo };\n\t"list_children" if "read" on "parent_silo";\n\t"read" if "read" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_silo";\n}\nhas_relation(silo: Silo, "parent_silo", group: SiloGroup)\n\tif group.silo = silo;\n\nresource SshKey {\n\tpermissions = [ "read", "modify" ];\n\trelations = { silo_user: SiloUser };\n\n\t"read" if "read" on "silo_user";\n\t"modify" if "modify" on "silo_user";\n}\nhas_relation(user: SiloUser, "silo_user", ssh_key: SshKey)\n\tif ssh_key.silo_user = user;\n\nresource IdentityProvider {\n\tpermissions = [\n\t "read",\n\t "modify",\n\t "create_child",\n\t "list_children",\n\t];\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Silo-level roles grant privileges on identity providers.\n\t"read" if "viewer" on "parent_silo";\n\t"list_children" if "viewer" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_silo";\n\n\t# Fleet-level roles also grant privileges on identity providers.\n\t"read" if "viewer" on "parent_fleet";\n\t"list_children" if "viewer" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", identity_provider: IdentityProvider)\n\tif identity_provider.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: IdentityProvider)\n\tif collection.silo.fleet = fleet;\n\nresource SamlIdentityProvider {\n\tpermissions = [\n\t "read",\n\t "modify",\n\t "create_child",\n\t "list_children",\n\t];\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Silo-level roles grant privileges on identity providers.\n\t"read" if "viewer" on "parent_silo";\n\t"list_children" if "viewer" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_silo";\n\n\t# Fleet-level roles also grant privileges on identity providers.\n\t"read" if "viewer" on "parent_fleet";\n\t"list_children" if "viewer" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", saml_identity_provider: SamlIdentityProvider)\n\tif saml_identity_provider.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: SamlIdentityProvider)\n\tif collection.silo.fleet = fleet;\n\n#\n# SYNTHETIC RESOURCES OUTSIDE THE SILO HIERARCHY\n#\n# The resources here do not correspond to anything that appears explicitly in\n# the API or is stored in the database. These are used either at the top level\n# of the API path (e.g., "/v1/system/ip-pools") or as an implementation detail of the system\n# (in the case of console sessions and "Database"). The policies are\n# either statically-defined in this file or driven by role assignments on the\n# Fleet. None of these resources defines their own roles.\n#\n\n# Describes the policy for reading and modifying DNS configuration\n# (both internal and external)\nresource DnsConfig {\n\tpermissions = [ "read", "modify" ];\n\trelations = { parent_fleet: Fleet };\n\t# "external-authenticator" requires these permissions because that's the\n\t# context that Nexus uses when creating and deleting Silos. These\n\t# operations necessarily need to read and modify DNS configuration.\n\t"read" if "external-authenticator" on "parent_fleet";\n\t"modify" if "external-authenticator" on "parent_fleet";\n\t# "admin" on the parent fleet also gets these permissions, primarily for\n\t# the test suite.\n\t"read" if "admin" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", dns_config: DnsConfig)\n\tif dns_config.fleet = fleet;\n\n# Describes the policy for accessing blueprints\nresource BlueprintConfig {\n\tpermissions = [\n\t "list_children", # list blueprints\n\t "create_child", # create blueprint\n\t "read", # read the current target\n\t "modify", # change the current target\n\t];\n\n\trelations = { parent_fleet: Fleet };\n\t"create_child" if "admin" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n\t"list_children" if "viewer" on "parent_fleet";\n\t"read" if "viewer" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", list: BlueprintConfig)\n\tif list.fleet = fleet;\n\n# Describes the policy for reading and modifying low-level inventory\nresource Inventory {\n\tpermissions = [ "read", "modify" ];\n\trelations = { parent_fleet: Fleet };\n\t"read" if "viewer" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", inventory: Inventory)\n\tif inventory.fleet = fleet;\n\n# Describes the policy for accessing "/v1/system/ip-pools" in the API\nresource IpPoolList {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "create_child",\n\t];\n\n\t# Fleet Administrators can create or modify the IP Pools list.\n\trelations = { parent_fleet: Fleet };\n\t"modify" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n\n\t# Fleet Viewers can list IP Pools\n\t"list_children" if "viewer" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", ip_pool_list: IpPoolList)\n\tif ip_pool_list.fleet = fleet;\n\n# Any authenticated user can create a child of a provided IP Pool.\n# This is necessary to use the pools when provisioning instances.\nhas_permission(actor: AuthenticatedActor, "create_child", ip_pool: IpPool)\n\tif silo in actor.silo and silo.fleet = ip_pool.fleet;\n\n# Describes the policy for creating and managing web console sessions.\nresource ConsoleSessionList {\n\tpermissions = [ "create_child" ];\n\trelations = { parent_fleet: Fleet };\n\t"create_child" if "external-authenticator" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", collection: ConsoleSessionList)\n\tif collection.fleet = fleet;\n\n# Describes the policy for creating and managing device authorization requests.\nresource DeviceAuthRequestList {\n\tpermissions = [ "create_child" ];\n\trelations = { parent_fleet: Fleet };\n\t"create_child" if "external-authenticator" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", collection: DeviceAuthRequestList)\n\tif collection.fleet = fleet;\n\n# Describes the policy for creating and managing Silo certificates\nresource SiloCertificateList {\n\tpermissions = [ "list_children", "create_child" ];\n\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Both Fleet and Silo administrators can see and modify the Silo's\n\t# certificates.\n\t"list_children" if "admin" on "parent_silo";\n\t"list_children" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", collection: SiloCertificateList)\n\tif collection.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: SiloCertificateList)\n\tif collection.silo.fleet = fleet;\n\n# Describes the policy for creating and managing Silo identity providers\nresource SiloIdentityProviderList {\n\tpermissions = [ "list_children", "create_child" ];\n\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Everyone who can read the Silo (which includes all the users in the\n\t# Silo) can see the identity providers in it.\n\t"list_children" if "read" on "parent_silo";\n\n\t# Fleet and Silo administrators can manage the Silo's identity provider\n\t# configuration. This is one of the only areas of Silo configuration\n\t# that Fleet Administrators have permissions on. This is also one of\n\t# the only cases where we need to look two levels up the hierarchy to\n\t# see if somebody has the right permission. For most other things,\n\t# permissions cascade down the hierarchy so we only need to look at the\n\t# parent.\n\t"create_child" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", collection: SiloIdentityProviderList)\n\tif collection.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: SiloIdentityProviderList)\n\tif collection.silo.fleet = fleet;\n\n# Describes the policy for creating and managing Silo users (mostly intended for\n# API-managed users)\nresource SiloUserList {\n\tpermissions = [ "list_children", "create_child" ];\n\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Everyone who can read the Silo (which includes all the users in the\n\t# Silo) can see the users in it.\n\t"list_children" if "read" on "parent_silo";\n\n\t# Fleet and Silo administrators can manage the Silo's users. This is\n\t# one of the only areas of Silo configuration that Fleet Administrators\n\t# have permissions on. This is also one of the few cases (so far) where\n\t# we need to look two levels up the hierarchy to see if somebody has the\n\t# right permission. For most other things, permissions cascade down the\n\t# hierarchy so we only need to look at the parent.\n\t"create_child" if "admin" on "parent_silo";\n\t"list_children" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", collection: SiloUserList)\n\tif collection.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: SiloUserList)\n\tif collection.silo.fleet = fleet;\n\n# These rules grants the external authenticator role the permissions it needs to\n# read silo users and modify their sessions. This is necessary for login to\n# work.\nhas_permission(actor: AuthenticatedActor, "read", silo: Silo)\n\tif has_role(actor, "external-authenticator", silo.fleet);\nhas_permission(actor: AuthenticatedActor, "read", user: SiloUser)\n\tif has_role(actor, "external-authenticator", user.silo.fleet);\nhas_permission(actor: AuthenticatedActor, "modify", user: SiloUser)\n\tif has_role(actor, "external-authenticator", user.silo.fleet);\nhas_permission(actor: AuthenticatedActor, "read", group: SiloGroup)\n\tif has_role(actor, "external-authenticator", group.silo.fleet);\nhas_permission(actor: AuthenticatedActor, "modify", group: SiloGroup)\n\tif has_role(actor, "external-authenticator", group.silo.fleet);\n\nhas_permission(actor: AuthenticatedActor, "read", session: ConsoleSession)\n\tif has_role(actor, "external-authenticator", session.fleet);\nhas_permission(actor: AuthenticatedActor, "modify", session: ConsoleSession)\n\tif has_role(actor, "external-authenticator", session.fleet);\n\n# All authenticated users can read and delete device authn requests because\n# by necessity these operations happen before we've figured out what user (or\n# even Silo) the device auth is associated with. Any user can claim a device\n# auth request with the right user code (that's how it works) -- it's the user\n# code and associated logic that prevents unauthorized access here.\nhas_permission(_actor: AuthenticatedActor, "read", _device_auth: DeviceAuthRequest);\nhas_permission(_actor: AuthenticatedActor, "modify", _device_auth: DeviceAuthRequest);\n\nhas_permission(actor: AuthenticatedActor, "read", device_token: DeviceAccessToken)\n\tif has_role(actor, "external-authenticator", device_token.fleet);\n\nhas_permission(actor: AuthenticatedActor, "read", identity_provider: IdentityProvider)\n\tif has_role(actor, "external-authenticator", identity_provider.silo.fleet);\n\nhas_permission(actor: AuthenticatedActor, "read", saml_identity_provider: SamlIdentityProvider)\n\tif has_role(actor, "external-authenticator", saml_identity_provider.silo.fleet);\n\n# Describes the policy for who can access the internal database.\nresource Database {\n\tpermissions = [\n\t # "query" is required to perform any query against the database,\n\t # whether a read or write query. This is checked when an operation\n\t # checks out a database connection from the connection pool.\n\t #\n\t # Any authenticated user gets this permission. There's generally\n\t # some other authz check involved in the database query. For\n\t # example, if you're querying the database to "read" a "Project", we\n\t # should also be checking that. So why do we do this at all? It's\n\t # a belt-and-suspenders measure so that if we somehow introduced an\n\t # unauthenticated code path that hits the database, it cannot be\n\t # used to DoS the database because we won't allow the operation to\n\t # make the query. (As long as the code path _is_ authenticated, we\n\t # can use throttling mechanisms to prevent DoS.)\n\t "query",\n\n\t # "modify" is required to populate database data that's delivered\n\t # with the system. It should also be required for schema changes,\n\t # when we support those. This is separate from "query" so that we\n\t # cannot accidentally invoke these code paths from API calls and\n\t # other general functions.\n\t "modify"\n\t];\n}\n\n# All authenticated users have the "query" permission on the database.\nhas_permission(_actor: AuthenticatedActor, "query", _resource: Database);\n\n# The "db-init" user is the only one with the "modify" permission.\nhas_permission(USER_DB_INIT: AuthenticatedActor, "modify", _resource: Database);\nhas_permission(USER_DB_INIT: AuthenticatedActor, "create_child", _resource: IpPoolList);\n# It also has "admin" on the internal silo to populate it with built-in resources.\n# TODO-completeness: actually limit to just internal silo and not all silos\nhas_role(USER_DB_INIT: AuthenticatedActor, "admin", _silo: Silo);\n\n# Allow the internal API admin permissions on all silos.\nhas_role(USER_INTERNAL_API: AuthenticatedActor, "admin", _silo: Silo);\n\n\n\n resource Disk {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: Disk)\n if child.project = parent;\n \n\n resource Snapshot {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: Snapshot)\n if child.project = parent;\n \n\n resource ProjectImage {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: ProjectImage)\n if child.project = parent;\n \n\n resource Instance {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: Instance)\n if child.project = parent;\n \n\n resource IpPool {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: IpPool)\n if child.fleet = fleet;\n \n\n resource InstanceNetworkInterface {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: Instance\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: InstanceNetworkInterface)\n if has_relation(project, "containing_project", child.instance);\n\n has_relation(parent: Instance, "parent", child: InstanceNetworkInterface)\n if child.instance = parent;\n \n\n resource Vpc {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: Vpc)\n if child.project = parent;\n \n\n resource VpcRouter {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: Vpc\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: VpcRouter)\n if has_relation(project, "containing_project", child.vpc);\n\n has_relation(parent: Vpc, "parent", child: VpcRouter)\n if child.vpc = parent;\n \n\n resource RouterRoute {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: VpcRouter\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: RouterRoute)\n if has_relation(project, "containing_project", child.vpc_router);\n\n has_relation(parent: VpcRouter, "parent", child: RouterRoute)\n if child.vpc_router = parent;\n \n\n resource VpcSubnet {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: Vpc\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: VpcSubnet)\n if has_relation(project, "containing_project", child.vpc);\n\n has_relation(parent: Vpc, "parent", child: VpcSubnet)\n if child.vpc = parent;\n \n\n resource FloatingIp {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: FloatingIp)\n if child.project = parent;\n \n\n resource Image {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_silo: Silo };\n "list_children" if "viewer" on "containing_silo";\n "read" if "viewer" on "containing_silo";\n "modify" if "collaborator" on "containing_silo";\n "create_child" if "collaborator" on "containing_silo";\n }\n\n has_relation(parent: Silo, "containing_silo", child: Image)\n if child.silo = parent;\n \n\n resource SiloImage {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_silo: Silo };\n "list_children" if "viewer" on "containing_silo";\n "read" if "viewer" on "containing_silo";\n "modify" if "collaborator" on "containing_silo";\n "create_child" if "collaborator" on "containing_silo";\n }\n\n has_relation(parent: Silo, "containing_silo", child: SiloImage)\n if child.silo = parent;\n \n\n resource AddressLot {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: AddressLot)\n if child.fleet = fleet;\n \n\n resource Blueprint {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Blueprint)\n if child.fleet = fleet;\n \n\n resource LoopbackAddress {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: LoopbackAddress)\n if child.fleet = fleet;\n \n\n\n resource ConsoleSession {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: ConsoleSession)\n if child.fleet = fleet;\n \n\n resource DeviceAuthRequest {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: DeviceAuthRequest)\n if child.fleet = fleet;\n \n\n resource DeviceAccessToken {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: DeviceAccessToken)\n if child.fleet = fleet;\n \n\n resource PhysicalDisk {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: PhysicalDisk)\n if child.fleet = fleet;\n \n\n resource Rack {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Rack)\n if child.fleet = fleet;\n \n\n resource RoleBuiltin {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: RoleBuiltin)\n if child.fleet = fleet;\n \n\n\n\n\n\n\n\n resource Sled {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Sled)\n if child.fleet = fleet;\n \n\n resource TufRepo {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: TufRepo)\n if child.fleet = fleet;\n \n\n resource TufArtifact {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: TufArtifact)\n if child.fleet = fleet;\n \n\n resource Zpool {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Zpool)\n if child.fleet = fleet;\n \n\n resource Service {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Service)\n if child.fleet = fleet;\n \n\n resource UserBuiltin {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: UserBuiltin)\n if child.fleet = fleet;\n file = nexus/auth/src/authz/oso_generic.rs:89
602024-10-01T02:32:57.803ZINFOnexus (ServerContext): Setting up resolver using DNS servers for subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344::, width: 48 } } file = nexus/src/context.rs:218
612024-10-01T02:32:57.807ZINFOnexus (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = internal-dns/src/resolver.rs:72
622024-10-01T02:32:57.811ZINFOnexus (ServerContext): Setting up qorb pool from DNS dns_addrs = [\n [fd00:1122:3344:1::1]:53,\n [fd00:1122:3344:2::1]:53,\n [fd00:1122:3344:3::1]:53,\n [fd00:1122:3344:4::1]:53,\n [fd00:1122:3344:5::1]:53,\n] file = nexus/src/context.rs:267
632024-10-01T02:33:08.025ZINFOnexus: Database schema version is up to date desired_version = 106.0.0 file = nexus/db-queries/src/db/datastore/db_metadata.rs:145 found_version = 106.0.0
642024-10-01T02:33:08.027ZINFOnexus (SEC): SEC running file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:813 sec_id = 3dfd7033-71d8-4eb9-bb97-49dae3b5cd35
652024-10-01T02:33:08.028ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1241, tv_nsec: 471767001 } })
662024-10-01T02:33:08.028ZINFOnexus (Nexus): Determining switch slots managed by switch zones file = nexus/src/app/mod.rs:1051
672024-10-01T02:33:08.077ZINFOnexus (Nexus): determining switch slot managed by dendrite zone file = nexus/src/app/mod.rs:1059 zone_address = fd00:1122:3344:101::2
682024-10-01T02:33:08.078ZDEBGnexus (MgsClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
692024-10-01T02:33:08.080ZDEBGnexus (MgsClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "3c1dcae2-7070-466a-9c49-93e233ee638c", "content-length": "26", "date": "Tue, 01 Oct 2024 02:33:07 GMT"} })
702024-10-01T02:33:08.080ZINFOnexus (Nexus): identified switch slot for dendrite zone file = nexus/src/app/mod.rs:1064 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
712024-10-01T02:33:08.081ZINFOnexus (Nexus): completed mapping dendrite zones to switch slots file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
722024-10-01T02:33:08.112ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1241, tv_nsec: 556435329 } })
732024-10-01T02:33:08.113ZINFOnexus (Nexus): Determining switch slots managed by switch zones file = nexus/src/app/mod.rs:1051
742024-10-01T02:33:08.145ZINFOnexus (Nexus): determining switch slot managed by dendrite zone file = nexus/src/app/mod.rs:1059 zone_address = fd00:1122:3344:101::2
752024-10-01T02:33:08.145ZDEBGnexus (MgsClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
762024-10-01T02:33:08.145ZDEBGnexus (MgsClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "077e28b8-df78-4c1d-8d14-825fe1ffe539", "content-length": "26", "date": "Tue, 01 Oct 2024 02:33:07 GMT"} })
772024-10-01T02:33:08.145ZINFOnexus (Nexus): identified switch slot for dendrite zone file = nexus/src/app/mod.rs:1064 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
782024-10-01T02:33:08.145ZINFOnexus (Nexus): completed mapping dendrite zones to switch slots file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
792024-10-01T02:33:08.219ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
802024-10-01T02:33:08.228ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
812024-10-01T02:33:08.229ZDEBGnexus (DataLoader): attempting to create built-in users
822024-10-01T02:33:08.230ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
832024-10-01T02:33:08.230ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
842024-10-01T02:33:08.241ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /artifacts/{kind}/{name}/{version}
852024-10-01T02:33:08.241ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /bgtasks
862024-10-01T02:33:08.241ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /bgtasks/activate
872024-10-01T02:33:08.241ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /bgtasks/view/{bgtask_name}
882024-10-01T02:33:08.241ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /crucible/0/upstairs/{upstairs_id}/downstairs/{downstairs_id}/stop-request
892024-10-01T02:33:08.241ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /crucible/0/upstairs/{upstairs_id}/downstairs/{downstairs_id}/stopped
902024-10-01T02:33:08.241ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /crucible/0/upstairs/{upstairs_id}/repair/{repair_id}/progress
912024-10-01T02:33:08.241ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /crucible/0/upstairs/{upstairs_id}/repair-finish
922024-10-01T02:33:08.241ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /crucible/0/upstairs/{upstairs_id}/repair-start
932024-10-01T02:33:08.241ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /demo-saga
942024-10-01T02:33:08.241ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /demo-saga/{demo_saga_id}/complete
952024-10-01T02:33:08.241ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /deployment/blueprints/all
962024-10-01T02:33:08.241ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = DELETE path = /deployment/blueprints/all/{blueprint_id}
972024-10-01T02:33:08.241ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /deployment/blueprints/all/{blueprint_id}
982024-10-01T02:33:08.242ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /deployment/blueprints/import
992024-10-01T02:33:08.242ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /deployment/blueprints/regenerate
1002024-10-01T02:33:08.242ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /deployment/blueprints/target
1012024-10-01T02:33:08.242ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /deployment/blueprints/target
1022024-10-01T02:33:08.242ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = PUT path = /deployment/blueprints/target/enabled
1032024-10-01T02:33:08.242ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /disk/{disk_id}/remove-read-only-parent
1042024-10-01T02:33:08.242ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = PUT path = /disks/{disk_id}
1052024-10-01T02:33:08.242ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /instances/{instance_id}/migrate
1062024-10-01T02:33:08.242ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /metrics/collectors
1072024-10-01T02:33:08.242ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /metrics/collectors/{collector_id}/producers
1082024-10-01T02:33:08.242ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /metrics/producers
1092024-10-01T02:33:08.242ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /nat/ipv4/changeset/{from_gen}
1102024-10-01T02:33:08.242ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /physical-disk/expunge
1112024-10-01T02:33:08.242ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /probes/{sled}
1122024-10-01T02:33:08.242ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = PUT path = /racks/{rack_id}/initialization-complete
1132024-10-01T02:33:08.242ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /sagas
1142024-10-01T02:33:08.242ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /sagas/{saga_id}
1152024-10-01T02:33:08.242ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /sled-agents/{sled_id}
1162024-10-01T02:33:08.242ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /sled-agents/{sled_id}
1172024-10-01T02:33:08.242ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /sled-agents/{sled_id}/firewall-rules-update
1182024-10-01T02:33:08.242ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /sleds/add
1192024-10-01T02:33:08.242ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /sleds/expunge
1202024-10-01T02:33:08.242ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /sleds/uninitialized
1212024-10-01T02:33:08.242ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = PUT path = /switch/{switch_id}
1222024-10-01T02:33:08.242ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = PUT path = /vmms/{propolis_id}
1232024-10-01T02:33:08.242ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /volume/{volume_id}/remove-read-only-parent
1242024-10-01T02:33:08.242ZINFOnexus (dropshot_internal): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:197 local_addr = [fd00:1122:3344:101::c]:12221
1252024-10-01T02:33:08.242ZDEBGnexus (dropshot_internal): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::c]:12221
1262024-10-01T02:33:08.242ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
1272024-10-01T02:33:08.243ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
1282024-10-01T02:33:08.245ZWARNnexus: Cannot look up rack: Object (of type ById(52547763-7759-42e1-81a9-8b833f59f5dd)) not found: rack file = nexus/src/app/rack.rs:770
1292024-10-01T02:33:08.284ZINFOnexus (DataLoader): created 0 built-in users file = nexus/db-queries/src/db/datastore/silo_user.rs:394
1302024-10-01T02:33:08.285ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1312024-10-01T02:33:08.286ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1322024-10-01T02:33:08.286ZDEBGnexus (DataLoader): attempting to create built-in roles
1332024-10-01T02:33:08.286ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1342024-10-01T02:33:08.286ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1352024-10-01T02:33:08.305ZINFOnexus (DataLoader): created 0 built-in roles file = nexus/db-queries/src/db/datastore/role.rs:85
1362024-10-01T02:33:08.305ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1372024-10-01T02:33:08.306ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1382024-10-01T02:33:08.306ZDEBGnexus (DataLoader): attempting to create built-in role assignments
1392024-10-01T02:33:08.306ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1402024-10-01T02:33:08.307ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1412024-10-01T02:33:08.503ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:49909
1422024-10-01T02:33:08.529ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = 005a1c70-0dc7-4be4-b02c-c8b32d0a2a11 roles = RoleSet { roles: {} } uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
1432024-10-01T02:33:08.529ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = 005a1c70-0dc7-4be4-b02c-c8b32d0a2a11 resource = Database result = Ok(()) uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
1442024-10-01T02:33:08.617ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = 005a1c70-0dc7-4be4-b02c-c8b32d0a2a11 roles = RoleSet { roles: {} } uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
1452024-10-01T02:33:08.624ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = 005a1c70-0dc7-4be4-b02c-c8b32d0a2a11 resource = Fleet result = Err(Forbidden) uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
1462024-10-01T02:33:08.624ZINFOnexus (dropshot_internal): request completed error_message_external = Forbidden error_message_internal = Forbidden file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:938 latency_us = 120895 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = 005a1c70-0dc7-4be4-b02c-c8b32d0a2a11 response_code = 403 uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
1472024-10-01T02:33:09.153ZINFOnexus (DataLoader): created 0 built-in role assignments file = nexus/db-queries/src/db/datastore/role.rs:114
1482024-10-01T02:33:09.153ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1492024-10-01T02:33:09.154ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1502024-10-01T02:33:09.154ZDEBGnexus (DataLoader): attempting to create built-in silos
1512024-10-01T02:33:09.154ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1522024-10-01T02:33:09.154ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1532024-10-01T02:33:09.297ZINFOnexus (DataLoader): created 0 built-in silos file = nexus/db-queries/src/db/datastore/silo.rs:95
1542024-10-01T02:33:09.297ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1552024-10-01T02:33:09.297ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1562024-10-01T02:33:09.315ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1572024-10-01T02:33:09.316ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1582024-10-01T02:33:09.316ZDEBGnexus (DataLoader): attempting to create built-in projects
1592024-10-01T02:33:09.316ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1602024-10-01T02:33:09.316ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1612024-10-01T02:33:09.334ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1622024-10-01T02:33:09.334ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1632024-10-01T02:33:10.145ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1642024-10-01T02:33:10.145ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1652024-10-01T02:33:10.146ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1662024-10-01T02:33:10.148ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) } result = Ok(())
1672024-10-01T02:33:10.148ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1682024-10-01T02:33:10.148ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1692024-10-01T02:33:10.185ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1702024-10-01T02:33:10.186ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1712024-10-01T02:33:10.189ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1722024-10-01T02:33:10.191ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) } result = Ok(())
1732024-10-01T02:33:10.191ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1742024-10-01T02:33:10.191ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1752024-10-01T02:33:10.223ZINFOnexus (DataLoader): created built-in services project file = nexus/db-queries/src/db/datastore/project.rs:122
1762024-10-01T02:33:10.223ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1772024-10-01T02:33:10.224ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1782024-10-01T02:33:10.224ZDEBGnexus (DataLoader): attempting to create built-in VPCs
1792024-10-01T02:33:10.224ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1802024-10-01T02:33:10.225ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1812024-10-01T02:33:10.227ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1822024-10-01T02:33:10.227ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1832024-10-01T02:33:10.246ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1842024-10-01T02:33:10.246ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1852024-10-01T02:33:10.246ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
1862024-10-01T02:33:10.246ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
1872024-10-01T02:33:10.248ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1882024-10-01T02:33:10.248ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1892024-10-01T02:33:10.248ZWARNnexus: Cannot look up rack: Object (of type ById(52547763-7759-42e1-81a9-8b833f59f5dd)) not found: rack file = nexus/src/app/rack.rs:770
1902024-10-01T02:33:10.285ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1912024-10-01T02:33:10.286ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1922024-10-01T02:33:10.314ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1932024-10-01T02:33:10.317ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) } result = Ok(())
1942024-10-01T02:33:10.318ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1952024-10-01T02:33:10.318ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1962024-10-01T02:33:10.319ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1972024-10-01T02:33:10.320ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1982024-10-01T02:33:10.321ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1992024-10-01T02:33:10.322ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2002024-10-01T02:33:10.323ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2012024-10-01T02:33:10.325ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) } result = Ok(())
2022024-10-01T02:33:10.325ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2032024-10-01T02:33:10.326ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2042024-10-01T02:33:10.427ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2052024-10-01T02:33:10.427ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2062024-10-01T02:33:10.448ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2072024-10-01T02:33:10.448ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2082024-10-01T02:33:10.467ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2092024-10-01T02:33:10.468ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2102024-10-01T02:33:10.470ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2112024-10-01T02:33:10.470ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2122024-10-01T02:33:10.472ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2132024-10-01T02:33:10.472ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2142024-10-01T02:33:10.473ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2152024-10-01T02:33:10.473ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2162024-10-01T02:33:10.475ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2172024-10-01T02:33:10.475ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2182024-10-01T02:33:10.476ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2192024-10-01T02:33:10.480ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) } result = Ok(())
2202024-10-01T02:33:10.480ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2212024-10-01T02:33:10.480ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2222024-10-01T02:33:10.481ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2232024-10-01T02:33:10.481ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2242024-10-01T02:33:10.485ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2252024-10-01T02:33:10.485ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2262024-10-01T02:33:10.489ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2272024-10-01T02:33:10.492ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) } result = Ok(())
2282024-10-01T02:33:10.492ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2292024-10-01T02:33:10.492ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2302024-10-01T02:33:10.566ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::d]:65117
2312024-10-01T02:33:10.568ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::d]:65117 req_id = 241fd9d8-6a7c-4aaf-b3cc-c75188ed5126 roles = RoleSet { roles: {} } uri = /metrics/collectors
2322024-10-01T02:33:10.568ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::d]:65117 req_id = 241fd9d8-6a7c-4aaf-b3cc-c75188ed5126 resource = Database result = Ok(()) uri = /metrics/collectors
2332024-10-01T02:33:10.605ZINFOnexus: registered new oximeter metric collection server address = [fd00:1122:3344:101::d]:12223 collector_id = 41f2943e-6041-44c9-a47a-3cf5fb012644 file = nexus/src/app/oximeter.rs:88
2342024-10-01T02:33:10.605ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 38464 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::d]:65117 req_id = 241fd9d8-6a7c-4aaf-b3cc-c75188ed5126 response_code = 204 uri = /metrics/collectors
2352024-10-01T02:33:10.612ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2362024-10-01T02:33:10.612ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2372024-10-01T02:33:10.614ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2382024-10-01T02:33:10.614ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2392024-10-01T02:33:10.615ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2402024-10-01T02:33:10.615ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2412024-10-01T02:33:10.617ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2422024-10-01T02:33:10.620ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) } result = Ok(())
2432024-10-01T02:33:10.620ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2442024-10-01T02:33:10.620ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2452024-10-01T02:33:10.632ZDEBGnexus (DataLoader): attempting to create built-in VPC firewall rules
2462024-10-01T02:33:10.632ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2472024-10-01T02:33:10.633ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2482024-10-01T02:33:10.634ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2492024-10-01T02:33:10.634ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2502024-10-01T02:33:10.635ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2512024-10-01T02:33:10.636ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2522024-10-01T02:33:10.637ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2532024-10-01T02:33:10.637ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2542024-10-01T02:33:10.638ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2552024-10-01T02:33:10.639ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2562024-10-01T02:33:10.640ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2572024-10-01T02:33:10.640ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2582024-10-01T02:33:10.641ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2592024-10-01T02:33:10.644ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
2602024-10-01T02:33:10.644ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2612024-10-01T02:33:10.644ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2622024-10-01T02:33:10.646ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2632024-10-01T02:33:10.646ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2642024-10-01T02:33:10.647ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2652024-10-01T02:33:10.647ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2662024-10-01T02:33:10.648ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2672024-10-01T02:33:10.652ZDEBGnexus (DataLoader): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
2682024-10-01T02:33:10.652ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2692024-10-01T02:33:10.653ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2702024-10-01T02:33:10.660ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::d]:54190
2712024-10-01T02:33:10.660ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54190 req_id = d0fbac18-55a8-43e5-a36a-2c8c92eb8248 roles = RoleSet { roles: {} } uri = /metrics/collectors/41f2943e-6041-44c9-a47a-3cf5fb012644/producers?sort_by=id_ascending
2722024-10-01T02:33:10.660ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54190 req_id = d0fbac18-55a8-43e5-a36a-2c8c92eb8248 resource = Database result = Ok(()) uri = /metrics/collectors/41f2943e-6041-44c9-a47a-3cf5fb012644/producers?sort_by=id_ascending
2732024-10-01T02:33:10.675ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 15317 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54190 req_id = d0fbac18-55a8-43e5-a36a-2c8c92eb8248 response_code = 200 uri = /metrics/collectors/41f2943e-6041-44c9-a47a-3cf5fb012644/producers?sort_by=id_ascending
2742024-10-01T02:33:10.678ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2752024-10-01T02:33:10.679ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2762024-10-01T02:33:10.680ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2772024-10-01T02:33:10.680ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2782024-10-01T02:33:10.681ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2792024-10-01T02:33:10.681ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2802024-10-01T02:33:10.683ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2812024-10-01T02:33:10.686ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
2822024-10-01T02:33:10.686ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2832024-10-01T02:33:10.686ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2842024-10-01T02:33:10.774ZINFOnexus (DataLoader): created built-in VPC firewall rules file = nexus/db-queries/src/db/datastore/vpc.rs:252
2852024-10-01T02:33:10.774ZDEBGnexus (DataLoader): attempting to create built-in VPC Subnets
2862024-10-01T02:33:10.774ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2872024-10-01T02:33:10.774ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2882024-10-01T02:33:10.786ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2892024-10-01T02:33:10.786ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2902024-10-01T02:33:10.788ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2912024-10-01T02:33:10.788ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2922024-10-01T02:33:10.789ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2932024-10-01T02:33:10.789ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2942024-10-01T02:33:10.791ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2952024-10-01T02:33:10.791ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2962024-10-01T02:33:10.795ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2972024-10-01T02:33:10.795ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2982024-10-01T02:33:10.798ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2992024-10-01T02:33:10.801ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
3002024-10-01T02:33:10.801ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3012024-10-01T02:33:10.801ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3022024-10-01T02:33:10.803ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3032024-10-01T02:33:10.804ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3042024-10-01T02:33:10.816ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3052024-10-01T02:33:10.816ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3062024-10-01T02:33:10.818ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3072024-10-01T02:33:10.818ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3082024-10-01T02:33:10.820ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3092024-10-01T02:33:10.820ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3102024-10-01T02:33:10.821ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3112024-10-01T02:33:10.821ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3122024-10-01T02:33:10.823ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3132024-10-01T02:33:10.823ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3142024-10-01T02:33:10.824ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3152024-10-01T02:33:10.827ZDEBGnexus (DataLoader): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ById(001de000-c470-4000-8000-000000000001) } result = Ok(())
3162024-10-01T02:33:10.827ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3172024-10-01T02:33:10.828ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3182024-10-01T02:33:10.842ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3192024-10-01T02:33:10.842ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3202024-10-01T02:33:10.844ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3212024-10-01T02:33:10.844ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3222024-10-01T02:33:10.845ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3232024-10-01T02:33:10.845ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3242024-10-01T02:33:10.847ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3252024-10-01T02:33:10.849ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
3262024-10-01T02:33:10.881ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3272024-10-01T02:33:10.881ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3282024-10-01T02:33:10.967ZWARNnexus (datastore): Retryable transaction failure file = nexus/db-queries/src/transaction_retry.rs:160 retry_after (ms) = 25 transaction = vpc_subnet_route_reconcile
3292024-10-01T02:33:11.014ZINFOnexus (datastore): transaction completed attempts = 2 file = nexus/db-queries/src/transaction_retry.rs:116 transaction = vpc_subnet_route_reconcile
3302024-10-01T02:33:11.014ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3312024-10-01T02:33:11.014ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3322024-10-01T02:33:11.043ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3332024-10-01T02:33:11.044ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3342024-10-01T02:33:11.045ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3352024-10-01T02:33:11.046ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3362024-10-01T02:33:11.048ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3372024-10-01T02:33:11.049ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3382024-10-01T02:33:11.051ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3392024-10-01T02:33:11.055ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) } result = Ok(())
3402024-10-01T02:33:11.056ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3412024-10-01T02:33:11.056ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3422024-10-01T02:33:11.087ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3432024-10-01T02:33:11.088ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3442024-10-01T02:33:11.092ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3452024-10-01T02:33:11.093ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3462024-10-01T02:33:11.105ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3472024-10-01T02:33:11.106ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3482024-10-01T02:33:11.120ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3492024-10-01T02:33:11.120ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3502024-10-01T02:33:11.136ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3512024-10-01T02:33:11.141ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
3522024-10-01T02:33:11.180ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3532024-10-01T02:33:11.180ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3542024-10-01T02:33:11.227ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3552024-10-01T02:33:11.227ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3562024-10-01T02:33:11.283ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3572024-10-01T02:33:11.283ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3582024-10-01T02:33:11.285ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3592024-10-01T02:33:11.286ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3602024-10-01T02:33:11.287ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3612024-10-01T02:33:11.287ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3622024-10-01T02:33:11.289ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3632024-10-01T02:33:11.293ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) } result = Ok(())
3642024-10-01T02:33:11.293ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3652024-10-01T02:33:11.293ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3662024-10-01T02:33:11.308ZINFOnexus (DataLoader): created built-in services vpc subnets file = nexus/db-queries/src/db/datastore/vpc.rs:316
3672024-10-01T02:33:11.308ZINFOnexus (DataLoader): created built-in services vpc file = nexus/db-queries/src/db/datastore/vpc.rs:194
3682024-10-01T02:33:11.308ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3692024-10-01T02:33:11.309ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3702024-10-01T02:33:11.309ZDEBGnexus (DataLoader): attempting to create silo users
3712024-10-01T02:33:11.309ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3722024-10-01T02:33:11.309ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3732024-10-01T02:33:11.355ZINFOnexus (DataLoader): created 2 silo users file = nexus/db-queries/src/db/datastore/silo_user.rs:419
3742024-10-01T02:33:11.355ZDEBGnexus (DataLoader): attempting to create silo user role assignments
3752024-10-01T02:33:11.355ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3762024-10-01T02:33:11.355ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3772024-10-01T02:33:11.363ZINFOnexus (DataLoader): created 2 silo user role assignments file = nexus/db-queries/src/db/datastore/silo_user.rs:446
3782024-10-01T02:33:11.363ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3792024-10-01T02:33:11.364ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3802024-10-01T02:33:11.371ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3812024-10-01T02:33:11.371ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3822024-10-01T02:33:11.383ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3832024-10-01T02:33:11.384ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3842024-10-01T02:33:11.385ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3852024-10-01T02:33:11.386ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = IpPoolList result = Ok(())
3862024-10-01T02:33:11.386ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3872024-10-01T02:33:11.387ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3882024-10-01T02:33:11.403ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3892024-10-01T02:33:11.404ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3902024-10-01T02:33:11.406ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3912024-10-01T02:33:11.407ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = IpPoolList result = Ok(())
3922024-10-01T02:33:11.407ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3932024-10-01T02:33:11.407ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3942024-10-01T02:33:11.487ZINFOnexus: populate complete file = nexus/src/app/mod.rs:514
3952024-10-01T02:33:11.487ZINFOnexus: activating background tasks file = nexus/src/app/mod.rs:523
3962024-10-01T02:33:11.489ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 1 reason = Timeout
3972024-10-01T02:33:11.489ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 1 reason = Timeout
3982024-10-01T02:33:11.489ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 1 reason = Timeout
3992024-10-01T02:33:11.489ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 1 reason = Timeout
4002024-10-01T02:33:11.489ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 1 reason = Timeout
4012024-10-01T02:33:11.489ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 1 reason = Timeout
4022024-10-01T02:33:11.489ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 1 reason = Timeout
4032024-10-01T02:33:11.489ZWARNnexus (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:61 reason = no config nor servers
4042024-10-01T02:33:11.489ZWARNnexus (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:61 reason = no config nor servers
4052024-10-01T02:33:11.489ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 1 reason = Timeout
4062024-10-01T02:33:11.489ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 1 reason = Timeout
4072024-10-01T02:33:11.489ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
4082024-10-01T02:33:11.489ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 1 reason = Timeout
4092024-10-01T02:33:11.489ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 1 reason = Timeout
4102024-10-01T02:33:11.489ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = crdb_node_id_collector file = nexus/src/app/background/tasks/crdb_node_id_collector.rs:78 reason = no blueprint
4112024-10-01T02:33:11.489ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
4122024-10-01T02:33:11.489ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
4132024-10-01T02:33:11.489ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 1 reason = Timeout
4142024-10-01T02:33:11.489ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-10-01 02:23:11.489159554 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
4152024-10-01T02:33:11.489ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:74 reason = no blueprint
4162024-10-01T02:33:11.489ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
4172024-10-01T02:33:11.489ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 1 reason = Timeout
4182024-10-01T02:33:11.489ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
4192024-10-01T02:33:11.489ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 1 reason = Timeout
4202024-10-01T02:33:11.489ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 1 reason = Timeout
4212024-10-01T02:33:11.489ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 45.241\u{b5}s iteration = 1 status = {"error":"no blueprint"}
4222024-10-01T02:33:11.489ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 152.363\u{b5}s iteration = 1 status = {"error":"no config nor servers"}
4232024-10-01T02:33:11.489ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 1 reason = Timeout
4242024-10-01T02:33:11.489ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 31.051\u{b5}s iteration = 1 status = {"error":"no blueprint"}
4252024-10-01T02:33:11.489ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 108.531\u{b5}s iteration = 1 status = {"error":"no config nor servers"}
4262024-10-01T02:33:11.489ZDEBGnexus (BackgroundTasks): activating background_task = inventory_collection iteration = 1 reason = Timeout
4272024-10-01T02:33:11.489ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 1 reason = Timeout
4282024-10-01T02:33:11.489ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 1 reason = Timeout
4292024-10-01T02:33:11.489ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 1 reason = Timeout
4302024-10-01T02:33:11.489ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 1 reason = Timeout
4312024-10-01T02:33:11.490ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
4322024-10-01T02:33:11.490ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
4332024-10-01T02:33:11.490ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
4342024-10-01T02:33:11.490ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 1 reason = Timeout
4352024-10-01T02:33:11.490ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 1 reason = Timeout
4362024-10-01T02:33:11.490ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
4372024-10-01T02:33:11.490ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
4382024-10-01T02:33:11.490ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 1 reason = Timeout
4392024-10-01T02:33:11.490ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 1 reason = Timeout
4402024-10-01T02:33:11.490ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
4412024-10-01T02:33:11.490ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 1 reason = Timeout
4422024-10-01T02:33:11.490ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
4432024-10-01T02:33:11.490ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 1 reason = Timeout
4442024-10-01T02:33:11.490ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
4452024-10-01T02:33:11.490ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
4462024-10-01T02:33:11.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
4472024-10-01T02:33:11.491ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 1 reason = Timeout
4482024-10-01T02:33:11.491ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 1 reason = Timeout
4492024-10-01T02:33:11.492ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
4502024-10-01T02:33:11.492ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 1 reason = Timeout
4512024-10-01T02:33:11.492ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4522024-10-01T02:33:11.492ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
4532024-10-01T02:33:11.492ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
4542024-10-01T02:33:11.492ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4552024-10-01T02:33:11.492ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
4562024-10-01T02:33:11.492ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 1 reason = Timeout
4572024-10-01T02:33:11.492ZDEBGnexus (BackgroundTasks): activating background_task = saga_recovery iteration = 1 reason = Timeout
4582024-10-01T02:33:11.492ZDEBGnexus (SagaRecoverer): listing candidate sagas for recovery
4592024-10-01T02:33:11.492ZDEBGnexus (SagaRecoverer): roles roles = RoleSet { roles: {} }
4602024-10-01T02:33:11.492ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 1 reason = Timeout
4612024-10-01T02:33:11.492ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 1 reason = Timeout
4622024-10-01T02:33:11.492ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
4632024-10-01T02:33:11.492ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
4642024-10-01T02:33:11.492ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
4652024-10-01T02:33:11.492ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
4662024-10-01T02:33:11.492ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
4672024-10-01T02:33:11.492ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
4682024-10-01T02:33:11.492ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
4692024-10-01T02:33:11.493ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4702024-10-01T02:33:11.493ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
4712024-10-01T02:33:11.493ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
4722024-10-01T02:33:11.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4732024-10-01T02:33:11.493ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
4742024-10-01T02:33:11.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
4752024-10-01T02:33:11.494ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
4762024-10-01T02:33:11.494ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
4772024-10-01T02:33:11.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
4782024-10-01T02:33:11.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
4792024-10-01T02:33:11.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
4802024-10-01T02:33:11.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4812024-10-01T02:33:11.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
4822024-10-01T02:33:11.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
4832024-10-01T02:33:11.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
4842024-10-01T02:33:11.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
4852024-10-01T02:33:11.495ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4862024-10-01T02:33:11.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
4872024-10-01T02:33:11.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
4882024-10-01T02:33:11.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
4892024-10-01T02:33:11.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
4902024-10-01T02:33:11.496ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
4912024-10-01T02:33:11.496ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
4922024-10-01T02:33:11.496ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
4932024-10-01T02:33:11.496ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
4942024-10-01T02:33:11.496ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4952024-10-01T02:33:11.496ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
4962024-10-01T02:33:11.496ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
4972024-10-01T02:33:11.496ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
4982024-10-01T02:33:11.496ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("0a1ed896-5078-4267-b636-10151376f015.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("eb937866-c779-4a9e-aec4-cc18302d4ce1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("eb937866-c779-4a9e-aec4-cc18302d4ce1.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1244, tv_nsec: 940491216 } })
4992024-10-01T02:33:11.496ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
5002024-10-01T02:33:11.496ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
5012024-10-01T02:33:11.496ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
5022024-10-01T02:33:11.496ZDEBGnexus (SagaRecoverer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000003a8a, .. }) resource = Database result = Ok(())
5032024-10-01T02:33:11.496ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
5042024-10-01T02:33:11.498ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("1af5fb25-d768-4bc6-915c-0b4c59e1f0ef.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("293e78c2-b712-4c13-b502-e2be11a76306.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("71ea2e4f-4772-4ce7-8093-48597fd7fd92.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("71ea2e4f-4772-4ce7-8093-48597fd7fd92.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1244, tv_nsec: 941673546 } })
5052024-10-01T02:33:11.498ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
5062024-10-01T02:33:11.498ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5072024-10-01T02:33:11.498ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5082024-10-01T02:33:11.499ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
5092024-10-01T02:33:11.499ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
5102024-10-01T02:33:11.499ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
5112024-10-01T02:33:11.500ZINFOnexus (BackgroundTasks): found DNS servers (initial) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external dns_group = external file = nexus/src/app/background/tasks/dns_servers.rs:113
5122024-10-01T02:33:11.500ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 11.277318ms iteration = 1 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
5132024-10-01T02:33:11.500ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 2 reason = Dependency
5142024-10-01T02:33:11.500ZWARNnexus (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:69 reason = no config
5152024-10-01T02:33:11.500ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 5.57\u{b5}s iteration = 2 status = {"error":"no config"}
5162024-10-01T02:33:11.501ZINFOnexus (BackgroundTasks): found DNS servers (initial) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal dns_group = internal file = nexus/src/app/background/tasks/dns_servers.rs:113
5172024-10-01T02:33:11.501ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 12.56083ms iteration = 1 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
5182024-10-01T02:33:11.501ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 2 reason = Dependency
5192024-10-01T02:33:11.501ZWARNnexus (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:69 reason = no config
5202024-10-01T02:33:11.501ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 3.03\u{b5}s iteration = 2 status = {"error":"no config"}
5212024-10-01T02:33:11.504ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5222024-10-01T02:33:11.507ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
5232024-10-01T02:33:11.507ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5242024-10-01T02:33:11.507ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5252024-10-01T02:33:11.511ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5262024-10-01T02:33:11.513ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
5272024-10-01T02:33:11.513ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
5282024-10-01T02:33:11.513ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
5292024-10-01T02:33:11.515ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5302024-10-01T02:33:11.516ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5312024-10-01T02:33:11.536ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1244, tv_nsec: 980270363 } })
5322024-10-01T02:33:11.538ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1051
5332024-10-01T02:33:11.544ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1244, tv_nsec: 987757858 } })
5342024-10-01T02:33:11.546ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1051
5352024-10-01T02:33:11.547ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-10-01 02:23:11.489159554 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
5362024-10-01T02:33:11.547ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 58.50143ms iteration = 1 status = {"expiration":"2024-10-01T02:23:11.489159554Z","pruned":[]}
5372024-10-01T02:33:11.549ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 58.660223ms iteration = 1 status = {"errors":[],"found_port_ok":[]}
5382024-10-01T02:33:11.549ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
5392024-10-01T02:33:11.550ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
5402024-10-01T02:33:11.552ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
5412024-10-01T02:33:11.552ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
5422024-10-01T02:33:11.555ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 66.163059ms iteration = 1 status = {}
5432024-10-01T02:33:11.559ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 69.142388ms iteration = 1 status = {"errors":[],"records_set_to_done":[]}
5442024-10-01T02:33:11.560ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
5452024-10-01T02:33:11.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
5462024-10-01T02:33:11.562ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5472024-10-01T02:33:11.562ZWARNnexus (BackgroundTasks): failed to read target blueprint background_task = blueprint_loader error = Internal Error: no target blueprint set file = nexus/src/app/background/tasks/blueprint_load.rs:69
5482024-10-01T02:33:11.562ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 73.41735ms iteration = 1 status = {"error":"failed to read target blueprint: Internal Error: no target blueprint set"}
5492024-10-01T02:33:11.562ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
5502024-10-01T02:33:11.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
5512024-10-01T02:33:11.564ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5522024-10-01T02:33:11.564ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5532024-10-01T02:33:11.565ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5542024-10-01T02:33:11.565ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5552024-10-01T02:33:11.566ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
5562024-10-01T02:33:11.566ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
5572024-10-01T02:33:11.566ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
5582024-10-01T02:33:11.567ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5592024-10-01T02:33:11.568ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 78.299232ms iteration = 1 status = {"errors":[],"garbage_collect_requested":[]}
5602024-10-01T02:33:11.569ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
5612024-10-01T02:33:11.569ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5622024-10-01T02:33:11.570ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
5632024-10-01T02:33:11.570ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
5642024-10-01T02:33:11.570ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
5652024-10-01T02:33:11.570ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
5662024-10-01T02:33:11.570ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
5672024-10-01T02:33:11.570ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
5682024-10-01T02:33:11.570ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
5692024-10-01T02:33:11.571ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
5702024-10-01T02:33:11.571ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
5712024-10-01T02:33:11.571ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
5722024-10-01T02:33:11.572ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 83.185474ms iteration = 1 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
5732024-10-01T02:33:11.573ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
5742024-10-01T02:33:11.573ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
5752024-10-01T02:33:11.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
5762024-10-01T02:33:11.574ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5772024-10-01T02:33:11.576ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5782024-10-01T02:33:11.576ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5792024-10-01T02:33:11.576ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
5802024-10-01T02:33:11.576ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
5812024-10-01T02:33:11.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5822024-10-01T02:33:11.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
5832024-10-01T02:33:11.578ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
5842024-10-01T02:33:11.578ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
5852024-10-01T02:33:11.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
5862024-10-01T02:33:11.581ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5872024-10-01T02:33:11.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5882024-10-01T02:33:11.583ZINFOnexus (BackgroundTasks): Physical Disk Adoption: Rack not yet initialized background_task = physical_disk_adoption file = nexus/src/app/background/tasks/physical_disk_adoption.rs:79 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd
5892024-10-01T02:33:11.583ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 94.582625ms iteration = 1 status = {"error":"rack not yet initialized: 52547763-7759-42e1-81a9-8b833f59f5dd"}
5902024-10-01T02:33:11.583ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5912024-10-01T02:33:11.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5922024-10-01T02:33:11.602ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
5932024-10-01T02:33:11.602ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
5942024-10-01T02:33:11.602ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 112.438495ms iteration = 1 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
5952024-10-01T02:33:11.607ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
5962024-10-01T02:33:11.607ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
5972024-10-01T02:33:11.607ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 118.242691ms iteration = 1 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
5982024-10-01T02:33:11.609ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
5992024-10-01T02:33:11.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
6002024-10-01T02:33:11.613ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6012024-10-01T02:33:11.616ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 125.781758ms iteration = 1 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
6022024-10-01T02:33:11.617ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
6032024-10-01T02:33:11.617ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
6042024-10-01T02:33:11.617ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
6052024-10-01T02:33:11.619ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1059 zone_address = fd00:1122:3344:101::2
6062024-10-01T02:33:11.619ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
6072024-10-01T02:33:11.619ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4a5433b0-de79-4750-a24e-380192975bbf", "content-length": "26", "date": "Tue, 01 Oct 2024 02:33:11 GMT"} })
6082024-10-01T02:33:11.619ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1064 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
6092024-10-01T02:33:11.621ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
6102024-10-01T02:33:11.621ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1059 zone_address = fd00:1122:3344:101::2
6112024-10-01T02:33:11.621ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
6122024-10-01T02:33:11.621ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "125c32e6-0141-4c43-a1e0-2e5d74251f04", "content-length": "26", "date": "Tue, 01 Oct 2024 02:33:11 GMT"} })
6132024-10-01T02:33:11.622ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1064 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
6142024-10-01T02:33:11.622ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6152024-10-01T02:33:11.622ZINFOnexus (SagaRecoverer): listed in-progress sagas count = 0 file = nexus/src/app/background/tasks/saga_recovery.rs:438
6162024-10-01T02:33:11.622ZDEBGnexus (BackgroundTasks): activation complete background_task = saga_recovery elapsed = 132.302487ms iteration = 1 status = {"last_pass":{"Success":{"nfailed":0,"nfound":0,"nrecovered":0,"nremoved":0,"nskipped":0}},"ntotal_failures":0,"ntotal_finished":0,"ntotal_recovered":0,"ntotal_sec_errors_bad_state":0,"ntotal_sec_errors_missing":0,"ntotal_started":0,"recent_failures":[],"recent_recoveries":[]}
6172024-10-01T02:33:11.623ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
6182024-10-01T02:33:11.625ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
6192024-10-01T02:33:11.625ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
6202024-10-01T02:33:11.625ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
6212024-10-01T02:33:11.625ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
6222024-10-01T02:33:11.625ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
6232024-10-01T02:33:11.626ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
6242024-10-01T02:33:11.626ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
6252024-10-01T02:33:11.628ZWARNnexus (BackgroundTasks): failed to read DNS config background_task = dns_config_external dns_group = external error = Internal Error: expected exactly one latest version for DNS group External, found 0 file = nexus/src/app/background/tasks/dns_config.rs:72
6262024-10-01T02:33:11.628ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 139.758922ms iteration = 1 status = {"error":"failed to read DNS config: Internal Error: expected exactly one latest version for DNS group External, found 0"}
6272024-10-01T02:33:11.631ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
6282024-10-01T02:33:11.631ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
6292024-10-01T02:33:11.631ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
6302024-10-01T02:33:11.631ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
6312024-10-01T02:33:11.636ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
6322024-10-01T02:33:11.636ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 146.23269ms iteration = 1 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
6332024-10-01T02:33:11.642ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6342024-10-01T02:33:11.646ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
6352024-10-01T02:33:11.646ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6362024-10-01T02:33:11.646ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6372024-10-01T02:33:11.654ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 164.494027ms iteration = 1 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
6382024-10-01T02:33:11.658ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 169.307167ms iteration = 1 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
6392024-10-01T02:33:11.661ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
6402024-10-01T02:33:11.662ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
6412024-10-01T02:33:11.665ZWARNnexus (BackgroundTasks): failed to read DNS config background_task = dns_config_internal dns_group = internal error = Internal Error: expected exactly one latest version for DNS group Internal, found 0 file = nexus/src/app/background/tasks/dns_config.rs:72
6422024-10-01T02:33:11.665ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 176.499667ms iteration = 1 status = {"error":"failed to read DNS config: Internal Error: expected exactly one latest version for DNS group Internal, found 0"}
6432024-10-01T02:33:11.666ZWARNnexus (BackgroundTasks): failed to read Silo/DNS/TLS configuration background_task = external_endpoints error = Internal Error: expected at least one external DNS zone file = nexus/src/app/background/tasks/external_endpoints.rs:48
6442024-10-01T02:33:11.666ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 177.410583ms iteration = 1 status = {"error":"failed to read Silo/DNS/TLS configuration: Internal Error: expected at least one external DNS zone"}
6452024-10-01T02:33:11.666ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 176.300784ms iteration = 1 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
6462024-10-01T02:33:11.684ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
6472024-10-01T02:33:11.684ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 194.402498ms iteration = 1 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
6482024-10-01T02:33:11.685ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6492024-10-01T02:33:11.685ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6502024-10-01T02:33:11.686ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6512024-10-01T02:33:11.686ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 197.555661ms iteration = 1 status = {}
6522024-10-01T02:33:11.686ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6532024-10-01T02:33:11.687ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6542024-10-01T02:33:11.691ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
6552024-10-01T02:33:11.691ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6562024-10-01T02:33:11.691ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6572024-10-01T02:33:11.694ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
6582024-10-01T02:33:11.695ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "fe984e3d-7371-4227-a754-58f77579a81a", "content-length": "1", "date": "Tue, 01 Oct 2024 02:33:11 GMT"} })
6592024-10-01T02:33:11.696ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
6602024-10-01T02:33:11.696ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
6612024-10-01T02:33:11.713ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
6622024-10-01T02:33:11.713ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
6632024-10-01T02:33:11.713ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 223.465224ms iteration = 1 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
6642024-10-01T02:33:11.721ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
6652024-10-01T02:33:11.727ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "489e4538-d1bd-4a23-8242-8ba219063c99", "content-length": "312", "date": "Tue, 01 Oct 2024 02:33:11 GMT"} })
6662024-10-01T02:33:11.727ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
6672024-10-01T02:33:11.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
6682024-10-01T02:33:11.733ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
6692024-10-01T02:33:11.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
6702024-10-01T02:33:11.737ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
6712024-10-01T02:33:11.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
6722024-10-01T02:33:11.741ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
6732024-10-01T02:33:11.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
6742024-10-01T02:33:11.743ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
6752024-10-01T02:33:11.743ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
6762024-10-01T02:33:11.745ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
6772024-10-01T02:33:11.745ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
6782024-10-01T02:33:11.747ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
6792024-10-01T02:33:11.747ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
6802024-10-01T02:33:11.748ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
6812024-10-01T02:33:11.749ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
6822024-10-01T02:33:11.750ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
6832024-10-01T02:33:11.750ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
6842024-10-01T02:33:11.751ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
6852024-10-01T02:33:11.751ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
6862024-10-01T02:33:11.753ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6872024-10-01T02:33:11.757ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) } result = Ok(())
6882024-10-01T02:33:11.757ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
6892024-10-01T02:33:11.757ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
6902024-10-01T02:33:11.758ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
6912024-10-01T02:33:11.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
6922024-10-01T02:33:11.758ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
6932024-10-01T02:33:11.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
6942024-10-01T02:33:11.760ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
6952024-10-01T02:33:11.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
6962024-10-01T02:33:11.760ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6972024-10-01T02:33:11.761ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6982024-10-01T02:33:11.762ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
6992024-10-01T02:33:11.762ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7002024-10-01T02:33:11.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7012024-10-01T02:33:11.763ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7022024-10-01T02:33:11.765ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) } result = Ok(())
7032024-10-01T02:33:11.765ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7042024-10-01T02:33:11.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7052024-10-01T02:33:11.766ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
7062024-10-01T02:33:11.766ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7072024-10-01T02:33:11.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7082024-10-01T02:33:11.768ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 279.486874ms iteration = 1 status = null
7092024-10-01T02:33:11.769ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7102024-10-01T02:33:11.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7112024-10-01T02:33:11.772ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7122024-10-01T02:33:11.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7132024-10-01T02:33:11.773ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7142024-10-01T02:33:11.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7152024-10-01T02:33:11.775ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7162024-10-01T02:33:11.775ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7172024-10-01T02:33:11.780ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7182024-10-01T02:33:11.780ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7192024-10-01T02:33:11.782ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7202024-10-01T02:33:11.782ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7212024-10-01T02:33:11.783ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7222024-10-01T02:33:11.783ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7232024-10-01T02:33:11.785ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7242024-10-01T02:33:11.785ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7252024-10-01T02:33:11.785ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7262024-10-01T02:33:11.787ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7272024-10-01T02:33:11.787ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7282024-10-01T02:33:11.788ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
7292024-10-01T02:33:11.788ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7302024-10-01T02:33:11.789ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7312024-10-01T02:33:11.789ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7322024-10-01T02:33:11.789ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7332024-10-01T02:33:11.790ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7342024-10-01T02:33:11.790ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7352024-10-01T02:33:11.791ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7362024-10-01T02:33:11.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7372024-10-01T02:33:11.792ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7382024-10-01T02:33:11.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7392024-10-01T02:33:11.794ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7402024-10-01T02:33:11.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7412024-10-01T02:33:11.797ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7422024-10-01T02:33:11.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7432024-10-01T02:33:11.798ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7442024-10-01T02:33:11.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7452024-10-01T02:33:11.799ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7462024-10-01T02:33:11.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7472024-10-01T02:33:11.801ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7482024-10-01T02:33:11.805ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-c470-4000-8000-000000000003, lookup_type: ByName("boundary-ntp") } result = Ok(())
7492024-10-01T02:33:11.805ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7502024-10-01T02:33:11.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7512024-10-01T02:33:11.806ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7522024-10-01T02:33:11.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7532024-10-01T02:33:11.808ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7542024-10-01T02:33:11.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7552024-10-01T02:33:11.810ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7562024-10-01T02:33:11.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7572024-10-01T02:33:11.811ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7582024-10-01T02:33:11.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7592024-10-01T02:33:11.813ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7602024-10-01T02:33:11.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7612024-10-01T02:33:11.816ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7622024-10-01T02:33:11.816ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7632024-10-01T02:33:11.817ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7642024-10-01T02:33:11.821ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
7652024-10-01T02:33:11.822ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
7662024-10-01T02:33:11.825ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7672024-10-01T02:33:11.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7682024-10-01T02:33:11.827ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7692024-10-01T02:33:11.827ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7702024-10-01T02:33:11.828ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7712024-10-01T02:33:11.829ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "03b16f70-2f46-4389-b9e8-e16364c702fa", "date": "Tue, 01 Oct 2024 02:33:11 GMT"} })
7722024-10-01T02:33:11.831ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
7732024-10-01T02:33:11.831ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7742024-10-01T02:33:11.831ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7752024-10-01T02:33:11.832ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 341.90015ms iteration = 1 status = {}
7762024-10-01T02:33:11.833ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7772024-10-01T02:33:11.833ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7782024-10-01T02:33:11.835ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7792024-10-01T02:33:11.835ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7802024-10-01T02:33:11.837ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7812024-10-01T02:33:11.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7822024-10-01T02:33:11.840ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7832024-10-01T02:33:11.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7842024-10-01T02:33:11.842ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7852024-10-01T02:33:11.842ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7862024-10-01T02:33:11.843ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7872024-10-01T02:33:11.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7882024-10-01T02:33:11.847ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7892024-10-01T02:33:11.851ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
7902024-10-01T02:33:11.851ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7912024-10-01T02:33:11.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7922024-10-01T02:33:11.852ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7932024-10-01T02:33:11.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7942024-10-01T02:33:11.853ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7952024-10-01T02:33:11.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7962024-10-01T02:33:11.855ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7972024-10-01T02:33:11.858ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
7982024-10-01T02:33:11.859ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "e37cc2a5-5772-4218-8ca6-85ae1fda9137", "content-length": "691", "date": "Tue, 01 Oct 2024 02:33:11 GMT"} })
7992024-10-01T02:33:11.859ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
8002024-10-01T02:33:11.859ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
8012024-10-01T02:33:11.859ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
8022024-10-01T02:33:11.859ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
8032024-10-01T02:33:11.859ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8042024-10-01T02:33:11.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8052024-10-01T02:33:11.860ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 371.385243ms iteration = 1 status = {}
8062024-10-01T02:33:11.862ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8072024-10-01T02:33:11.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8082024-10-01T02:33:11.864ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8092024-10-01T02:33:11.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8102024-10-01T02:33:11.866ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8112024-10-01T02:33:11.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8122024-10-01T02:33:11.869ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8132024-10-01T02:33:11.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8142024-10-01T02:33:11.871ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8152024-10-01T02:33:11.871ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8162024-10-01T02:33:11.873ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8172024-10-01T02:33:11.873ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8182024-10-01T02:33:11.874ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8192024-10-01T02:33:11.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8202024-10-01T02:33:11.875ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8212024-10-01T02:33:11.879ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
8222024-10-01T02:33:11.879ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8232024-10-01T02:33:11.879ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8242024-10-01T02:33:11.880ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8252024-10-01T02:33:11.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8262024-10-01T02:33:11.882ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8272024-10-01T02:33:11.882ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8282024-10-01T02:33:11.883ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8292024-10-01T02:33:11.887ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
8302024-10-01T02:33:11.887ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8312024-10-01T02:33:11.887ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8322024-10-01T02:33:11.892ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {} subnet_networks = {Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })], Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })]} vpc_interfaces = {}
8332024-10-01T02:33:11.892ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8342024-10-01T02:33:11.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8352024-10-01T02:33:11.894ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8362024-10-01T02:33:11.895ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
8372024-10-01T02:33:11.895ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8382024-10-01T02:33:11.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8392024-10-01T02:33:11.908ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
8402024-10-01T02:33:11.908ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = []
8412024-10-01T02:33:11.908ZDEBGnexus (service-firewall-rule-progator): resolved 0 rules for sleds background_task = service_firewall_rule_propagation
8422024-10-01T02:33:12.059ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
8432024-10-01T02:33:12.059ZDEBGnexus (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(f4292df9-35df-497b-a9dc-2e40f77ad419, 0), (c4c1c8ca-7be6-4a78-9a5c-d371c17c5887, 0)]
8442024-10-01T02:33:12.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
8452024-10-01T02:33:12.060ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1245, tv_nsec: 504089731 } })
8462024-10-01T02:33:12.095ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = []
8472024-10-01T02:33:12.095ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
8482024-10-01T02:33:12.095ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 0 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
8492024-10-01T02:33:12.095ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 602.605699ms
8502024-10-01T02:33:12.095ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 605.13628ms iteration = 1 status = {}
8512024-10-01T02:33:12.099ZDEBGnexus (BackgroundTasks): begin collection background_task = inventory_collection
8522024-10-01T02:33:12.099ZDEBGnexus (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[fd00:1122:3344:101::2]:12225
8532024-10-01T02:33:12.099ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/ignition
8542024-10-01T02:33:12.100ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "f14fe7fa-ed22-4e18-8e10-ee4db65a250f", "content-length": "476", "date": "Tue, 01 Oct 2024 02:33:11 GMT"} })
8552024-10-01T02:33:12.101ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0
8562024-10-01T02:33:12.102ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "95b68afe-2aff-4334-9fe8-908a76ed43de", "content-length": "734", "date": "Tue, 01 Oct 2024 02:33:11 GMT"} })
8572024-10-01T02:33:12.103ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0
8582024-10-01T02:33:12.103ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "816c7a7f-9945-4c44-b5d5-950d8acb2082", "content-length": "111", "date": "Tue, 01 Oct 2024 02:33:11 GMT"} })
8592024-10-01T02:33:12.103ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1
8602024-10-01T02:33:12.104ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "b05a8b5a-5e02-4042-862d-c613e3be71fc", "content-length": "111", "date": "Tue, 01 Oct 2024 02:33:11 GMT"} })
8612024-10-01T02:33:12.105ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0
8622024-10-01T02:33:12.105ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "18112b7b-c4dd-41ad-b195-a8fcd2a590d5", "content-length": "167", "date": "Tue, 01 Oct 2024 02:33:11 GMT"} })
8632024-10-01T02:33:12.105ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1
8642024-10-01T02:33:12.106ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "c36914a7-4f8d-46e7-8ed3-7fac143220f5", "content-length": "167", "date": "Tue, 01 Oct 2024 02:33:11 GMT"} })
8652024-10-01T02:33:12.106ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0
8662024-10-01T02:33:12.107ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "2a72c8e4-ad29-440b-bbed-13052b0806c6", "content-length": "175", "date": "Tue, 01 Oct 2024 02:33:11 GMT"} })
8672024-10-01T02:33:12.107ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1
8682024-10-01T02:33:12.107ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "5c787107-254b-4919-976c-f2dad74c7488", "content-length": "175", "date": "Tue, 01 Oct 2024 02:33:11 GMT"} })
8692024-10-01T02:33:12.107ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa
8702024-10-01T02:33:12.107ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "27f5bd08-b4c7-4b26-a38b-80a91e6b3281", "content-length": "702", "date": "Tue, 01 Oct 2024 02:33:11 GMT"} })
8712024-10-01T02:33:12.107ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
8722024-10-01T02:33:12.108ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "7a150c9c-bdaf-4e99-8fc1-b386a433a504", "content-length": "727", "date": "Tue, 01 Oct 2024 02:33:11 GMT"} })
8732024-10-01T02:33:12.108ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
8742024-10-01T02:33:12.108ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "664a7dae-aa02-4674-965f-5954e7ac591c", "content-length": "729", "date": "Tue, 01 Oct 2024 02:33:11 GMT"} })
8752024-10-01T02:33:12.108ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
8762024-10-01T02:33:12.108ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "364d034e-6b63-4243-85f1-26f136598ae3", "content-length": "728", "date": "Tue, 01 Oct 2024 02:33:11 GMT"} })
8772024-10-01T02:33:12.108ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0
8782024-10-01T02:33:12.109ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "0b78607a-3d19-4c4f-9c3d-4eb2b2ce4ac9", "content-length": "722", "date": "Tue, 01 Oct 2024 02:33:11 GMT"} })
8792024-10-01T02:33:12.109ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0
8802024-10-01T02:33:12.110ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "8081ec92-4a4b-48a2-bfa1-0075bd3f034f", "content-length": "109", "date": "Tue, 01 Oct 2024 02:33:11 GMT"} })
8812024-10-01T02:33:12.110ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1
8822024-10-01T02:33:12.110ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "ae499a3b-ae4e-4225-9772-dc73b085dad7", "content-length": "109", "date": "Tue, 01 Oct 2024 02:33:11 GMT"} })
8832024-10-01T02:33:12.110ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0
8842024-10-01T02:33:12.112ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "74f05635-0823-4f92-8327-f41fe2162285", "content-length": "169", "date": "Tue, 01 Oct 2024 02:33:11 GMT"} })
8852024-10-01T02:33:12.112ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1
8862024-10-01T02:33:12.113ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "37e6e377-8a59-4446-90b5-dcde132d460c", "content-length": "169", "date": "Tue, 01 Oct 2024 02:33:11 GMT"} })
8872024-10-01T02:33:12.113ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0
8882024-10-01T02:33:12.113ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "49adea5a-2983-45ef-a2b9-4b4d1cacc4af", "content-length": "178", "date": "Tue, 01 Oct 2024 02:33:11 GMT"} })
8892024-10-01T02:33:12.113ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1
8902024-10-01T02:33:12.113ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "c794f697-84e1-4e4e-91e8-4f4af53025a3", "content-length": "178", "date": "Tue, 01 Oct 2024 02:33:11 GMT"} })
8912024-10-01T02:33:12.113ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa
8922024-10-01T02:33:12.114ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "80297d9d-9461-4b8a-8d59-85838b281919", "content-length": "702", "date": "Tue, 01 Oct 2024 02:33:11 GMT"} })
8932024-10-01T02:33:12.114ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
8942024-10-01T02:33:12.114ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "79c81086-9881-4d88-942c-36d5c6abc561", "content-length": "727", "date": "Tue, 01 Oct 2024 02:33:11 GMT"} })
8952024-10-01T02:33:12.114ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
8962024-10-01T02:33:12.115ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "e8bfaa7d-c962-4f86-93ff-1303ceb6640a", "content-length": "729", "date": "Tue, 01 Oct 2024 02:33:11 GMT"} })
8972024-10-01T02:33:12.115ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
8982024-10-01T02:33:12.115ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "05bbbf76-116a-4c29-8f3d-48def677f80f", "content-length": "728", "date": "Tue, 01 Oct 2024 02:33:11 GMT"} })
8992024-10-01T02:33:12.115ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
9002024-10-01T02:33:12.116ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
9012024-10-01T02:33:12.117ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9022024-10-01T02:33:12.119ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
9032024-10-01T02:33:12.119ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
9042024-10-01T02:33:12.119ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
9052024-10-01T02:33:12.121ZERROnexus (BackgroundTasks): nexus is running but no service zone nat values could be generated from inventory background_task = service_zone_nat_tracker file = nexus/src/app/background/tasks/sync_service_zone_nat.rs:257
9062024-10-01T02:33:12.121ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 631.902189ms iteration = 1 status = {"error":"nexus is running but no service zone nat values could be generated from inventory"}
9072024-10-01T02:33:12.121ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9082024-10-01T02:33:12.123ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
9092024-10-01T02:33:12.123ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
9102024-10-01T02:33:12.123ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
9112024-10-01T02:33:12.159ZDEBGnexus (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[fd00:1122:3344:101::1]:12345
9122024-10-01T02:33:12.159ZDEBGnexus (BackgroundTasks): client request SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/inventory
9132024-10-01T02:33:12.250ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
9142024-10-01T02:33:12.250ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
9152024-10-01T02:33:12.252ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
9162024-10-01T02:33:12.252ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
9172024-10-01T02:33:12.253ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9182024-10-01T02:33:12.255ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: 52547763-7759-42e1-81a9-8b833f59f5dd, lookup_type: ById(52547763-7759-42e1-81a9-8b833f59f5dd) } result = Ok(())
9192024-10-01T02:33:12.256ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: 52547763-7759-42e1-81a9-8b833f59f5dd, time_created: 2024-10-01T02:33:11.371096Z, time_modified: 2024-10-01T02:33:11.371096Z }, initialized: false, tuf_base_url: None, rack_subnet: None } file = nexus/src/app/rack.rs:764
9202024-10-01T02:33:12.366ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 roles = RoleSet { roles: {} } uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
9212024-10-01T02:33:12.366ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 resource = Database result = Ok(()) uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
9222024-10-01T02:33:12.368ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
9232024-10-01T02:33:12.369ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 resource = Fleet result = Ok(()) uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
9242024-10-01T02:33:12.371ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 roles = RoleSet { roles: {} } uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
9252024-10-01T02:33:12.371ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 resource = Database result = Ok(()) uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
9262024-10-01T02:33:12.411ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 roles = RoleSet { roles: {} } uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
9272024-10-01T02:33:12.411ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 resource = Database result = Ok(()) uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
9282024-10-01T02:33:12.453ZINFOnexus (dropshot_internal): set cockroachdb setting actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/cockroachdb_settings.rs:124 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 setting = cluster.preserve_downgrade_option uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete value = 22.1
9292024-10-01T02:33:12.453ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 roles = RoleSet { roles: {} } uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
9302024-10-01T02:33:12.453ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 resource = Database result = Ok(()) uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
9312024-10-01T02:33:12.454ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 roles = RoleSet { roles: {} } uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
9322024-10-01T02:33:12.455ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 resource = Database result = Ok(()) uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
9332024-10-01T02:33:12.456ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
9342024-10-01T02:33:12.459ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 resource = Rack { parent: Fleet, key: 52547763-7759-42e1-81a9-8b833f59f5dd, lookup_type: ById(52547763-7759-42e1-81a9-8b833f59f5dd) } result = Ok(()) uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
9352024-10-01T02:33:12.459ZDEBGnexus (dropshot_internal): updating rack subnet for rack 52547763-7759-42e1-81a9-8b833f59f5dd to Some( V6( Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56, }, ), ) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
9362024-10-01T02:33:12.459ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 roles = RoleSet { roles: {} } uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
9372024-10-01T02:33:12.459ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 resource = Database result = Ok(()) uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
9382024-10-01T02:33:12.464ZINFOnexus (dropshot_internal): Using automatic external switchport discovery actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:323 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
9392024-10-01T02:33:12.508ZDEBGnexus (DpdClient): client request actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true body = None local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
9402024-10-01T02:33:12.509ZDEBGnexus (DpdClient): client response actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/ports", status: 200, headers: {"content-type": "application/json", "x-request-id": "6ef18bfd-8d20-4fa7-98b3-4ee99e3b1663", "content-length": "24", "date": "Tue, 01 Oct 2024 02:33:12 GMT"} }) uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
9412024-10-01T02:33:12.510ZINFOnexus (dropshot_internal): discovered ports for switch0: [ Internal( Internal( "int0", ), ), Rear( Rear( "rear0", ), ), Qsfp( Qsfp( "qsfp0", ), ), ] actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:343 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
9422024-10-01T02:33:12.510ZINFOnexus (dropshot_internal): populating ports for switch0: [ Name( "qsfp0", ), ] actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:353 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
9432024-10-01T02:33:12.510ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 roles = RoleSet { roles: {} } uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
9442024-10-01T02:33:12.510ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 resource = Database result = Ok(()) uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
9452024-10-01T02:33:12.584ZDEBGnexus (BackgroundTasks): client response SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "43c73a58-03cd-4374-8fdb-1523775f03eb", "content-length": "20058", "date": "Tue, 01 Oct 2024 02:33:11 GMT"} })
9462024-10-01T02:33:12.584ZDEBGnexus (BackgroundTasks): client request SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/omicron-zones
9472024-10-01T02:33:12.587ZDEBGnexus (BackgroundTasks): client response SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/omicron-zones", status: 200, headers: {"content-type": "application/json", "x-request-id": "90f28937-fedc-4ce7-8e7d-a5cdf2a43010", "content-length": "10314", "date": "Tue, 01 Oct 2024 02:33:11 GMT"} })
9482024-10-01T02:33:12.588ZDEBGnexus (BackgroundTasks): finished collection background_task = inventory_collection
9492024-10-01T02:33:12.588ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
9502024-10-01T02:33:12.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
9512024-10-01T02:33:12.590ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9522024-10-01T02:33:12.592ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
9532024-10-01T02:33:12.594ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
9542024-10-01T02:33:12.594ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
9552024-10-01T02:33:12.636ZINFOnexus (dropshot_internal): Recording Rack Network Configuration actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:388 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
9562024-10-01T02:33:12.636ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 roles = RoleSet { roles: {} } uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
9572024-10-01T02:33:12.636ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 resource = Database result = Ok(()) uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
9582024-10-01T02:33:12.687ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 roles = RoleSet { roles: {} } uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
9592024-10-01T02:33:12.688ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 resource = Database result = Ok(()) uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
9602024-10-01T02:33:12.864ZINFOnexus (BackgroundTasks): inserted inventory collection background_task = inventory_collection collection_id = 679cc7f1-67b5-471b-a4ed-94a2cd652f8a file = nexus/db-queries/src/db/datastore/inventory.rs:970
9612024-10-01T02:33:12.866ZDEBGnexus (BackgroundTasks): inventory collection complete background_task = inventory_collection collection_id = 679cc7f1-67b5-471b-a4ed-94a2cd652f8a time_started = 2024-10-01 02:33:12.098261 UTC
9622024-10-01T02:33:12.866ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 1.376834322s iteration = 1 status = {"collection_id":"679cc7f1-67b5-471b-a4ed-94a2cd652f8a","time_done":"2024-10-01 02:33:12.588089 UTC","time_started":"2024-10-01 02:33:12.098261 UTC"}
9632024-10-01T02:33:12.866ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 2 reason = Dependency
9642024-10-01T02:33:12.866ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
9652024-10-01T02:33:12.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
9662024-10-01T02:33:12.868ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9672024-10-01T02:33:12.869ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
9682024-10-01T02:33:12.869ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
9692024-10-01T02:33:12.870ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
9702024-10-01T02:33:12.872ZINFOnexus (BackgroundTasks): Physical Disk Adoption: Rack not yet initialized background_task = physical_disk_adoption file = nexus/src/app/background/tasks/physical_disk_adoption.rs:79 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd
9712024-10-01T02:33:12.872ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 5.958689ms iteration = 2 status = {"error":"rack not yet initialized: 52547763-7759-42e1-81a9-8b833f59f5dd"}
9722024-10-01T02:33:13.031ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 roles = RoleSet { roles: {} } uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
9732024-10-01T02:33:13.032ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 resource = Database result = Ok(()) uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
9742024-10-01T02:33:13.047ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 roles = RoleSet { roles: {} } uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
9752024-10-01T02:33:13.047ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 resource = Database result = Ok(()) uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
9762024-10-01T02:33:13.049ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 roles = RoleSet { roles: {} } uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
9772024-10-01T02:33:13.049ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 resource = Database result = Ok(()) uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
9782024-10-01T02:33:13.069ZERROnexus (dropshot_internal): failed to check if bgp peer exists in switch port settings actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true error = NotFound file = nexus/db-queries/src/db/datastore/switch_port.rs:890 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
9792024-10-01T02:33:13.076ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 roles = RoleSet { roles: {} } uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
9802024-10-01T02:33:13.076ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 resource = Database result = Ok(()) uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
9812024-10-01T02:33:13.078ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
9822024-10-01T02:33:13.080ZDEBGnexus (dropshot_internal): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 resource = Fleet result = Ok(()) uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
9832024-10-01T02:33:13.080ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 roles = RoleSet { roles: {} } uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
9842024-10-01T02:33:13.080ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 resource = Database result = Ok(()) uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
9852024-10-01T02:33:13.082ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 roles = RoleSet { roles: {} } uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
9862024-10-01T02:33:13.082ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 resource = Database result = Ok(()) uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
9872024-10-01T02:33:13.084ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
9882024-10-01T02:33:13.087ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 resource = IpPool { parent: Fleet, key: 4595965d-630a-4afe-ad7b-a2d8abcc47d7, lookup_type: ByName("oxide-service-pool") } result = Ok(()) uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
9892024-10-01T02:33:13.087ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 roles = RoleSet { roles: {} } uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
9902024-10-01T02:33:13.087ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 resource = Database result = Ok(()) uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
9912024-10-01T02:33:13.089ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 roles = RoleSet { roles: {} } uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
9922024-10-01T02:33:13.089ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 resource = Database result = Ok(()) uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
9932024-10-01T02:33:13.091ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
9942024-10-01T02:33:13.092ZDEBGnexus (dropshot_internal): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 resource = IpPool { parent: Fleet, key: 4595965d-630a-4afe-ad7b-a2d8abcc47d7, lookup_type: ByName("oxide-service-pool") } result = Ok(()) uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
9952024-10-01T02:33:13.114ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 roles = RoleSet { roles: {} } uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
9962024-10-01T02:33:13.114ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 resource = Database result = Ok(()) uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
9972024-10-01T02:33:13.115ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
9982024-10-01T02:33:13.117ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 resource = BlueprintConfig result = Ok(()) uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
9992024-10-01T02:33:13.187ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:50432
10002024-10-01T02:33:13.190ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:50432 req_id = 9f7813d8-f162-40c7-9780-f8a53ce342ce roles = RoleSet { roles: {} } uri = /metrics/producers
10012024-10-01T02:33:13.190ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:50432 req_id = 9f7813d8-f162-40c7-9780-f8a53ce342ce resource = Database result = Ok(()) uri = /metrics/producers
10022024-10-01T02:33:13.225ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 41f2943e-6041-44c9-a47a-3cf5fb012644
10032024-10-01T02:33:13.225ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:50432 req_id = 9f7813d8-f162-40c7-9780-f8a53ce342ce roles = RoleSet { roles: {} } uri = /metrics/producers
10042024-10-01T02:33:13.225ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:50432 req_id = 9f7813d8-f162-40c7-9780-f8a53ce342ce resource = Database result = Ok(()) uri = /metrics/producers
10052024-10-01T02:33:13.241ZINFOnexus (dropshot_internal): inserted blueprint actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true blueprint_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 file = nexus/db-queries/src/db/datastore/deployment.rs:266 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
10062024-10-01T02:33:13.241ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 roles = RoleSet { roles: {} } uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
10072024-10-01T02:33:13.242ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 resource = Database result = Ok(()) uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
10082024-10-01T02:33:13.243ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
10092024-10-01T02:33:13.245ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 resource = BlueprintConfig result = Ok(()) uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
10102024-10-01T02:33:13.257ZINFOnexus (dropshot_internal): No networking records needed for internal_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
10112024-10-01T02:33:13.257ZINFOnexus (dropshot_internal): No networking records needed for internal_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
10122024-10-01T02:33:13.257ZINFOnexus (dropshot_internal): No networking records needed for internal_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
10132024-10-01T02:33:13.257ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
10142024-10-01T02:33:13.257ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
10152024-10-01T02:33:13.258ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
10162024-10-01T02:33:13.258ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
10172024-10-01T02:33:13.258ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
10182024-10-01T02:33:13.292ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 41f2943e-6041-44c9-a47a-3cf5fb012644 uri = http://[fd00:1122:3344:101::d]:12223/producers
10192024-10-01T02:33:13.301ZDEBGnexus: client response oximeter-collector = 41f2943e-6041-44c9-a47a-3cf5fb012644 result = Ok(Response { url: "http://[fd00:1122:3344:101::d]:12223/producers", status: 204, headers: {"x-request-id": "8c5e3a71-cade-4454-a87a-93acaa4dce0a", "date": "Tue, 01 Oct 2024 02:33:13 GMT"} })
10202024-10-01T02:33:13.301ZINFOnexus: assigned collector to new producer collector_id = 41f2943e-6041-44c9-a47a-3cf5fb012644 file = nexus/src/app/oximeter.rs:125 producer_id = 0fb48756-e6d8-4a38-934b-d9ec5c59cf45
10212024-10-01T02:33:13.302ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 112894 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:50432 req_id = 9f7813d8-f162-40c7-9780-f8a53ce342ce response_code = 201 uri = /metrics/producers
10222024-10-01T02:33:13.339ZINFOnexus (dropshot_internal): Inserted networking records for external_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
10232024-10-01T02:33:13.356ZINFOnexus (dropshot_internal): Inserted networking records for external_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
10242024-10-01T02:33:13.372ZINFOnexus (dropshot_internal): Inserted networking records for nexus service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
10252024-10-01T02:33:13.392ZINFOnexus (dropshot_internal): Inserted networking records for nexus service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
10262024-10-01T02:33:13.412ZINFOnexus (dropshot_internal): Inserted networking records for nexus service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
10272024-10-01T02:33:13.412ZINFOnexus (dropshot_internal): No networking records needed for oximeter service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
10282024-10-01T02:33:13.412ZINFOnexus (dropshot_internal): No networking records needed for clickhouse service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
10292024-10-01T02:33:13.412ZINFOnexus (dropshot_internal): No networking records needed for crucible_pantry service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
10302024-10-01T02:33:13.412ZINFOnexus (dropshot_internal): No networking records needed for crucible_pantry service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
10312024-10-01T02:33:13.412ZINFOnexus (dropshot_internal): No networking records needed for crucible_pantry service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
10322024-10-01T02:33:13.412ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
10332024-10-01T02:33:13.412ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
10342024-10-01T02:33:13.412ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
10352024-10-01T02:33:13.412ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
10362024-10-01T02:33:13.412ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
10372024-10-01T02:33:13.412ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
10382024-10-01T02:33:13.412ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
10392024-10-01T02:33:13.412ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
10402024-10-01T02:33:13.412ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
10412024-10-01T02:33:13.439ZINFOnexus (dropshot_internal): Inserted networking records for boundary_ntp service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
10422024-10-01T02:33:13.439ZINFOnexus (dropshot_internal): Inserted service networking records actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:808 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
10432024-10-01T02:33:13.439ZINFOnexus (dropshot_internal): physical disk upsert in handoff: PhysicalDisk { identity: PhysicalDiskIdentity { id: 9ea4fbca-7825-4af5-b233-716faacf004a, time_created: 2024-10-01T02:33:12.369782321Z, time_modified: 2024-10-01T02:33:12.369782321Z, }, time_deleted: None, rcgen: Generation( Generation( 1, ), ), vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-U2", variant: U2, sled_id: 2a571ec0-85a3-450e-88fc-680c13ffa211, disk_policy: InService, disk_state: Active, } actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:811 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
10442024-10-01T02:33:13.439ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 roles = RoleSet { roles: {} } uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
10452024-10-01T02:33:13.439ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 resource = Database result = Ok(()) uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
10462024-10-01T02:33:13.441ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
10472024-10-01T02:33:13.443ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 resource = Fleet result = Ok(()) uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
10482024-10-01T02:33:13.463ZINFOnexus (dropshot_internal): physical disk upsert in handoff: PhysicalDisk { identity: PhysicalDiskIdentity { id: 02b8c707-9e5c-4916-b5b0-7daa868b21fb, time_created: 2024-10-01T02:33:12.369782801Z, time_modified: 2024-10-01T02:33:12.369782801Z, }, time_deleted: None, rcgen: Generation( Generation( 1, ), ), vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-U2", variant: U2, sled_id: 2a571ec0-85a3-450e-88fc-680c13ffa211, disk_policy: InService, disk_state: Active, } actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:811 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
10492024-10-01T02:33:13.463ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 roles = RoleSet { roles: {} } uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
10502024-10-01T02:33:13.464ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 resource = Database result = Ok(()) uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
10512024-10-01T02:33:13.465ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
10522024-10-01T02:33:13.468ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 resource = Fleet result = Ok(()) uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
10532024-10-01T02:33:13.471ZINFOnexus (dropshot_internal): physical disk upsert in handoff: PhysicalDisk { identity: PhysicalDiskIdentity { id: b3169590-463e-4aa5-8d74-46b767b4f418, time_created: 2024-10-01T02:33:12.369783001Z, time_modified: 2024-10-01T02:33:12.369783001Z, }, time_deleted: None, rcgen: Generation( Generation( 1, ), ), vendor: "synthetic-vendor", serial: "synthetic-serial-2", model: "synthetic-model-U2", variant: U2, sled_id: 2a571ec0-85a3-450e-88fc-680c13ffa211, disk_policy: InService, disk_state: Active, } actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:811 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
10542024-10-01T02:33:13.471ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 roles = RoleSet { roles: {} } uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
10552024-10-01T02:33:13.472ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 resource = Database result = Ok(()) uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
10562024-10-01T02:33:13.473ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
10572024-10-01T02:33:13.475ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 resource = Fleet result = Ok(()) uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
10582024-10-01T02:33:13.482ZINFOnexus (dropshot_internal): physical disk upsert in handoff: PhysicalDisk { identity: PhysicalDiskIdentity { id: c6ad05eb-5d45-4fe2-b244-fdb603095123, time_created: 2024-10-01T02:33:12.369783071Z, time_modified: 2024-10-01T02:33:12.369783071Z, }, time_deleted: None, rcgen: Generation( Generation( 1, ), ), vendor: "synthetic-vendor", serial: "synthetic-serial-3", model: "synthetic-model-U2", variant: U2, sled_id: 2a571ec0-85a3-450e-88fc-680c13ffa211, disk_policy: InService, disk_state: Active, } actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:811 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
10592024-10-01T02:33:13.482ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 roles = RoleSet { roles: {} } uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
10602024-10-01T02:33:13.482ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 resource = Database result = Ok(()) uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
10612024-10-01T02:33:13.484ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
10622024-10-01T02:33:13.486ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 resource = Fleet result = Ok(()) uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
10632024-10-01T02:33:13.489ZINFOnexus (dropshot_internal): physical disk upsert in handoff: PhysicalDisk { identity: PhysicalDiskIdentity { id: ed87e175-31f6-47cc-b01f-4d57cbb25b8e, time_created: 2024-10-01T02:33:12.369783151Z, time_modified: 2024-10-01T02:33:12.369783151Z, }, time_deleted: None, rcgen: Generation( Generation( 1, ), ), vendor: "synthetic-vendor", serial: "synthetic-serial-4", model: "synthetic-model-U2", variant: U2, sled_id: 2a571ec0-85a3-450e-88fc-680c13ffa211, disk_policy: InService, disk_state: Active, } actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:811 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
10642024-10-01T02:33:13.489ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 roles = RoleSet { roles: {} } uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
10652024-10-01T02:33:13.489ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 resource = Database result = Ok(()) uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
10662024-10-01T02:33:13.491ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
10672024-10-01T02:33:13.492ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 resource = Fleet result = Ok(()) uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
10682024-10-01T02:33:13.496ZINFOnexus (dropshot_internal): physical disk upsert in handoff: PhysicalDisk { identity: PhysicalDiskIdentity { id: 783debfa-234e-46fa-9848-d866cf9fa69d, time_created: 2024-10-01T02:33:12.369783231Z, time_modified: 2024-10-01T02:33:12.369783231Z, }, time_deleted: None, rcgen: Generation( Generation( 1, ), ), vendor: "synthetic-vendor", serial: "synthetic-serial-5", model: "synthetic-model-U2", variant: U2, sled_id: 2a571ec0-85a3-450e-88fc-680c13ffa211, disk_policy: InService, disk_state: Active, } actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:811 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
10692024-10-01T02:33:13.496ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 roles = RoleSet { roles: {} } uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
10702024-10-01T02:33:13.496ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 resource = Database result = Ok(()) uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
10712024-10-01T02:33:13.498ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
10722024-10-01T02:33:13.500ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 resource = Fleet result = Ok(()) uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
10732024-10-01T02:33:13.504ZINFOnexus (dropshot_internal): physical disk upsert in handoff: PhysicalDisk { identity: PhysicalDiskIdentity { id: b34151d7-b6a2-4296-88e2-a5b8772c77c8, time_created: 2024-10-01T02:33:12.369783311Z, time_modified: 2024-10-01T02:33:12.369783311Z, }, time_deleted: None, rcgen: Generation( Generation( 1, ), ), vendor: "synthetic-vendor", serial: "synthetic-serial-6", model: "synthetic-model-U2", variant: U2, sled_id: 2a571ec0-85a3-450e-88fc-680c13ffa211, disk_policy: InService, disk_state: Active, } actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:811 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
10742024-10-01T02:33:13.504ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 roles = RoleSet { roles: {} } uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
10752024-10-01T02:33:13.504ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 resource = Database result = Ok(()) uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
10762024-10-01T02:33:13.506ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
10772024-10-01T02:33:13.508ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 resource = Fleet result = Ok(()) uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
10782024-10-01T02:33:13.512ZINFOnexus (dropshot_internal): physical disk upsert in handoff: PhysicalDisk { identity: PhysicalDiskIdentity { id: ae1124fc-68f6-4dfa-974f-6214f7f43390, time_created: 2024-10-01T02:33:12.369783391Z, time_modified: 2024-10-01T02:33:12.369783391Z, }, time_deleted: None, rcgen: Generation( Generation( 1, ), ), vendor: "synthetic-vendor", serial: "synthetic-serial-7", model: "synthetic-model-U2", variant: U2, sled_id: 2a571ec0-85a3-450e-88fc-680c13ffa211, disk_policy: InService, disk_state: Active, } actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:811 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
10792024-10-01T02:33:13.512ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 roles = RoleSet { roles: {} } uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
10802024-10-01T02:33:13.512ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 resource = Database result = Ok(()) uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
10812024-10-01T02:33:13.514ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
10822024-10-01T02:33:13.516ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 resource = Fleet result = Ok(()) uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
10832024-10-01T02:33:13.520ZINFOnexus (dropshot_internal): physical disk upsert in handoff: PhysicalDisk { identity: PhysicalDiskIdentity { id: fb87561f-21c8-407f-bf60-705375e63065, time_created: 2024-10-01T02:33:12.369783471Z, time_modified: 2024-10-01T02:33:12.369783471Z, }, time_deleted: None, rcgen: Generation( Generation( 1, ), ), vendor: "synthetic-vendor", serial: "synthetic-serial-8", model: "synthetic-model-U2", variant: U2, sled_id: 2a571ec0-85a3-450e-88fc-680c13ffa211, disk_policy: InService, disk_state: Active, } actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:811 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
10842024-10-01T02:33:13.520ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 roles = RoleSet { roles: {} } uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
10852024-10-01T02:33:13.520ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 resource = Database result = Ok(()) uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
10862024-10-01T02:33:13.522ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
10872024-10-01T02:33:13.523ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 resource = Fleet result = Ok(()) uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
10882024-10-01T02:33:13.527ZINFOnexus (dropshot_internal): Inserted physical disks actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:823 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
10892024-10-01T02:33:13.528ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 roles = RoleSet { roles: {} } uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
10902024-10-01T02:33:13.528ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 resource = Database result = Ok(()) uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
10912024-10-01T02:33:13.529ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
10922024-10-01T02:33:13.530ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 resource = Fleet result = Ok(()) uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
10932024-10-01T02:33:13.536ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 roles = RoleSet { roles: {} } uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
10942024-10-01T02:33:13.536ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 resource = Database result = Ok(()) uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
10952024-10-01T02:33:13.538ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
10962024-10-01T02:33:13.539ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 resource = Fleet result = Ok(()) uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
10972024-10-01T02:33:13.543ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 roles = RoleSet { roles: {} } uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
10982024-10-01T02:33:13.543ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 resource = Database result = Ok(()) uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
10992024-10-01T02:33:13.545ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
11002024-10-01T02:33:13.546ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 resource = Fleet result = Ok(()) uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
11012024-10-01T02:33:13.550ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 roles = RoleSet { roles: {} } uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
11022024-10-01T02:33:13.550ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 resource = Database result = Ok(()) uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
11032024-10-01T02:33:13.551ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
11042024-10-01T02:33:13.553ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 resource = Fleet result = Ok(()) uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
11052024-10-01T02:33:13.556ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 roles = RoleSet { roles: {} } uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
11062024-10-01T02:33:13.557ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 resource = Database result = Ok(()) uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
11072024-10-01T02:33:13.558ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
11082024-10-01T02:33:13.559ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 resource = Fleet result = Ok(()) uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
11092024-10-01T02:33:13.563ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 roles = RoleSet { roles: {} } uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
11102024-10-01T02:33:13.564ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 resource = Database result = Ok(()) uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
11112024-10-01T02:33:13.565ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
11122024-10-01T02:33:13.566ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 resource = Fleet result = Ok(()) uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
11132024-10-01T02:33:13.569ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 roles = RoleSet { roles: {} } uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
11142024-10-01T02:33:13.570ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 resource = Database result = Ok(()) uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
11152024-10-01T02:33:13.571ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
11162024-10-01T02:33:13.572ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 resource = Fleet result = Ok(()) uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
11172024-10-01T02:33:13.576ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 roles = RoleSet { roles: {} } uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
11182024-10-01T02:33:13.576ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 resource = Database result = Ok(()) uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
11192024-10-01T02:33:13.578ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
11202024-10-01T02:33:13.579ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 resource = Fleet result = Ok(()) uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
11212024-10-01T02:33:13.584ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 roles = RoleSet { roles: {} } uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
11222024-10-01T02:33:13.584ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 resource = Database result = Ok(()) uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
11232024-10-01T02:33:13.586ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
11242024-10-01T02:33:13.587ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 resource = Fleet result = Ok(()) uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
11252024-10-01T02:33:13.591ZINFOnexus (dropshot_internal): Inserted zpools actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:835 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
11262024-10-01T02:33:13.678ZINFOnexus (dropshot_internal): Inserted datasets actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:865 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
11272024-10-01T02:33:13.710ZINFOnexus (dropshot_internal): Populated DNS tables for internal DNS actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:876 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
11282024-10-01T02:33:13.712ZINFOnexus (dropshot_internal): Populated DNS tables for external DNS actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:885 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
11292024-10-01T02:33:13.712ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 roles = RoleSet { roles: {} } uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
11302024-10-01T02:33:13.713ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 resource = Database result = Ok(()) uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
11312024-10-01T02:33:13.717ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
11322024-10-01T02:33:13.718ZDEBGnexus (dropshot_internal): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 resource = Fleet result = Ok(()) uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
11332024-10-01T02:33:13.718ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 roles = RoleSet { roles: {} } uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
11342024-10-01T02:33:13.718ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 resource = Database result = Ok(()) uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
11352024-10-01T02:33:13.720ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
11362024-10-01T02:33:13.721ZDEBGnexus (dropshot_internal): authorize result action = ModifyPolicy actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 resource = Fleet result = Ok(()) uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
11372024-10-01T02:33:13.747ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 roles = RoleSet { roles: {} } uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
11382024-10-01T02:33:13.748ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 resource = Database result = Ok(()) uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
11392024-10-01T02:33:13.749ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
11402024-10-01T02:33:13.752ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 resource = DnsConfig result = Ok(()) uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
11412024-10-01T02:33:13.752ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 roles = RoleSet { roles: {} } uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
11422024-10-01T02:33:13.752ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 resource = Database result = Ok(()) uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
11432024-10-01T02:33:13.755ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
11442024-10-01T02:33:13.758ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 resource = DnsConfig result = Ok(()) uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
11452024-10-01T02:33:13.759ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 roles = RoleSet { roles: {} } uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
11462024-10-01T02:33:13.760ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 resource = Database result = Ok(()) uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
11472024-10-01T02:33:13.761ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
11482024-10-01T02:33:13.764ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 resource = DnsConfig result = Ok(()) uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
11492024-10-01T02:33:13.768ZINFOnexus (dropshot_internal): Created recovery silo actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:451 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
11502024-10-01T02:33:13.789ZINFOnexus (dropshot_internal): Created recovery user actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:467 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
11512024-10-01T02:33:13.797ZINFOnexus (dropshot_internal): Created recovery user's password actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:481 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
11522024-10-01T02:33:13.797ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 roles = RoleSet { roles: {} } uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
11532024-10-01T02:33:13.797ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 resource = Database result = Ok(()) uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
11542024-10-01T02:33:13.799ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 roles = RoleSet { roles: {} } uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
11552024-10-01T02:33:13.799ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 resource = Database result = Ok(()) uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
11562024-10-01T02:33:13.800ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
11572024-10-01T02:33:13.801ZDEBGnexus (dropshot_internal): authorize result action = ModifyPolicy actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 resource = Silo { parent: Fleet, key: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, lookup_type: ById(21983b87-d6d0-47c6-a33c-5fe68fbed0c6) } result = Ok(()) uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
11582024-10-01T02:33:13.801ZDEBGnexus (dropshot_internal): Generated role assignment queries actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
11592024-10-01T02:33:13.805ZINFOnexus (dropshot_internal): Granted Silo privileges actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:509 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
11602024-10-01T02:33:13.805ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 roles = RoleSet { roles: {} } uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
11612024-10-01T02:33:13.805ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 resource = Database result = Ok(()) uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
11622024-10-01T02:33:13.809ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
11632024-10-01T02:33:13.810ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 resource = Fleet result = Ok(()) uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
11642024-10-01T02:33:13.839ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 roles = RoleSet { roles: {} } uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
11652024-10-01T02:33:13.839ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 resource = Database result = Ok(()) uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
11662024-10-01T02:33:13.841ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 roles = RoleSet { roles: {} } uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
11672024-10-01T02:33:13.842ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 resource = Database result = Ok(()) uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
11682024-10-01T02:33:13.945ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 roles = RoleSet { roles: {} } uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
11692024-10-01T02:33:13.946ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 resource = Database result = Ok(()) uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
11702024-10-01T02:33:13.947ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 roles = RoleSet { roles: {} } uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
11712024-10-01T02:33:13.948ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 resource = Database result = Ok(()) uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
11722024-10-01T02:33:13.949ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 roles = RoleSet { roles: {} } uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
11732024-10-01T02:33:13.949ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 resource = Database result = Ok(()) uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
11742024-10-01T02:33:13.951ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 roles = RoleSet { roles: {} } uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
11752024-10-01T02:33:13.951ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 resource = Database result = Ok(()) uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
11762024-10-01T02:33:13.952ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
11772024-10-01T02:33:13.955ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(()) uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
11782024-10-01T02:33:13.955ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 roles = RoleSet { roles: {} } uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
11792024-10-01T02:33:13.956ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 resource = Database result = Ok(()) uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
11802024-10-01T02:33:13.957ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 roles = RoleSet { roles: {} } uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
11812024-10-01T02:33:13.957ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 resource = Database result = Ok(()) uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
11822024-10-01T02:33:13.959ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 roles = RoleSet { roles: {} } uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
11832024-10-01T02:33:13.959ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 resource = Database result = Ok(()) uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
11842024-10-01T02:33:13.960ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
11852024-10-01T02:33:13.964ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(()) uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
11862024-10-01T02:33:13.964ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 roles = RoleSet { roles: {} } uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
11872024-10-01T02:33:13.964ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 resource = Database result = Ok(()) uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
11882024-10-01T02:33:13.966ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 roles = RoleSet { roles: {} } uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
11892024-10-01T02:33:13.967ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 resource = Database result = Ok(()) uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
11902024-10-01T02:33:13.968ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 roles = RoleSet { roles: {} } uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
11912024-10-01T02:33:13.969ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 resource = Database result = Ok(()) uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
11922024-10-01T02:33:13.970ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 roles = RoleSet { roles: {} } uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
11932024-10-01T02:33:13.970ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 resource = Database result = Ok(()) uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
11942024-10-01T02:33:13.971ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 roles = RoleSet { roles: {} } uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
11952024-10-01T02:33:13.971ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 resource = Database result = Ok(()) uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
11962024-10-01T02:33:13.972ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 roles = RoleSet { roles: {} } uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
11972024-10-01T02:33:13.973ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 resource = Database result = Ok(()) uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
11982024-10-01T02:33:13.974ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 roles = RoleSet { roles: {} } uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
11992024-10-01T02:33:13.974ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 resource = Database result = Ok(()) uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
12002024-10-01T02:33:13.975ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
12012024-10-01T02:33:13.978ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(()) uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
12022024-10-01T02:33:13.978ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 roles = RoleSet { roles: {} } uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
12032024-10-01T02:33:13.979ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 resource = Database result = Ok(()) uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
12042024-10-01T02:33:13.979ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 roles = RoleSet { roles: {} } uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
12052024-10-01T02:33:13.980ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 resource = Database result = Ok(()) uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
12062024-10-01T02:33:13.981ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 roles = RoleSet { roles: {} } uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
12072024-10-01T02:33:13.981ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 resource = Database result = Ok(()) uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
12082024-10-01T02:33:13.982ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 roles = RoleSet { roles: {} } uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
12092024-10-01T02:33:13.982ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 resource = Database result = Ok(()) uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
12102024-10-01T02:33:13.984ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 roles = RoleSet { roles: {} } uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
12112024-10-01T02:33:13.984ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 resource = Database result = Ok(()) uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
12122024-10-01T02:33:13.985ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 roles = RoleSet { roles: {} } uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
12132024-10-01T02:33:13.985ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 resource = Database result = Ok(()) uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
12142024-10-01T02:33:13.987ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 roles = RoleSet { roles: {} } uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
12152024-10-01T02:33:13.987ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 resource = Database result = Ok(()) uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
12162024-10-01T02:33:13.988ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
12172024-10-01T02:33:13.992ZDEBGnexus (dropshot_internal): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(()) uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
12182024-10-01T02:33:13.992ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 roles = RoleSet { roles: {} } uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
12192024-10-01T02:33:13.992ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 resource = Database result = Ok(()) uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
12202024-10-01T02:33:13.993ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 roles = RoleSet { roles: {} } uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
12212024-10-01T02:33:13.993ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 resource = Database result = Ok(()) uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
12222024-10-01T02:33:13.994ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 roles = RoleSet { roles: {} } uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
12232024-10-01T02:33:13.994ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 resource = Database result = Ok(()) uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
12242024-10-01T02:33:13.996ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
12252024-10-01T02:33:13.999ZDEBGnexus (dropshot_internal): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(()) uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
12262024-10-01T02:33:13.999ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 roles = RoleSet { roles: {} } uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
12272024-10-01T02:33:13.999ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 resource = Database result = Ok(()) uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
12282024-10-01T02:33:14.004ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 roles = RoleSet { roles: {} } uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
12292024-10-01T02:33:14.004ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 resource = Database result = Ok(()) uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
12302024-10-01T02:33:14.104ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 roles = RoleSet { roles: {} } uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
12312024-10-01T02:33:14.104ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 resource = Database result = Ok(()) uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
12322024-10-01T02:33:14.105ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 roles = RoleSet { roles: {} } uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
12332024-10-01T02:33:14.106ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 resource = Database result = Ok(()) uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
12342024-10-01T02:33:14.108ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 roles = RoleSet { roles: {} } uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
12352024-10-01T02:33:14.109ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 resource = Database result = Ok(()) uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
12362024-10-01T02:33:14.111ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 roles = RoleSet { roles: {} } uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
12372024-10-01T02:33:14.111ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 resource = Database result = Ok(()) uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
12382024-10-01T02:33:14.112ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 roles = RoleSet { roles: {} } uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
12392024-10-01T02:33:14.113ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 resource = Database result = Ok(()) uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
12402024-10-01T02:33:14.114ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 roles = RoleSet { roles: {} } uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
12412024-10-01T02:33:14.114ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 resource = Database result = Ok(()) uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
12422024-10-01T02:33:14.115ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
12432024-10-01T02:33:14.119ZDEBGnexus (dropshot_internal): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(()) uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
12442024-10-01T02:33:14.119ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 roles = RoleSet { roles: {} } uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
12452024-10-01T02:33:14.119ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 resource = Database result = Ok(()) uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
12462024-10-01T02:33:14.120ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 roles = RoleSet { roles: {} } uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
12472024-10-01T02:33:14.121ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 resource = Database result = Ok(()) uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
12482024-10-01T02:33:14.122ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 roles = RoleSet { roles: {} } uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
12492024-10-01T02:33:14.122ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 resource = Database result = Ok(()) uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
12502024-10-01T02:33:14.124ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
12512024-10-01T02:33:14.127ZDEBGnexus (dropshot_internal): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(()) uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
12522024-10-01T02:33:14.127ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 roles = RoleSet { roles: {} } uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
12532024-10-01T02:33:14.127ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 resource = Database result = Ok(()) uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
12542024-10-01T02:33:14.133ZDEBGnexus: resolved names for firewall rules instance_interfaces = {} subnet_interfaces = {Name("external-dns"): [NetworkInterface { id: 498a9376-2ad6-4307-b191-e6d73cf2f1a4, kind: Service { id: 0a1ed896-5078-4267-b636-10151376f015 }, name: Name("external-dns-0a1ed896-5078-4267-b636-10151376f015"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 226, 149])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e4ffe935-3383-46e7-947f-e87df509f06f, kind: Service { id: eb937866-c779-4a9e-aec4-cc18302d4ce1 }, name: Name("external-dns-eb937866-c779-4a9e-aec4-cc18302d4ce1"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 254, 225])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("nexus"): [NetworkInterface { id: 611bfb6e-9731-4e0b-9af8-03e07b661aa3, kind: Service { id: 772acfa5-ee20-4a17-a053-c207ffa50ed6 }, name: Name("nexus-772acfa5-ee20-4a17-a053-c207ffa50ed6"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 139, 222])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 98b85cfc-ac80-4175-9f04-dd15c9b20d24, kind: Service { id: 3dfd7033-71d8-4eb9-bb97-49dae3b5cd35 }, name: Name("nexus-3dfd7033-71d8-4eb9-bb97-49dae3b5cd35"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 167, 29])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a840a1d8-f258-45fe-96a0-7b8383461d51, kind: Service { id: e9e4c757-e076-4386-92e2-8217b8bb307d }, name: Name("nexus-e9e4c757-e076-4386-92e2-8217b8bb307d"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 176, 241])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })], Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })]} vpc_interfaces = {}
12552024-10-01T02:33:14.133ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 roles = RoleSet { roles: {} } uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
12562024-10-01T02:33:14.133ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 resource = Database result = Ok(()) uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
12572024-10-01T02:33:14.134ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
12582024-10-01T02:33:14.136ZDEBGnexus (dropshot_internal): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 resource = Fleet result = Ok(()) uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
12592024-10-01T02:33:14.136ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 roles = RoleSet { roles: {} } uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
12602024-10-01T02:33:14.136ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 resource = Database result = Ok(()) uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
12612024-10-01T02:33:14.138ZDEBGnexus: Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified.
12622024-10-01T02:33:14.139ZDEBGnexus: resolved firewall rules for sled agents sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 498a9376-2ad6-4307-b191-e6d73cf2f1a4, kind: Service { id: 0a1ed896-5078-4267-b636-10151376f015 }, name: Name("external-dns-0a1ed896-5078-4267-b636-10151376f015"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 226, 149])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e4ffe935-3383-46e7-947f-e87df509f06f, kind: Service { id: eb937866-c779-4a9e-aec4-cc18302d4ce1 }, name: Name("external-dns-eb937866-c779-4a9e-aec4-cc18302d4ce1"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 254, 225])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 611bfb6e-9731-4e0b-9af8-03e07b661aa3, kind: Service { id: 772acfa5-ee20-4a17-a053-c207ffa50ed6 }, name: Name("nexus-772acfa5-ee20-4a17-a053-c207ffa50ed6"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 139, 222])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 98b85cfc-ac80-4175-9f04-dd15c9b20d24, kind: Service { id: 3dfd7033-71d8-4eb9-bb97-49dae3b5cd35 }, name: Name("nexus-3dfd7033-71d8-4eb9-bb97-49dae3b5cd35"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 167, 29])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a840a1d8-f258-45fe-96a0-7b8383461d51, kind: Service { id: e9e4c757-e076-4386-92e2-8217b8bb307d }, name: Name("nexus-e9e4c757-e076-4386-92e2-8217b8bb307d"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 176, 241])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
12632024-10-01T02:33:14.140ZDEBGnexus: resolved 2 rules for sleds
12642024-10-01T02:33:14.195ZDEBGnexus: resolved sleds for vpc oxide-services vpc_to_sled = [Sled { identity: SledIdentity { id: 2a571ec0-85a3-450e-88fc-680c13ffa211, time_created: 2024-10-01T02:33:11.506220Z, time_modified: 2024-10-01T02:33:11.506220Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: 52547763-7759-42e1-81a9-8b833f59f5dd, is_scrimlet: true, serial_number: "buskin", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
12652024-10-01T02:33:14.195ZDEBGnexus: sending firewall rules to sled agents
12662024-10-01T02:33:14.195ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
12672024-10-01T02:33:14.195ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
12682024-10-01T02:33:14.197ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
12692024-10-01T02:33:14.198ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
12702024-10-01T02:33:14.199ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
12712024-10-01T02:33:14.201ZDEBGnexus (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Sled { parent: Fleet, key: 2a571ec0-85a3-450e-88fc-680c13ffa211, lookup_type: ById(2a571ec0-85a3-450e-88fc-680c13ffa211) } result = Ok(())
12722024-10-01T02:33:14.234ZDEBGnexus: client request SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
12732024-10-01T02:33:14.237ZDEBGnexus: client response SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "3e28ccb1-7723-449a-b010-76dfb72b73ea", "date": "Tue, 01 Oct 2024 02:33:14 GMT"} })
12742024-10-01T02:33:14.239ZINFOnexus: updated firewall rules on 1 sleds file = nexus/networking/src/firewall_rules.rs:496
12752024-10-01T02:33:14.239ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 2 reason = Signaled
12762024-10-01T02:33:14.239ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1873182 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49909 req_id = aee20e7a-0c9a-460a-8463-08b5f9200ab1 response_code = 204 uri = /racks/52547763-7759-42e1-81a9-8b833f59f5dd/initialization-complete
12772024-10-01T02:33:14.239ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 2 reason = Signaled
12782024-10-01T02:33:14.239ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 2 reason = Signaled
12792024-10-01T02:33:14.239ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
12802024-10-01T02:33:14.239ZDEBGnexus (BackgroundTasks): activating background_task = inventory_collection iteration = 2 reason = Signaled
12812024-10-01T02:33:14.239ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 2 reason = Signaled
12822024-10-01T02:33:14.239ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
12832024-10-01T02:33:14.239ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
12842024-10-01T02:33:14.239ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
12852024-10-01T02:33:14.239ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 2 reason = Signaled
12862024-10-01T02:33:14.239ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
12872024-10-01T02:33:14.239ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
12882024-10-01T02:33:14.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
12892024-10-01T02:33:14.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
12902024-10-01T02:33:14.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
12912024-10-01T02:33:14.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
12922024-10-01T02:33:14.239ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("0a1ed896-5078-4267-b636-10151376f015.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("eb937866-c779-4a9e-aec4-cc18302d4ce1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("eb937866-c779-4a9e-aec4-cc18302d4ce1.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1247, tv_nsec: 683472580 } })
12932024-10-01T02:33:14.240ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("1af5fb25-d768-4bc6-915c-0b4c59e1f0ef.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("293e78c2-b712-4c13-b502-e2be11a76306.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("71ea2e4f-4772-4ce7-8093-48597fd7fd92.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("71ea2e4f-4772-4ce7-8093-48597fd7fd92.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1247, tv_nsec: 683688464 } })
12942024-10-01T02:33:14.240ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
12952024-10-01T02:33:14.240ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.487985ms iteration = 2 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
12962024-10-01T02:33:14.241ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
12972024-10-01T02:33:14.241ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12982024-10-01T02:33:14.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
12992024-10-01T02:33:14.241ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
13002024-10-01T02:33:14.241ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 2.601603ms iteration = 2 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
13012024-10-01T02:33:14.242ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
13022024-10-01T02:33:14.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
13032024-10-01T02:33:14.242ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13042024-10-01T02:33:14.243ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13052024-10-01T02:33:14.243ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
13062024-10-01T02:33:14.243ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
13072024-10-01T02:33:14.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
13082024-10-01T02:33:14.244ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
13092024-10-01T02:33:14.244ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
13102024-10-01T02:33:14.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
13112024-10-01T02:33:14.245ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13122024-10-01T02:33:14.247ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
13132024-10-01T02:33:14.248ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
13142024-10-01T02:33:14.249ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
13152024-10-01T02:33:14.249ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
13162024-10-01T02:33:14.249ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
13172024-10-01T02:33:14.249ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
13182024-10-01T02:33:14.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
13192024-10-01T02:33:14.250ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
13202024-10-01T02:33:14.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
13212024-10-01T02:33:14.251ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13222024-10-01T02:33:14.252ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13232024-10-01T02:33:14.254ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
13242024-10-01T02:33:14.254ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
13252024-10-01T02:33:14.254ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
13262024-10-01T02:33:14.254ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
13272024-10-01T02:33:14.254ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
13282024-10-01T02:33:14.255ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
13292024-10-01T02:33:14.257ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
13302024-10-01T02:33:14.257ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
13312024-10-01T02:33:14.257ZDEBGnexus (BackgroundTasks): inventory_prune_one: eligible for removal background_task = inventory_collection candidates = [(f4292df9-35df-497b-a9dc-2e40f77ad419, 0), (c4c1c8ca-7be6-4a78-9a5c-d371c17c5887, 0), (679cc7f1-67b5-471b-a4ed-94a2cd652f8a, 0), (be89f38c-d395-41e2-899a-3fcfb38880dd, 0)] collection_id = f4292df9-35df-497b-a9dc-2e40f77ad419
13322024-10-01T02:33:14.258ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
13332024-10-01T02:33:14.258ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
13342024-10-01T02:33:14.259ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
13352024-10-01T02:33:14.260ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
13362024-10-01T02:33:14.278ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
13372024-10-01T02:33:14.278ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
13382024-10-01T02:33:14.278ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
13392024-10-01T02:33:14.278ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
13402024-10-01T02:33:14.278ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
13412024-10-01T02:33:14.279ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13422024-10-01T02:33:14.282ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
13432024-10-01T02:33:14.282ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
13442024-10-01T02:33:14.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
13452024-10-01T02:33:14.286ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
13462024-10-01T02:33:14.286ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 3d6d7965-c160-4184-b04f-32fa0fb7b928 dns_zone_name = oxide.test found_so_far = 0 version = 2
13472024-10-01T02:33:14.286ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
13482024-10-01T02:33:14.286ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
13492024-10-01T02:33:14.286ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13502024-10-01T02:33:14.287ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13512024-10-01T02:33:14.289ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
13522024-10-01T02:33:14.289ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
13532024-10-01T02:33:14.289ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: 52547763-7759-42e1-81a9-8b833f59f5dd, lookup_type: ById(52547763-7759-42e1-81a9-8b833f59f5dd) } result = Ok(())
13542024-10-01T02:33:14.289ZINFOnexus: Rack initialized file = nexus/src/app/rack.rs:761
13552024-10-01T02:33:14.289ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
13562024-10-01T02:33:14.290ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
13572024-10-01T02:33:14.290ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13582024-10-01T02:33:14.291ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
13592024-10-01T02:33:14.291ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
13602024-10-01T02:33:14.291ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
13612024-10-01T02:33:14.292ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
13622024-10-01T02:33:14.292ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
13632024-10-01T02:33:14.292ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
13642024-10-01T02:33:14.292ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
13652024-10-01T02:33:14.293ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
13662024-10-01T02:33:14.295ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 3d6d7965-c160-4184-b04f-32fa0fb7b928 dns_zone_name = oxide.test found_so_far = 1 version = 2
13672024-10-01T02:33:14.295ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
13682024-10-01T02:33:14.295ZINFOnexus (BackgroundTasks): found latest generation (first find) background_task = dns_config_external dns_group = external file = nexus/src/app/background/tasks/dns_config.rs:87 generation = 2
13692024-10-01T02:33:14.295ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 56.441116ms iteration = 2 status = {"generation":2}
13702024-10-01T02:33:14.295ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 3 reason = Dependency
13712024-10-01T02:33:14.296ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
13722024-10-01T02:33:14.296ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
13732024-10-01T02:33:14.298ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
13742024-10-01T02:33:14.298ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
13752024-10-01T02:33:14.299ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
13762024-10-01T02:33:14.300ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
13772024-10-01T02:33:14.301ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
13782024-10-01T02:33:14.301ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
13792024-10-01T02:33:14.302ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13802024-10-01T02:33:14.306ZDEBGnexus (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
13812024-10-01T02:33:14.306ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
13822024-10-01T02:33:14.306ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
13832024-10-01T02:33:14.307ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
13842024-10-01T02:33:14.307ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
13852024-10-01T02:33:14.308ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
13862024-10-01T02:33:14.309ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
13872024-10-01T02:33:14.310ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13882024-10-01T02:33:14.313ZDEBGnexus (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
13892024-10-01T02:33:14.313ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
13902024-10-01T02:33:14.313ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
13912024-10-01T02:33:14.316ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
13922024-10-01T02:33:14.316ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
13932024-10-01T02:33:14.317ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
13942024-10-01T02:33:14.318ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
13952024-10-01T02:33:14.328ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
13962024-10-01T02:33:14.329ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
13972024-10-01T02:33:14.329ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = bc7b49a6-c38c-499f-983e-184e2c58fa04 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
13982024-10-01T02:33:14.329ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
13992024-10-01T02:33:14.330ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
14002024-10-01T02:33:14.331ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14012024-10-01T02:33:14.334ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
14022024-10-01T02:33:14.334ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
14032024-10-01T02:33:14.334ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
14042024-10-01T02:33:14.347ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (initial) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-10-01T02:33:09.142901Z, time_modified: 2024-10-01T02:33:09.142901Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, db_silo: Silo { identity: SiloIdentity { id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-10-01T02:33:13.712784Z, time_modified: 2024-10-01T02:33:13.712784Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(1)) }, tls_certs: [TlsCertificate { digest: "ca547a59343cd98ceb775f10ce9428d8003a71a149b5b7d33f10c1e7a9820bb1" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, db_silo: Silo { identity: SiloIdentity { id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-10-01T02:33:13.712784Z, time_modified: 2024-10-01T02:33:13.712784Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(1)) }, tls_certs: [TlsCertificate { digest: "ca547a59343cd98ceb775f10ce9428d8003a71a149b5b7d33f10c1e7a9820bb1" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:77
14052024-10-01T02:33:14.347ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 108.215193ms iteration = 2 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"21983b87-d6d0-47c6-a33c-5fe68fbed0c6","tls_certs":["ca547a59343cd98ceb775f10ce9428d8003a71a149b5b7d33f10c1e7a9820bb1"]}},"default_endpoint":{"silo_id":"21983b87-d6d0-47c6-a33c-5fe68fbed0c6","tls_certs":["ca547a59343cd98ceb775f10ce9428d8003a71a149b5b7d33f10c1e7a9820bb1"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
14062024-10-01T02:33:14.361ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
14072024-10-01T02:33:14.377ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = bc7b49a6-c38c-499f-983e-184e2c58fa04 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
14082024-10-01T02:33:14.377ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
14092024-10-01T02:33:14.377ZINFOnexus (BackgroundTasks): found latest generation (first find) background_task = dns_config_internal dns_group = internal file = nexus/src/app/background/tasks/dns_config.rs:87 generation = 1
14102024-10-01T02:33:14.377ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 137.961152ms iteration = 2 status = {"generation":1}
14112024-10-01T02:33:14.377ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 3 reason = Dependency
14122024-10-01T02:33:14.398ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "5d7b7ad1-f380-42a1-9169-535b852e54a9", "date": "Tue, 01 Oct 2024 02:33:14 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
14132024-10-01T02:33:14.398ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
14142024-10-01T02:33:14.411ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
14152024-10-01T02:33:14.415ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "a9ad6fbf-bde3-4572-aaff-9b5567cd5ee7", "date": "Tue, 01 Oct 2024 02:33:14 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
14162024-10-01T02:33:14.415ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
14172024-10-01T02:33:14.416ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
14182024-10-01T02:33:14.416ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 120.945876ms iteration = 3 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
14192024-10-01T02:33:14.419ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
14202024-10-01T02:33:14.419ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
14212024-10-01T02:33:14.421ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
14222024-10-01T02:33:14.421ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
14232024-10-01T02:33:14.422ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
14242024-10-01T02:33:14.423ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
14252024-10-01T02:33:14.424ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
14262024-10-01T02:33:14.424ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
14272024-10-01T02:33:14.425ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14282024-10-01T02:33:14.428ZDEBGnexus (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
14292024-10-01T02:33:14.429ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
14302024-10-01T02:33:14.429ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
14312024-10-01T02:33:14.430ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
14322024-10-01T02:33:14.430ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
14332024-10-01T02:33:14.431ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
14342024-10-01T02:33:14.432ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
14352024-10-01T02:33:14.433ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
14362024-10-01T02:33:14.433ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
14372024-10-01T02:33:14.435ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
14382024-10-01T02:33:14.435ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
14392024-10-01T02:33:14.437ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
14402024-10-01T02:33:14.437ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
14412024-10-01T02:33:14.438ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
14422024-10-01T02:33:14.438ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
14432024-10-01T02:33:14.440ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14442024-10-01T02:33:14.443ZDEBGnexus (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
14452024-10-01T02:33:14.443ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
14462024-10-01T02:33:14.443ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
14472024-10-01T02:33:14.444ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
14482024-10-01T02:33:14.444ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
14492024-10-01T02:33:14.445ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
14502024-10-01T02:33:14.446ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
14512024-10-01T02:33:14.446ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
14522024-10-01T02:33:14.448ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14532024-10-01T02:33:14.451ZDEBGnexus (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
14542024-10-01T02:33:14.451ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
14552024-10-01T02:33:14.451ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
14562024-10-01T02:33:14.454ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
14572024-10-01T02:33:14.454ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
14582024-10-01T02:33:14.455ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
14592024-10-01T02:33:14.456ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
14602024-10-01T02:33:14.457ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
14612024-10-01T02:33:14.457ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
14622024-10-01T02:33:14.459ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
14632024-10-01T02:33:14.459ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
14642024-10-01T02:33:14.461ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
14652024-10-01T02:33:14.461ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
14662024-10-01T02:33:14.462ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
14672024-10-01T02:33:14.462ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
14682024-10-01T02:33:14.464ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
14692024-10-01T02:33:14.464ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
14702024-10-01T02:33:14.468ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14712024-10-01T02:33:14.471ZDEBGnexus (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
14722024-10-01T02:33:14.471ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
14732024-10-01T02:33:14.471ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
14742024-10-01T02:33:14.473ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
14752024-10-01T02:33:14.473ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
14762024-10-01T02:33:14.474ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
14772024-10-01T02:33:14.475ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
14782024-10-01T02:33:14.476ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14792024-10-01T02:33:14.478ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
14802024-10-01T02:33:14.479ZDEBGnexus (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
14812024-10-01T02:33:14.479ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
14822024-10-01T02:33:14.479ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
14832024-10-01T02:33:14.486ZDEBGnexus (InternalApi): resolved names for firewall rules instance_interfaces = {} subnet_interfaces = {Name("external-dns"): [NetworkInterface { id: 498a9376-2ad6-4307-b191-e6d73cf2f1a4, kind: Service { id: 0a1ed896-5078-4267-b636-10151376f015 }, name: Name("external-dns-0a1ed896-5078-4267-b636-10151376f015"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 226, 149])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e4ffe935-3383-46e7-947f-e87df509f06f, kind: Service { id: eb937866-c779-4a9e-aec4-cc18302d4ce1 }, name: Name("external-dns-eb937866-c779-4a9e-aec4-cc18302d4ce1"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 254, 225])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("nexus"): [NetworkInterface { id: 611bfb6e-9731-4e0b-9af8-03e07b661aa3, kind: Service { id: 772acfa5-ee20-4a17-a053-c207ffa50ed6 }, name: Name("nexus-772acfa5-ee20-4a17-a053-c207ffa50ed6"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 139, 222])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 98b85cfc-ac80-4175-9f04-dd15c9b20d24, kind: Service { id: 3dfd7033-71d8-4eb9-bb97-49dae3b5cd35 }, name: Name("nexus-3dfd7033-71d8-4eb9-bb97-49dae3b5cd35"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 167, 29])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a840a1d8-f258-45fe-96a0-7b8383461d51, kind: Service { id: e9e4c757-e076-4386-92e2-8217b8bb307d }, name: Name("nexus-e9e4c757-e076-4386-92e2-8217b8bb307d"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 176, 241])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })], Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })]} vpc_interfaces = {}
14842024-10-01T02:33:14.486ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
14852024-10-01T02:33:14.487ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
14862024-10-01T02:33:14.488ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14872024-10-01T02:33:14.490ZDEBGnexus (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Fleet result = Ok(())
14882024-10-01T02:33:14.490ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
14892024-10-01T02:33:14.490ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
14902024-10-01T02:33:14.513ZDEBGnexus (InternalApi): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified.
14912024-10-01T02:33:14.513ZDEBGnexus (InternalApi): resolved firewall rules for sled agents sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 498a9376-2ad6-4307-b191-e6d73cf2f1a4, kind: Service { id: 0a1ed896-5078-4267-b636-10151376f015 }, name: Name("external-dns-0a1ed896-5078-4267-b636-10151376f015"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 226, 149])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e4ffe935-3383-46e7-947f-e87df509f06f, kind: Service { id: eb937866-c779-4a9e-aec4-cc18302d4ce1 }, name: Name("external-dns-eb937866-c779-4a9e-aec4-cc18302d4ce1"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 254, 225])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 611bfb6e-9731-4e0b-9af8-03e07b661aa3, kind: Service { id: 772acfa5-ee20-4a17-a053-c207ffa50ed6 }, name: Name("nexus-772acfa5-ee20-4a17-a053-c207ffa50ed6"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 139, 222])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 98b85cfc-ac80-4175-9f04-dd15c9b20d24, kind: Service { id: 3dfd7033-71d8-4eb9-bb97-49dae3b5cd35 }, name: Name("nexus-3dfd7033-71d8-4eb9-bb97-49dae3b5cd35"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 167, 29])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a840a1d8-f258-45fe-96a0-7b8383461d51, kind: Service { id: e9e4c757-e076-4386-92e2-8217b8bb307d }, name: Name("nexus-e9e4c757-e076-4386-92e2-8217b8bb307d"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 176, 241])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
14922024-10-01T02:33:14.514ZDEBGnexus (InternalApi): resolved 2 rules for sleds
14932024-10-01T02:33:14.518ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "688ac133-fd9f-4a3e-a5ea-15e6bfd75322", "date": "Tue, 01 Oct 2024 02:33:14 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
14942024-10-01T02:33:14.518ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
14952024-10-01T02:33:14.521ZINFOnexus (BackgroundTasks): removed inventory collection background_task = inventory_collection collection_id = f4292df9-35df-497b-a9dc-2e40f77ad419 file = nexus/db-queries/src/db/datastore/inventory.rs:1402 ncabooses = 12 ncollections = 1 ndatasets = 0 nerrors = 0 nnics = 0 nnvme_disk_firmware = 0 nphysical_disks = 0 nrot_pages = 8 nrots = 2 nsled_agent_zones = 0 nsled_agents = 0 nsps = 2 nzones = 0 nzpools = 0
14962024-10-01T02:33:14.521ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
14972024-10-01T02:33:14.522ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
14982024-10-01T02:33:14.523ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "1e677d57-8944-40b6-94c7-2afc86d3c1d7", "date": "Tue, 01 Oct 2024 02:33:14 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
14992024-10-01T02:33:14.523ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
15002024-10-01T02:33:14.527ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "a5ef2722-0d60-4335-b5fa-60f785ecc77f", "date": "Tue, 01 Oct 2024 02:33:14 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
15012024-10-01T02:33:14.527ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
15022024-10-01T02:33:14.527ZDEBGnexus (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(c4c1c8ca-7be6-4a78-9a5c-d371c17c5887, 0), (679cc7f1-67b5-471b-a4ed-94a2cd652f8a, 0), (be89f38c-d395-41e2-899a-3fcfb38880dd, 0)]
15032024-10-01T02:33:14.527ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1247, tv_nsec: 971655709 } })
15042024-10-01T02:33:14.529ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
15052024-10-01T02:33:14.529ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 151.885485ms iteration = 3 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
15062024-10-01T02:33:14.559ZDEBGnexus (BackgroundTasks): begin collection background_task = inventory_collection
15072024-10-01T02:33:14.559ZDEBGnexus (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[fd00:1122:3344:101::2]:12225
15082024-10-01T02:33:14.559ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/ignition
15092024-10-01T02:33:14.559ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "d7485c39-b6e4-4293-aeaf-d8142e5dfdca", "content-length": "476", "date": "Tue, 01 Oct 2024 02:33:14 GMT"} })
15102024-10-01T02:33:14.559ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0
15112024-10-01T02:33:14.560ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "6b7217ad-1a16-4ef4-95b9-0e7c3438f346", "content-length": "734", "date": "Tue, 01 Oct 2024 02:33:14 GMT"} })
15122024-10-01T02:33:14.560ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0
15132024-10-01T02:33:14.560ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "ba74c9f5-76c9-4203-8a0d-a5b0a4f01846", "content-length": "111", "date": "Tue, 01 Oct 2024 02:33:14 GMT"} })
15142024-10-01T02:33:14.560ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1
15152024-10-01T02:33:14.560ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "9336f6ed-2b14-4353-a450-1051c024ad97", "content-length": "111", "date": "Tue, 01 Oct 2024 02:33:14 GMT"} })
15162024-10-01T02:33:14.560ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0
15172024-10-01T02:33:14.560ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "01ffaac3-db12-48a5-8375-b571050efb96", "content-length": "167", "date": "Tue, 01 Oct 2024 02:33:14 GMT"} })
15182024-10-01T02:33:14.560ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1
15192024-10-01T02:33:14.561ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "27358297-8841-4d5a-9e41-7a629498933b", "content-length": "167", "date": "Tue, 01 Oct 2024 02:33:14 GMT"} })
15202024-10-01T02:33:14.561ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0
15212024-10-01T02:33:14.561ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "a9cbe4c2-472e-43dc-9447-5632db1fbc6b", "content-length": "175", "date": "Tue, 01 Oct 2024 02:33:14 GMT"} })
15222024-10-01T02:33:14.561ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1
15232024-10-01T02:33:14.562ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "e21e8494-4461-4d97-936a-17b3b214111c", "content-length": "175", "date": "Tue, 01 Oct 2024 02:33:14 GMT"} })
15242024-10-01T02:33:14.562ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa
15252024-10-01T02:33:14.562ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "7e49b43d-62d3-4096-9ecc-a341338fc2b7", "content-length": "702", "date": "Tue, 01 Oct 2024 02:33:14 GMT"} })
15262024-10-01T02:33:14.562ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
15272024-10-01T02:33:14.562ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "1138f647-51ee-48fb-9249-6f8b4379efd1", "content-length": "727", "date": "Tue, 01 Oct 2024 02:33:14 GMT"} })
15282024-10-01T02:33:14.562ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
15292024-10-01T02:33:14.562ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "ac82af11-2cf0-40a6-8e4e-6c9d50348cd9", "content-length": "729", "date": "Tue, 01 Oct 2024 02:33:14 GMT"} })
15302024-10-01T02:33:14.562ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
15312024-10-01T02:33:14.562ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "07d2326b-cd42-4e3e-b139-cfa464d29999", "content-length": "728", "date": "Tue, 01 Oct 2024 02:33:14 GMT"} })
15322024-10-01T02:33:14.562ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0
15332024-10-01T02:33:14.563ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "6769b673-9612-426b-8fbb-1f44a4743d45", "content-length": "722", "date": "Tue, 01 Oct 2024 02:33:14 GMT"} })
15342024-10-01T02:33:14.563ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0
15352024-10-01T02:33:14.564ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "c43d6443-8e2b-4ebf-8488-d3aa638290a7", "content-length": "109", "date": "Tue, 01 Oct 2024 02:33:14 GMT"} })
15362024-10-01T02:33:14.564ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1
15372024-10-01T02:33:14.564ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "4b42b342-5e44-41c1-bc5c-e5cb90886bae", "content-length": "109", "date": "Tue, 01 Oct 2024 02:33:14 GMT"} })
15382024-10-01T02:33:14.564ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0
15392024-10-01T02:33:14.564ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "ac2c8594-88ec-41e3-83dd-9dcc183e6b23", "content-length": "169", "date": "Tue, 01 Oct 2024 02:33:14 GMT"} })
15402024-10-01T02:33:14.564ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1
15412024-10-01T02:33:14.564ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "86d3e3c5-e12f-4877-8fe6-e6eacb1e0849", "content-length": "169", "date": "Tue, 01 Oct 2024 02:33:14 GMT"} })
15422024-10-01T02:33:14.564ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0
15432024-10-01T02:33:14.566ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "c448a68a-be1b-452c-ad1f-d99b5afebd79", "content-length": "178", "date": "Tue, 01 Oct 2024 02:33:14 GMT"} })
15442024-10-01T02:33:14.566ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1
15452024-10-01T02:33:14.566ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "aecefaa2-b941-4ed1-9221-5e5be901cf69", "content-length": "178", "date": "Tue, 01 Oct 2024 02:33:14 GMT"} })
15462024-10-01T02:33:14.566ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa
15472024-10-01T02:33:14.566ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "fbdeb2ea-88fa-48ca-ac90-26707f64221b", "content-length": "702", "date": "Tue, 01 Oct 2024 02:33:14 GMT"} })
15482024-10-01T02:33:14.566ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
15492024-10-01T02:33:14.566ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "d93bb8d4-b77d-41b8-963b-d1264e0d5bfe", "content-length": "727", "date": "Tue, 01 Oct 2024 02:33:14 GMT"} })
15502024-10-01T02:33:14.566ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
15512024-10-01T02:33:14.567ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "7bd7334d-4a2d-4059-9005-e6e848ba7fe4", "content-length": "729", "date": "Tue, 01 Oct 2024 02:33:14 GMT"} })
15522024-10-01T02:33:14.567ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
15532024-10-01T02:33:14.567ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "8c49e7fb-31b2-45cd-94c5-00a1bf408d64", "content-length": "728", "date": "Tue, 01 Oct 2024 02:33:14 GMT"} })
15542024-10-01T02:33:14.567ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
15552024-10-01T02:33:14.567ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
15562024-10-01T02:33:14.575ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15572024-10-01T02:33:14.577ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
15582024-10-01T02:33:14.577ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
15592024-10-01T02:33:14.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
15602024-10-01T02:33:14.577ZDEBGnexus (InternalApi): resolved sleds for vpc oxide-services vpc_to_sled = [Sled { identity: SledIdentity { id: 2a571ec0-85a3-450e-88fc-680c13ffa211, time_created: 2024-10-01T02:33:11.506220Z, time_modified: 2024-10-01T02:33:11.506220Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: 52547763-7759-42e1-81a9-8b833f59f5dd, is_scrimlet: true, serial_number: "buskin", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
15612024-10-01T02:33:14.577ZDEBGnexus (InternalApi): sending firewall rules to sled agents
15622024-10-01T02:33:14.577ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
15632024-10-01T02:33:14.577ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
15642024-10-01T02:33:14.579ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15652024-10-01T02:33:14.579ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
15662024-10-01T02:33:14.579ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
15672024-10-01T02:33:14.580ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
15682024-10-01T02:33:14.580ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
15692024-10-01T02:33:14.580ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15702024-10-01T02:33:14.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
15712024-10-01T02:33:14.583ZDEBGnexus (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Sled { parent: Fleet, key: 2a571ec0-85a3-450e-88fc-680c13ffa211, lookup_type: ById(2a571ec0-85a3-450e-88fc-680c13ffa211) } result = Ok(())
15722024-10-01T02:33:14.614ZDEBGnexus (InternalApi): client request SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
15732024-10-01T02:33:14.615ZDEBGnexus (InternalApi): client response SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "ace5f580-cd1e-4483-acbc-acc87a11e9e3", "date": "Tue, 01 Oct 2024 02:33:14 GMT"} })
15742024-10-01T02:33:14.616ZINFOnexus (InternalApi): updated firewall rules on 1 sleds file = nexus/networking/src/firewall_rules.rs:496
15752024-10-01T02:33:14.616ZINFOnexus: plumbed initial IP allowlist file = nexus/src/app/allow_list.rs:161
15762024-10-01T02:33:14.627ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /
15772024-10-01T02:33:14.627ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /access
15782024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /assets/{path}
15792024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /device/auth
15802024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /device/confirm
15812024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /device/success
15822024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /device/token
15832024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /device/verify
15842024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /experimental/v1/probes
15852024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /experimental/v1/probes
15862024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /experimental/v1/probes/{probe}
15872024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /experimental/v1/probes/{probe}
15882024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /images
15892024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /login
15902024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /login/{silo_name}/local
15912024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /login/{silo_name}/saml/{provider_name}
15922024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /login/{silo_name}/saml/{provider_name}
15932024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /login/{silo_name}/saml/{provider_name}/redirect
15942024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /lookup/{path}
15952024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /projects/{path}
15962024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /projects-new
15972024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /settings/{path}
15982024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /system/{path}
15992024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /utilization
16002024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/certificates
16012024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/certificates
16022024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/certificates/{certificate}
16032024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/certificates/{certificate}
16042024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/disks
16052024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/disks
16062024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/disks/{disk}
16072024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/disks/{disk}
16082024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/disks/{disk}/bulk-write
16092024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/disks/{disk}/bulk-write-start
16102024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/disks/{disk}/bulk-write-stop
16112024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/disks/{disk}/finalize
16122024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/disks/{disk}/metrics/{metric}
16132024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/floating-ips
16142024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/floating-ips
16152024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/floating-ips/{floating_ip}
16162024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/floating-ips/{floating_ip}
16172024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/floating-ips/{floating_ip}
16182024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/floating-ips/{floating_ip}/attach
16192024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/floating-ips/{floating_ip}/detach
16202024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/groups
16212024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/groups/{group_id}
16222024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/images
16232024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/images
16242024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/images/{image}
16252024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/images/{image}
16262024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/images/{image}/demote
16272024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/images/{image}/promote
16282024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/instances
16292024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/instances
16302024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/instances/{instance}
16312024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/instances/{instance}
16322024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/instances/{instance}/disks
16332024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/instances/{instance}/disks/attach
16342024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/instances/{instance}/disks/detach
16352024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/instances/{instance}/external-ips
16362024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/instances/{instance}/external-ips/ephemeral
16372024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/instances/{instance}/external-ips/ephemeral
16382024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/instances/{instance}/reboot
16392024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/instances/{instance}/serial-console
16402024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/instances/{instance}/serial-console/stream
16412024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/instances/{instance}/ssh-public-keys
16422024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/instances/{instance}/start
16432024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/instances/{instance}/stop
16442024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/ip-pools
16452024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/ip-pools/{pool}
16462024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/login/{silo_name}/local
16472024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/logout
16482024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/me
16492024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/me/groups
16502024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/me/ssh-keys
16512024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/me/ssh-keys
16522024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/me/ssh-keys/{ssh_key}
16532024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/me/ssh-keys/{ssh_key}
16542024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/metrics/{metric_name}
16552024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/network-interfaces
16562024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/network-interfaces
16572024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/network-interfaces/{interface}
16582024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/network-interfaces/{interface}
16592024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/network-interfaces/{interface}
16602024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/ping
16612024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/policy
16622024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/policy
16632024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/projects
16642024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/projects
16652024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/projects/{project}
16662024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/projects/{project}
16672024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/projects/{project}
16682024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/projects/{project}/policy
16692024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/projects/{project}/policy
16702024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/snapshots
16712024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/snapshots
16722024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/snapshots/{snapshot}
16732024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/snapshots/{snapshot}
16742024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/disks
16752024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/disks/{disk_id}
16762024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/racks
16772024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/racks/{rack_id}
16782024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/sleds
16792024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/hardware/sleds
16802024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/sleds/{sled_id}
16812024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/sleds/{sled_id}/disks
16822024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/sleds/{sled_id}/instances
16832024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/hardware/sleds/{sled_id}/provision-policy
16842024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/sleds-uninitialized
16852024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/switch-port
16862024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/hardware/switch-port/{port}/settings
16872024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/hardware/switch-port/{port}/settings
16882024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/switch-port/{port}/status
16892024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/switches
16902024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/switches/{switch_id}
16912024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/identity-providers
16922024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/identity-providers/local/users
16932024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/identity-providers/local/users/{user_id}
16942024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/identity-providers/local/users/{user_id}/set-password
16952024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/identity-providers/saml
16962024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/identity-providers/saml/{provider}
16972024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/ip-pools
16982024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/ip-pools
16992024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/ip-pools/{pool}
17002024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/ip-pools/{pool}
17012024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/ip-pools/{pool}
17022024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/ip-pools/{pool}/ranges
17032024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/ip-pools/{pool}/ranges/add
17042024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/ip-pools/{pool}/ranges/remove
17052024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/ip-pools/{pool}/silos
17062024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/ip-pools/{pool}/silos
17072024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/ip-pools/{pool}/silos/{silo}
17082024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/ip-pools/{pool}/silos/{silo}
17092024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/ip-pools/{pool}/utilization
17102024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/ip-pools-service
17112024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/ip-pools-service/ranges
17122024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/ip-pools-service/ranges/add
17132024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/ip-pools-service/ranges/remove
17142024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/metrics/{metric_name}
17152024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/address-lot
17162024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/networking/address-lot
17172024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/networking/address-lot/{address_lot}
17182024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/address-lot/{address_lot}/blocks
17192024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/allow-list
17202024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/networking/allow-list
17212024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/networking/bfd-disable
17222024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/networking/bfd-enable
17232024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/bfd-status
17242024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/networking/bgp
17252024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/bgp
17262024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/networking/bgp
17272024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/bgp-announce-set
17282024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/networking/bgp-announce-set
17292024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/networking/bgp-announce-set/{announce_set}
17302024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/bgp-announce-set/{announce_set}/announcement
17312024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/bgp-exported
17322024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/bgp-message-history
17332024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/bgp-routes-ipv4
17342024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/bgp-status
17352024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/loopback-address
17362024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/networking/loopback-address
17372024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/networking/loopback-address/{rack_id}/{switch_location}/{address}/{subnet_mask}
17382024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/networking/switch-port-settings
17392024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/switch-port-settings
17402024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/networking/switch-port-settings
17412024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/switch-port-settings/{port}
17422024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/policy
17432024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/policy
17442024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/roles
17452024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/roles/{role_name}
17462024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/silo-quotas
17472024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/silos
17482024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/silos
17492024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/silos/{silo}
17502024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/silos/{silo}
17512024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/silos/{silo}/ip-pools
17522024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/silos/{silo}/policy
17532024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/silos/{silo}/policy
17542024-10-01T02:33:14.628ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/silos/{silo}/quotas
17552024-10-01T02:33:14.629ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/silos/{silo}/quotas
17562024-10-01T02:33:14.629ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/update/repository
17572024-10-01T02:33:14.629ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/update/repository/{system_version}
17582024-10-01T02:33:14.629ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/users
17592024-10-01T02:33:14.629ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/users/{user_id}
17602024-10-01T02:33:14.629ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/users-builtin
17612024-10-01T02:33:14.629ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/users-builtin/{user}
17622024-10-01T02:33:14.629ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/utilization/silos
17632024-10-01T02:33:14.629ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/utilization/silos/{silo}
17642024-10-01T02:33:14.629ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/timeseries/query
17652024-10-01T02:33:14.629ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/timeseries/schema
17662024-10-01T02:33:14.629ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/users
17672024-10-01T02:33:14.629ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/utilization
17682024-10-01T02:33:14.629ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpc-firewall-rules
17692024-10-01T02:33:14.629ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/vpc-firewall-rules
17702024-10-01T02:33:14.629ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpc-router-routes
17712024-10-01T02:33:14.629ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/vpc-router-routes
17722024-10-01T02:33:14.629ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/vpc-router-routes/{route}
17732024-10-01T02:33:14.629ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpc-router-routes/{route}
17742024-10-01T02:33:14.629ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/vpc-router-routes/{route}
17752024-10-01T02:33:14.629ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpc-routers
17762024-10-01T02:33:14.629ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/vpc-routers
17772024-10-01T02:33:14.629ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/vpc-routers/{router}
17782024-10-01T02:33:14.629ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpc-routers/{router}
17792024-10-01T02:33:14.629ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/vpc-routers/{router}
17802024-10-01T02:33:14.629ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpc-subnets
17812024-10-01T02:33:14.629ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/vpc-subnets
17822024-10-01T02:33:14.629ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/vpc-subnets/{subnet}
17832024-10-01T02:33:14.629ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpc-subnets/{subnet}
17842024-10-01T02:33:14.629ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/vpc-subnets/{subnet}
17852024-10-01T02:33:14.629ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpc-subnets/{subnet}/network-interfaces
17862024-10-01T02:33:14.629ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpcs
17872024-10-01T02:33:14.629ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/vpcs
17882024-10-01T02:33:14.629ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/vpcs/{vpc}
17892024-10-01T02:33:14.629ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpcs/{vpc}
17902024-10-01T02:33:14.629ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/vpcs/{vpc}
17912024-10-01T02:33:14.629ZINFOnexus (dropshot_external): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:197 local_addr = 172.30.2.7:443
17922024-10-01T02:33:14.629ZDEBGnexus (dropshot_external): successfully registered DTrace USDT probes local_addr = 172.30.2.7:443
17932024-10-01T02:33:14.633ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /
17942024-10-01T02:33:14.633ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /access
17952024-10-01T02:33:14.633ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /assets/{path}
17962024-10-01T02:33:14.633ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /device/auth
17972024-10-01T02:33:14.633ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /device/confirm
17982024-10-01T02:33:14.633ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /device/success
17992024-10-01T02:33:14.633ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /device/token
18002024-10-01T02:33:14.633ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /device/verify
18012024-10-01T02:33:14.633ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /experimental/v1/probes
18022024-10-01T02:33:14.633ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /experimental/v1/probes
18032024-10-01T02:33:14.633ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /experimental/v1/probes/{probe}
18042024-10-01T02:33:14.633ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /experimental/v1/probes/{probe}
18052024-10-01T02:33:14.633ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /images
18062024-10-01T02:33:14.633ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /login
18072024-10-01T02:33:14.633ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /login/{silo_name}/local
18082024-10-01T02:33:14.633ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /login/{silo_name}/saml/{provider_name}
18092024-10-01T02:33:14.633ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /login/{silo_name}/saml/{provider_name}
18102024-10-01T02:33:14.633ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /login/{silo_name}/saml/{provider_name}/redirect
18112024-10-01T02:33:14.633ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /lookup/{path}
18122024-10-01T02:33:14.633ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /projects/{path}
18132024-10-01T02:33:14.633ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /projects-new
18142024-10-01T02:33:14.633ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /settings/{path}
18152024-10-01T02:33:14.633ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /system/{path}
18162024-10-01T02:33:14.633ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /utilization
18172024-10-01T02:33:14.633ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/certificates
18182024-10-01T02:33:14.633ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/certificates
18192024-10-01T02:33:14.633ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/certificates/{certificate}
18202024-10-01T02:33:14.633ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/certificates/{certificate}
18212024-10-01T02:33:14.633ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/disks
18222024-10-01T02:33:14.633ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/disks
18232024-10-01T02:33:14.633ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/disks/{disk}
18242024-10-01T02:33:14.633ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/disks/{disk}
18252024-10-01T02:33:14.633ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/disks/{disk}/bulk-write
18262024-10-01T02:33:14.633ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/disks/{disk}/bulk-write-start
18272024-10-01T02:33:14.633ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/disks/{disk}/bulk-write-stop
18282024-10-01T02:33:14.633ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/disks/{disk}/finalize
18292024-10-01T02:33:14.633ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/disks/{disk}/metrics/{metric}
18302024-10-01T02:33:14.633ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/floating-ips
18312024-10-01T02:33:14.633ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/floating-ips
18322024-10-01T02:33:14.633ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/floating-ips/{floating_ip}
18332024-10-01T02:33:14.633ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/floating-ips/{floating_ip}
18342024-10-01T02:33:14.633ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/floating-ips/{floating_ip}
18352024-10-01T02:33:14.633ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/floating-ips/{floating_ip}/attach
18362024-10-01T02:33:14.633ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/floating-ips/{floating_ip}/detach
18372024-10-01T02:33:14.633ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/groups
18382024-10-01T02:33:14.633ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/groups/{group_id}
18392024-10-01T02:33:14.633ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/images
18402024-10-01T02:33:14.633ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/images
18412024-10-01T02:33:14.633ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/images/{image}
18422024-10-01T02:33:14.633ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/images/{image}
18432024-10-01T02:33:14.633ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/images/{image}/demote
18442024-10-01T02:33:14.633ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/images/{image}/promote
18452024-10-01T02:33:14.633ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/instances
18462024-10-01T02:33:14.633ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/instances
18472024-10-01T02:33:14.633ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/instances/{instance}
18482024-10-01T02:33:14.633ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/instances/{instance}
18492024-10-01T02:33:14.633ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/instances/{instance}/disks
18502024-10-01T02:33:14.633ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/instances/{instance}/disks/attach
18512024-10-01T02:33:14.633ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/instances/{instance}/disks/detach
18522024-10-01T02:33:14.633ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/instances/{instance}/external-ips
18532024-10-01T02:33:14.633ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/instances/{instance}/external-ips/ephemeral
18542024-10-01T02:33:14.633ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/instances/{instance}/external-ips/ephemeral
18552024-10-01T02:33:14.633ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/instances/{instance}/reboot
18562024-10-01T02:33:14.633ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/instances/{instance}/serial-console
18572024-10-01T02:33:14.633ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/instances/{instance}/serial-console/stream
18582024-10-01T02:33:14.633ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/instances/{instance}/ssh-public-keys
18592024-10-01T02:33:14.633ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/instances/{instance}/start
18602024-10-01T02:33:14.633ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/instances/{instance}/stop
18612024-10-01T02:33:14.633ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/ip-pools
18622024-10-01T02:33:14.633ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/ip-pools/{pool}
18632024-10-01T02:33:14.633ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/login/{silo_name}/local
18642024-10-01T02:33:14.633ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/logout
18652024-10-01T02:33:14.633ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/me
18662024-10-01T02:33:14.633ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/me/groups
18672024-10-01T02:33:14.633ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/me/ssh-keys
18682024-10-01T02:33:14.633ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/me/ssh-keys
18692024-10-01T02:33:14.633ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/me/ssh-keys/{ssh_key}
18702024-10-01T02:33:14.633ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/me/ssh-keys/{ssh_key}
18712024-10-01T02:33:14.633ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/metrics/{metric_name}
18722024-10-01T02:33:14.633ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/network-interfaces
18732024-10-01T02:33:14.633ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/network-interfaces
18742024-10-01T02:33:14.633ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/network-interfaces/{interface}
18752024-10-01T02:33:14.633ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/network-interfaces/{interface}
18762024-10-01T02:33:14.633ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/network-interfaces/{interface}
18772024-10-01T02:33:14.633ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/ping
18782024-10-01T02:33:14.633ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/policy
18792024-10-01T02:33:14.633ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/policy
18802024-10-01T02:33:14.633ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/projects
18812024-10-01T02:33:14.633ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/projects
18822024-10-01T02:33:14.633ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/projects/{project}
18832024-10-01T02:33:14.633ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/projects/{project}
18842024-10-01T02:33:14.633ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/projects/{project}
18852024-10-01T02:33:14.633ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/projects/{project}/policy
18862024-10-01T02:33:14.633ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/projects/{project}/policy
18872024-10-01T02:33:14.633ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/snapshots
18882024-10-01T02:33:14.633ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/snapshots
18892024-10-01T02:33:14.633ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/snapshots/{snapshot}
18902024-10-01T02:33:14.633ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/snapshots/{snapshot}
18912024-10-01T02:33:14.633ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/disks
18922024-10-01T02:33:14.633ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/disks/{disk_id}
18932024-10-01T02:33:14.633ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/racks
18942024-10-01T02:33:14.633ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/racks/{rack_id}
18952024-10-01T02:33:14.633ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/sleds
18962024-10-01T02:33:14.633ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/hardware/sleds
18972024-10-01T02:33:14.633ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/sleds/{sled_id}
18982024-10-01T02:33:14.633ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/sleds/{sled_id}/disks
18992024-10-01T02:33:14.633ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/sleds/{sled_id}/instances
19002024-10-01T02:33:14.633ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/hardware/sleds/{sled_id}/provision-policy
19012024-10-01T02:33:14.633ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/sleds-uninitialized
19022024-10-01T02:33:14.633ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/switch-port
19032024-10-01T02:33:14.633ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/hardware/switch-port/{port}/settings
19042024-10-01T02:33:14.633ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/hardware/switch-port/{port}/settings
19052024-10-01T02:33:14.633ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/switch-port/{port}/status
19062024-10-01T02:33:14.633ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/switches
19072024-10-01T02:33:14.633ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/switches/{switch_id}
19082024-10-01T02:33:14.633ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/identity-providers
19092024-10-01T02:33:14.633ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/identity-providers/local/users
19102024-10-01T02:33:14.633ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/identity-providers/local/users/{user_id}
19112024-10-01T02:33:14.633ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/identity-providers/local/users/{user_id}/set-password
19122024-10-01T02:33:14.633ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/identity-providers/saml
19132024-10-01T02:33:14.633ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/identity-providers/saml/{provider}
19142024-10-01T02:33:14.633ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/ip-pools
19152024-10-01T02:33:14.633ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/ip-pools
19162024-10-01T02:33:14.633ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/ip-pools/{pool}
19172024-10-01T02:33:14.633ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/ip-pools/{pool}
19182024-10-01T02:33:14.633ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/ip-pools/{pool}
19192024-10-01T02:33:14.633ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/ip-pools/{pool}/ranges
19202024-10-01T02:33:14.633ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/ip-pools/{pool}/ranges/add
19212024-10-01T02:33:14.633ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/ip-pools/{pool}/ranges/remove
19222024-10-01T02:33:14.633ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/ip-pools/{pool}/silos
19232024-10-01T02:33:14.633ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/ip-pools/{pool}/silos
19242024-10-01T02:33:14.633ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/ip-pools/{pool}/silos/{silo}
19252024-10-01T02:33:14.633ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/ip-pools/{pool}/silos/{silo}
19262024-10-01T02:33:14.633ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/ip-pools/{pool}/utilization
19272024-10-01T02:33:14.633ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/ip-pools-service
19282024-10-01T02:33:14.633ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/ip-pools-service/ranges
19292024-10-01T02:33:14.633ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/ip-pools-service/ranges/add
19302024-10-01T02:33:14.633ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/ip-pools-service/ranges/remove
19312024-10-01T02:33:14.633ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/metrics/{metric_name}
19322024-10-01T02:33:14.633ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/address-lot
19332024-10-01T02:33:14.633ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/networking/address-lot
19342024-10-01T02:33:14.633ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/networking/address-lot/{address_lot}
19352024-10-01T02:33:14.633ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/address-lot/{address_lot}/blocks
19362024-10-01T02:33:14.633ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/allow-list
19372024-10-01T02:33:14.633ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/networking/allow-list
19382024-10-01T02:33:14.633ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/networking/bfd-disable
19392024-10-01T02:33:14.633ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/networking/bfd-enable
19402024-10-01T02:33:14.633ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/bfd-status
19412024-10-01T02:33:14.633ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/networking/bgp
19422024-10-01T02:33:14.633ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/bgp
19432024-10-01T02:33:14.633ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/networking/bgp
19442024-10-01T02:33:14.633ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/bgp-announce-set
19452024-10-01T02:33:14.633ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/networking/bgp-announce-set
19462024-10-01T02:33:14.633ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/networking/bgp-announce-set/{announce_set}
19472024-10-01T02:33:14.633ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/bgp-announce-set/{announce_set}/announcement
19482024-10-01T02:33:14.633ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/bgp-exported
19492024-10-01T02:33:14.633ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/bgp-message-history
19502024-10-01T02:33:14.633ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/bgp-routes-ipv4
19512024-10-01T02:33:14.633ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/bgp-status
19522024-10-01T02:33:14.633ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/loopback-address
19532024-10-01T02:33:14.634ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/networking/loopback-address
19542024-10-01T02:33:14.634ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/networking/loopback-address/{rack_id}/{switch_location}/{address}/{subnet_mask}
19552024-10-01T02:33:14.634ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/networking/switch-port-settings
19562024-10-01T02:33:14.634ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/switch-port-settings
19572024-10-01T02:33:14.634ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/networking/switch-port-settings
19582024-10-01T02:33:14.634ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/switch-port-settings/{port}
19592024-10-01T02:33:14.634ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/policy
19602024-10-01T02:33:14.634ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/policy
19612024-10-01T02:33:14.634ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/roles
19622024-10-01T02:33:14.634ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/roles/{role_name}
19632024-10-01T02:33:14.634ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/silo-quotas
19642024-10-01T02:33:14.634ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/silos
19652024-10-01T02:33:14.634ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/silos
19662024-10-01T02:33:14.634ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/silos/{silo}
19672024-10-01T02:33:14.634ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/silos/{silo}
19682024-10-01T02:33:14.634ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/silos/{silo}/ip-pools
19692024-10-01T02:33:14.634ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/silos/{silo}/policy
19702024-10-01T02:33:14.634ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/silos/{silo}/policy
19712024-10-01T02:33:14.634ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/silos/{silo}/quotas
19722024-10-01T02:33:14.634ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/silos/{silo}/quotas
19732024-10-01T02:33:14.634ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/update/repository
19742024-10-01T02:33:14.634ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/update/repository/{system_version}
19752024-10-01T02:33:14.634ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/users
19762024-10-01T02:33:14.634ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/users/{user_id}
19772024-10-01T02:33:14.634ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/users-builtin
19782024-10-01T02:33:14.634ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/users-builtin/{user}
19792024-10-01T02:33:14.634ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/utilization/silos
19802024-10-01T02:33:14.634ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/utilization/silos/{silo}
19812024-10-01T02:33:14.634ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/timeseries/query
19822024-10-01T02:33:14.634ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/timeseries/schema
19832024-10-01T02:33:14.634ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/users
19842024-10-01T02:33:14.634ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/utilization
19852024-10-01T02:33:14.634ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpc-firewall-rules
19862024-10-01T02:33:14.634ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/vpc-firewall-rules
19872024-10-01T02:33:14.634ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpc-router-routes
19882024-10-01T02:33:14.634ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/vpc-router-routes
19892024-10-01T02:33:14.634ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/vpc-router-routes/{route}
19902024-10-01T02:33:14.634ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpc-router-routes/{route}
19912024-10-01T02:33:14.634ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/vpc-router-routes/{route}
19922024-10-01T02:33:14.634ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpc-routers
19932024-10-01T02:33:14.634ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/vpc-routers
19942024-10-01T02:33:14.634ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/vpc-routers/{router}
19952024-10-01T02:33:14.634ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpc-routers/{router}
19962024-10-01T02:33:14.634ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/vpc-routers/{router}
19972024-10-01T02:33:14.634ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpc-subnets
19982024-10-01T02:33:14.634ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/vpc-subnets
19992024-10-01T02:33:14.634ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/vpc-subnets/{subnet}
20002024-10-01T02:33:14.634ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpc-subnets/{subnet}
20012024-10-01T02:33:14.634ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/vpc-subnets/{subnet}
20022024-10-01T02:33:14.634ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpc-subnets/{subnet}/network-interfaces
20032024-10-01T02:33:14.634ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpcs
20042024-10-01T02:33:14.634ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/vpcs
20052024-10-01T02:33:14.634ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/vpcs/{vpc}
20062024-10-01T02:33:14.634ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpcs/{vpc}
20072024-10-01T02:33:14.634ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/vpcs/{vpc}
20082024-10-01T02:33:14.634ZINFOnexus (dropshot_external_techport): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:197 local_addr = [fd00:1122:3344:101::c]:12228
20092024-10-01T02:33:14.634ZDEBGnexus (dropshot_external_techport): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::c]:12228
20102024-10-01T02:33:14.634ZDEBGnexus (nexus-producer-server): registered DTrace probes
20112024-10-01T02:33:14.638ZDEBGnexus (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::c]:53319 method = GET path = /{producer_id}
20122024-10-01T02:33:14.638ZINFOnexus (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:197 local_addr = [fd00:1122:3344:101::c]:53319
20132024-10-01T02:33:14.638ZDEBGnexus (dropshot): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::c]:53319
20142024-10-01T02:33:14.638ZDEBGnexus (nexus-producer-server): Requested any available port, Dropshot server has been bound to [fd00:1122:3344:101::c]:53319
20152024-10-01T02:33:14.638ZDEBGnexus (nexus-producer-server): Nexus IP provided explicitly, will use it addr = [fd00:1122:3344:101::c]:12221
20162024-10-01T02:33:14.638ZDEBGnexus (nexus-producer-server): starting producer registration task
20172024-10-01T02:33:14.639ZINFOnexus (nexus-producer-server): starting oximeter metric producer server address = [fd00:1122:3344:101::c]:53319 file = oximeter/producer/src/lib.rs:283 interval = 10s producer_id = 3dfd7033-71d8-4eb9-bb97-49dae3b5cd35
20182024-10-01T02:33:14.639ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
20192024-10-01T02:33:14.639ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
20202024-10-01T02:33:14.704ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
20212024-10-01T02:33:14.704ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:63396
20222024-10-01T02:33:14.704ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:63396 req_id = 6ee007e3-dc78-4150-96e8-bad214f01bed roles = RoleSet { roles: {} } uri = /metrics/producers
20232024-10-01T02:33:14.704ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:63396 req_id = 6ee007e3-dc78-4150-96e8-bad214f01bed resource = Database result = Ok(()) uri = /metrics/producers
20242024-10-01T02:33:14.707ZDEBGnexus (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[fd00:1122:3344:101::1]:12345
20252024-10-01T02:33:14.707ZDEBGnexus (BackgroundTasks): client request SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/inventory
20262024-10-01T02:33:14.750ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 41f2943e-6041-44c9-a47a-3cf5fb012644
20272024-10-01T02:33:14.750ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:63396 req_id = 6ee007e3-dc78-4150-96e8-bad214f01bed roles = RoleSet { roles: {} } uri = /metrics/producers
20282024-10-01T02:33:14.750ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:63396 req_id = 6ee007e3-dc78-4150-96e8-bad214f01bed resource = Database result = Ok(()) uri = /metrics/producers
20292024-10-01T02:33:14.789ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 41f2943e-6041-44c9-a47a-3cf5fb012644 uri = http://[fd00:1122:3344:101::d]:12223/producers
20302024-10-01T02:33:14.790ZDEBGnexus: client response oximeter-collector = 41f2943e-6041-44c9-a47a-3cf5fb012644 result = Ok(Response { url: "http://[fd00:1122:3344:101::d]:12223/producers", status: 204, headers: {"x-request-id": "dd50a638-88d4-404a-a813-ee9977aecf80", "date": "Tue, 01 Oct 2024 02:33:14 GMT"} })
20312024-10-01T02:33:14.790ZINFOnexus: assigned collector to new producer collector_id = 41f2943e-6041-44c9-a47a-3cf5fb012644 file = nexus/src/app/oximeter.rs:125 producer_id = 3dfd7033-71d8-4eb9-bb97-49dae3b5cd35
20322024-10-01T02:33:14.791ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 87080 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:63396 req_id = 6ee007e3-dc78-4150-96e8-bad214f01bed response_code = 201 uri = /metrics/producers
20332024-10-01T02:33:14.791ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "6ee007e3-dc78-4150-96e8-bad214f01bed", "content-length": "41", "date": "Tue, 01 Oct 2024 02:33:14 GMT"} })
20342024-10-01T02:33:14.792ZDEBGnexus (producer-registration-task): registered with nexus successfully
20352024-10-01T02:33:14.792ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
20362024-10-01T02:33:14.908ZDEBGnexus (BackgroundTasks): client response SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "53fd661f-4698-48a5-b676-27649b1847f6", "content-length": "20058", "date": "Tue, 01 Oct 2024 02:33:14 GMT"} })
20372024-10-01T02:33:14.908ZDEBGnexus (BackgroundTasks): client request SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/omicron-zones
20382024-10-01T02:33:14.909ZDEBGnexus (BackgroundTasks): client response SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/omicron-zones", status: 200, headers: {"content-type": "application/json", "x-request-id": "a961f4f2-cfcd-4712-99df-d98fc1762836", "content-length": "10314", "date": "Tue, 01 Oct 2024 02:33:14 GMT"} })
20392024-10-01T02:33:14.911ZDEBGnexus (BackgroundTasks): finished collection background_task = inventory_collection
20402024-10-01T02:33:14.911ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
20412024-10-01T02:33:14.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
20422024-10-01T02:33:14.913ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20432024-10-01T02:33:14.915ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
20442024-10-01T02:33:14.917ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
20452024-10-01T02:33:14.917ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
20462024-10-01T02:33:15.031ZINFOnexus (BackgroundTasks): inserted inventory collection background_task = inventory_collection collection_id = 2c01bbb1-88ca-4d93-81b5-4107f61802eb file = nexus/db-queries/src/db/datastore/inventory.rs:970
20472024-10-01T02:33:15.032ZDEBGnexus (BackgroundTasks): inventory collection complete background_task = inventory_collection collection_id = 2c01bbb1-88ca-4d93-81b5-4107f61802eb time_started = 2024-10-01 02:33:14.558578 UTC
20482024-10-01T02:33:15.032ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 793.409945ms iteration = 2 status = {"collection_id":"2c01bbb1-88ca-4d93-81b5-4107f61802eb","time_done":"2024-10-01 02:33:14.911232 UTC","time_started":"2024-10-01 02:33:14.558578 UTC"}
20492024-10-01T02:33:15.032ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 3 reason = Dependency
20502024-10-01T02:33:15.032ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
20512024-10-01T02:33:15.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
20522024-10-01T02:33:15.034ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20532024-10-01T02:33:15.036ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
20542024-10-01T02:33:15.036ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
20552024-10-01T02:33:15.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
20562024-10-01T02:33:15.039ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
20572024-10-01T02:33:15.040ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
20582024-10-01T02:33:15.041ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20592024-10-01T02:33:15.043ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
20602024-10-01T02:33:15.043ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
20612024-10-01T02:33:15.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
20622024-10-01T02:33:15.052ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 19.589918ms iteration = 3 status = {"physical_disks_added":0}
20632024-10-01T02:33:15.394ZDEBGnexus (NexusCertResolver): resolved TLS certificate certificate = TlsCertificate { digest: "ca547a59343cd98ceb775f10ce9428d8003a71a149b5b7d33f10c1e7a9820bb1" } server_name = recovery.sys.oxide.test silo_id = 21983b87-d6d0-47c6-a33c-5fe68fbed0c6
20642024-10-01T02:33:15.406ZINFOnexus (dropshot_external): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = 172.30.2.7:443 remote_addr = 10.151.1.100:62739
20652024-10-01T02:33:15.416ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
20662024-10-01T02:33:15.417ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
20672024-10-01T02:33:15.420ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
20682024-10-01T02:33:15.420ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
20692024-10-01T02:33:15.421ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
20702024-10-01T02:33:15.422ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
20712024-10-01T02:33:15.423ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
20722024-10-01T02:33:15.425ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, lookup_type: ByName("recovery") } result = Ok(())
20732024-10-01T02:33:15.425ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
20742024-10-01T02:33:15.425ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
20752024-10-01T02:33:15.426ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
20762024-10-01T02:33:15.427ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
20772024-10-01T02:33:15.428ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
20782024-10-01T02:33:15.431ZDEBGnexus (ExternalAuthn): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, lookup_type: ByName("recovery") } result = Ok(())
20792024-10-01T02:33:15.431ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
20802024-10-01T02:33:15.431ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
20812024-10-01T02:33:15.432ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
20822024-10-01T02:33:15.433ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
20832024-10-01T02:33:15.434ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
20842024-10-01T02:33:15.434ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
20852024-10-01T02:33:15.436ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
20862024-10-01T02:33:15.437ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, lookup_type: ByName("recovery") }, key: 8fbcb238-2807-4312-9499-49292447c1fc, lookup_type: ByName("recovery") } result = Ok(())
20872024-10-01T02:33:15.437ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
20882024-10-01T02:33:15.437ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
20892024-10-01T02:33:16.179ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
20902024-10-01T02:33:16.180ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
20912024-10-01T02:33:16.191ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
20922024-10-01T02:33:16.192ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
20932024-10-01T02:33:16.193ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
20942024-10-01T02:33:16.193ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
20952024-10-01T02:33:16.195ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
20962024-10-01T02:33:16.195ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
20972024-10-01T02:33:16.197ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
20982024-10-01T02:33:16.198ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, lookup_type: ById(21983b87-d6d0-47c6-a33c-5fe68fbed0c6) }, key: 8fbcb238-2807-4312-9499-49292447c1fc, lookup_type: ById(8fbcb238-2807-4312-9499-49292447c1fc) } result = Ok(())
20992024-10-01T02:33:16.199ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
21002024-10-01T02:33:16.199ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
21012024-10-01T02:33:16.201ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
21022024-10-01T02:33:16.202ZDEBGnexus (ExternalAuthn): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSessionList result = Ok(())
21032024-10-01T02:33:16.202ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
21042024-10-01T02:33:16.203ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
21052024-10-01T02:33:16.223ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 811605 local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:62739 req_id = 32fec0e3-d45a-4611-af24-accdb52b43bc response_code = 204 uri = /v1/login/recovery/local
21062024-10-01T02:33:16.267ZDEBGnexus (NexusCertResolver): resolved TLS certificate certificate = TlsCertificate { digest: "ca547a59343cd98ceb775f10ce9428d8003a71a149b5b7d33f10c1e7a9820bb1" } server_name = recovery.sys.oxide.test silo_id = 21983b87-d6d0-47c6-a33c-5fe68fbed0c6
21072024-10-01T02:33:16.277ZINFOnexus (dropshot_external): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = 172.30.2.7:443 remote_addr = 10.151.1.100:49233
21082024-10-01T02:33:16.278ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
21092024-10-01T02:33:16.278ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
21102024-10-01T02:33:16.279ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
21112024-10-01T02:33:16.280ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
21122024-10-01T02:33:16.281ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
21132024-10-01T02:33:16.283ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "b2603776c17391bc0ca280d341de87edae62e8df", lookup_type: ByCompositeId("token = \\"b2603776c17391bc0ca280d341de87edae62e8df\\"") } result = Ok(())
21142024-10-01T02:33:16.283ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
21152024-10-01T02:33:16.283ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
21162024-10-01T02:33:16.297ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
21172024-10-01T02:33:16.297ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
21182024-10-01T02:33:16.299ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
21192024-10-01T02:33:16.299ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
21202024-10-01T02:33:16.301ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
21212024-10-01T02:33:16.301ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
21222024-10-01T02:33:16.302ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
21232024-10-01T02:33:16.303ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, lookup_type: ById(21983b87-d6d0-47c6-a33c-5fe68fbed0c6) }, key: 8fbcb238-2807-4312-9499-49292447c1fc, lookup_type: ById(8fbcb238-2807-4312-9499-49292447c1fc) } result = Ok(())
21242024-10-01T02:33:16.303ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
21252024-10-01T02:33:16.303ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
21262024-10-01T02:33:16.305ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
21272024-10-01T02:33:16.306ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "b2603776c17391bc0ca280d341de87edae62e8df", lookup_type: ByCompositeId("b2603776c17391bc0ca280d341de87edae62e8df") } result = Ok(())
21282024-10-01T02:33:16.306ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
21292024-10-01T02:33:16.306ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
21302024-10-01T02:33:16.323ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
21312024-10-01T02:33:16.323ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
21322024-10-01T02:33:16.325ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
21332024-10-01T02:33:16.326ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
21342024-10-01T02:33:16.328ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
21352024-10-01T02:33:16.328ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
21362024-10-01T02:33:16.329ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
21372024-10-01T02:33:16.329ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
21382024-10-01T02:33:16.331ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
21392024-10-01T02:33:16.332ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, lookup_type: ById(21983b87-d6d0-47c6-a33c-5fe68fbed0c6) }, key: 8fbcb238-2807-4312-9499-49292447c1fc, lookup_type: ById(8fbcb238-2807-4312-9499-49292447c1fc) } result = Ok(())
21402024-10-01T02:33:16.332ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
21412024-10-01T02:33:16.332ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
21422024-10-01T02:33:16.334ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
21432024-10-01T02:33:16.334ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
21442024-10-01T02:33:16.335ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
21452024-10-01T02:33:16.335ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
21462024-10-01T02:33:16.337ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
21472024-10-01T02:33:16.338ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, lookup_type: ById(21983b87-d6d0-47c6-a33c-5fe68fbed0c6) } result = Ok(())
21482024-10-01T02:33:16.338ZDEBGnexus (dropshot_external): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49233 req_id = 14d19edd-6718-4eb7-83d1-c2c73c90ff63 roles = RoleSet { roles: {} } uri = /v1/projects
21492024-10-01T02:33:16.338ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49233 req_id = 14d19edd-6718-4eb7-83d1-c2c73c90ff63 resource = Database result = Ok(()) uri = /v1/projects
21502024-10-01T02:33:16.341ZDEBGnexus (dropshot_external): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49233 req_id = 14d19edd-6718-4eb7-83d1-c2c73c90ff63 roles = RoleSet { roles: {} } uri = /v1/projects
21512024-10-01T02:33:16.341ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49233 req_id = 14d19edd-6718-4eb7-83d1-c2c73c90ff63 resource = Database result = Ok(()) uri = /v1/projects
21522024-10-01T02:33:16.359ZDEBGnexus (dropshot_external): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49233 req_id = 14d19edd-6718-4eb7-83d1-c2c73c90ff63 roles = RoleSet { roles: {} } uri = /v1/projects
21532024-10-01T02:33:16.360ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49233 req_id = 14d19edd-6718-4eb7-83d1-c2c73c90ff63 resource = Database result = Ok(()) uri = /v1/projects
21542024-10-01T02:33:16.381ZDEBGnexus (dropshot_external): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49233 req_id = 14d19edd-6718-4eb7-83d1-c2c73c90ff63 roles = RoleSet { roles: {(Silo, 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, "admin")} } uri = /v1/projects
21552024-10-01T02:33:16.383ZDEBGnexus (dropshot_external): authorize result action = ListChildren actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49233 req_id = 14d19edd-6718-4eb7-83d1-c2c73c90ff63 resource = Silo { parent: Fleet, key: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, lookup_type: ById(21983b87-d6d0-47c6-a33c-5fe68fbed0c6) } result = Ok(()) uri = /v1/projects
21562024-10-01T02:33:16.383ZDEBGnexus (dropshot_external): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49233 req_id = 14d19edd-6718-4eb7-83d1-c2c73c90ff63 roles = RoleSet { roles: {} } uri = /v1/projects
21572024-10-01T02:33:16.383ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49233 req_id = 14d19edd-6718-4eb7-83d1-c2c73c90ff63 resource = Database result = Ok(()) uri = /v1/projects
21582024-10-01T02:33:16.385ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 108563 local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49233 req_id = 14d19edd-6718-4eb7-83d1-c2c73c90ff63 response_code = 200 uri = /v1/projects
21592024-10-01T02:33:16.401ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
21602024-10-01T02:33:16.402ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
21612024-10-01T02:33:16.403ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
21622024-10-01T02:33:16.404ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
21632024-10-01T02:33:16.405ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
21642024-10-01T02:33:16.406ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "b2603776c17391bc0ca280d341de87edae62e8df", lookup_type: ByCompositeId("token = \\"b2603776c17391bc0ca280d341de87edae62e8df\\"") } result = Ok(())
21652024-10-01T02:33:16.406ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
21662024-10-01T02:33:16.406ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
21672024-10-01T02:33:16.417ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
21682024-10-01T02:33:16.418ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
21692024-10-01T02:33:16.419ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
21702024-10-01T02:33:16.419ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
21712024-10-01T02:33:16.421ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
21722024-10-01T02:33:16.421ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
21732024-10-01T02:33:16.423ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
21742024-10-01T02:33:16.424ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, lookup_type: ById(21983b87-d6d0-47c6-a33c-5fe68fbed0c6) }, key: 8fbcb238-2807-4312-9499-49292447c1fc, lookup_type: ById(8fbcb238-2807-4312-9499-49292447c1fc) } result = Ok(())
21752024-10-01T02:33:16.424ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
21762024-10-01T02:33:16.424ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
21772024-10-01T02:33:16.425ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
21782024-10-01T02:33:16.427ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "b2603776c17391bc0ca280d341de87edae62e8df", lookup_type: ByCompositeId("b2603776c17391bc0ca280d341de87edae62e8df") } result = Ok(())
21792024-10-01T02:33:16.427ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
21802024-10-01T02:33:16.427ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
21812024-10-01T02:33:16.444ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
21822024-10-01T02:33:16.444ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
21832024-10-01T02:33:16.445ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
21842024-10-01T02:33:16.445ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
21852024-10-01T02:33:16.447ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
21862024-10-01T02:33:16.447ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
21872024-10-01T02:33:16.449ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
21882024-10-01T02:33:16.449ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
21892024-10-01T02:33:16.450ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
21902024-10-01T02:33:16.452ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, lookup_type: ById(21983b87-d6d0-47c6-a33c-5fe68fbed0c6) }, key: 8fbcb238-2807-4312-9499-49292447c1fc, lookup_type: ById(8fbcb238-2807-4312-9499-49292447c1fc) } result = Ok(())
21912024-10-01T02:33:16.452ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
21922024-10-01T02:33:16.452ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
21932024-10-01T02:33:16.454ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
21942024-10-01T02:33:16.454ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
21952024-10-01T02:33:16.455ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
21962024-10-01T02:33:16.456ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
21972024-10-01T02:33:16.457ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
21982024-10-01T02:33:16.458ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, lookup_type: ById(21983b87-d6d0-47c6-a33c-5fe68fbed0c6) } result = Ok(())
21992024-10-01T02:33:16.458ZDEBGnexus (dropshot_external): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:49233 req_id = 80b446b8-6a3c-477d-bdd3-f8c52426de51 roles = RoleSet { roles: {} } uri = /v1/system/ip-pools
22002024-10-01T02:33:16.458ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:49233 req_id = 80b446b8-6a3c-477d-bdd3-f8c52426de51 resource = Database result = Ok(()) uri = /v1/system/ip-pools
22012024-10-01T02:33:16.477ZDEBGnexus (dropshot_external): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:49233 req_id = 80b446b8-6a3c-477d-bdd3-f8c52426de51 roles = RoleSet { roles: {} } uri = /v1/system/ip-pools
22022024-10-01T02:33:16.477ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:49233 req_id = 80b446b8-6a3c-477d-bdd3-f8c52426de51 resource = Database result = Ok(()) uri = /v1/system/ip-pools
22032024-10-01T02:33:16.479ZDEBGnexus (dropshot_external): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:49233 req_id = 80b446b8-6a3c-477d-bdd3-f8c52426de51 roles = RoleSet { roles: {(Silo, 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, "admin")} } uri = /v1/system/ip-pools
22042024-10-01T02:33:16.481ZDEBGnexus (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:49233 req_id = 80b446b8-6a3c-477d-bdd3-f8c52426de51 resource = IpPoolList result = Ok(()) uri = /v1/system/ip-pools
22052024-10-01T02:33:16.481ZDEBGnexus (dropshot_external): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:49233 req_id = 80b446b8-6a3c-477d-bdd3-f8c52426de51 roles = RoleSet { roles: {} } uri = /v1/system/ip-pools
22062024-10-01T02:33:16.481ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:49233 req_id = 80b446b8-6a3c-477d-bdd3-f8c52426de51 resource = Database result = Ok(()) uri = /v1/system/ip-pools
22072024-10-01T02:33:16.498ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 97423 local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:49233 req_id = 80b446b8-6a3c-477d-bdd3-f8c52426de51 response_code = 201 uri = /v1/system/ip-pools
22082024-10-01T02:33:16.504ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
22092024-10-01T02:33:16.504ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
22102024-10-01T02:33:16.506ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
22112024-10-01T02:33:16.506ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
22122024-10-01T02:33:16.508ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
22132024-10-01T02:33:16.509ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "b2603776c17391bc0ca280d341de87edae62e8df", lookup_type: ByCompositeId("token = \\"b2603776c17391bc0ca280d341de87edae62e8df\\"") } result = Ok(())
22142024-10-01T02:33:16.509ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
22152024-10-01T02:33:16.509ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
22162024-10-01T02:33:16.511ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
22172024-10-01T02:33:16.511ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
22182024-10-01T02:33:16.512ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
22192024-10-01T02:33:16.512ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
22202024-10-01T02:33:16.514ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
22212024-10-01T02:33:16.514ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
22222024-10-01T02:33:16.515ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
22232024-10-01T02:33:16.517ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, lookup_type: ById(21983b87-d6d0-47c6-a33c-5fe68fbed0c6) }, key: 8fbcb238-2807-4312-9499-49292447c1fc, lookup_type: ById(8fbcb238-2807-4312-9499-49292447c1fc) } result = Ok(())
22242024-10-01T02:33:16.517ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
22252024-10-01T02:33:16.517ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
22262024-10-01T02:33:16.518ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
22272024-10-01T02:33:16.520ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "b2603776c17391bc0ca280d341de87edae62e8df", lookup_type: ByCompositeId("b2603776c17391bc0ca280d341de87edae62e8df") } result = Ok(())
22282024-10-01T02:33:16.520ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
22292024-10-01T02:33:16.520ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
22302024-10-01T02:33:16.528ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
22312024-10-01T02:33:16.528ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
22322024-10-01T02:33:16.529ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
22332024-10-01T02:33:16.529ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
22342024-10-01T02:33:16.531ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
22352024-10-01T02:33:16.531ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
22362024-10-01T02:33:16.532ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
22372024-10-01T02:33:16.532ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
22382024-10-01T02:33:16.534ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
22392024-10-01T02:33:16.535ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, lookup_type: ById(21983b87-d6d0-47c6-a33c-5fe68fbed0c6) }, key: 8fbcb238-2807-4312-9499-49292447c1fc, lookup_type: ById(8fbcb238-2807-4312-9499-49292447c1fc) } result = Ok(())
22402024-10-01T02:33:16.535ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
22412024-10-01T02:33:16.535ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
22422024-10-01T02:33:16.537ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
22432024-10-01T02:33:16.537ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
22442024-10-01T02:33:16.538ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
22452024-10-01T02:33:16.538ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
22462024-10-01T02:33:16.539ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
22472024-10-01T02:33:16.540ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, lookup_type: ById(21983b87-d6d0-47c6-a33c-5fe68fbed0c6) } result = Ok(())
22482024-10-01T02:33:16.540ZDEBGnexus (dropshot_external): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:49233 req_id = b02f75c4-2737-471c-a12f-fdcdbc32f992 roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/silos
22492024-10-01T02:33:16.541ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:49233 req_id = b02f75c4-2737-471c-a12f-fdcdbc32f992 resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/silos
22502024-10-01T02:33:16.560ZDEBGnexus (dropshot_external): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:49233 req_id = b02f75c4-2737-471c-a12f-fdcdbc32f992 roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/silos
22512024-10-01T02:33:16.560ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:49233 req_id = b02f75c4-2737-471c-a12f-fdcdbc32f992 resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/silos
22522024-10-01T02:33:16.570ZDEBGnexus (dropshot_external): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:49233 req_id = b02f75c4-2737-471c-a12f-fdcdbc32f992 roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/silos
22532024-10-01T02:33:16.571ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:49233 req_id = b02f75c4-2737-471c-a12f-fdcdbc32f992 resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/silos
22542024-10-01T02:33:16.573ZDEBGnexus (dropshot_external): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:49233 req_id = b02f75c4-2737-471c-a12f-fdcdbc32f992 roles = RoleSet { roles: {(Silo, 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, "admin")} } uri = /v1/system/ip-pools/default/silos
22552024-10-01T02:33:16.575ZDEBGnexus (dropshot_external): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:49233 req_id = b02f75c4-2737-471c-a12f-fdcdbc32f992 resource = IpPool { parent: Fleet, key: 3e03fcf2-c865-46d8-8f8c-82c502a21ef4, lookup_type: ByName("default") } result = Ok(()) uri = /v1/system/ip-pools/default/silos
22562024-10-01T02:33:16.575ZDEBGnexus (dropshot_external): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:49233 req_id = b02f75c4-2737-471c-a12f-fdcdbc32f992 roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/silos
22572024-10-01T02:33:16.575ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:49233 req_id = b02f75c4-2737-471c-a12f-fdcdbc32f992 resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/silos
22582024-10-01T02:33:16.577ZDEBGnexus (dropshot_external): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:49233 req_id = b02f75c4-2737-471c-a12f-fdcdbc32f992 roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/silos
22592024-10-01T02:33:16.577ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:49233 req_id = b02f75c4-2737-471c-a12f-fdcdbc32f992 resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/silos
22602024-10-01T02:33:16.580ZDEBGnexus (dropshot_external): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:49233 req_id = b02f75c4-2737-471c-a12f-fdcdbc32f992 roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/silos
22612024-10-01T02:33:16.580ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:49233 req_id = b02f75c4-2737-471c-a12f-fdcdbc32f992 resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/silos
22622024-10-01T02:33:16.582ZDEBGnexus (dropshot_external): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:49233 req_id = b02f75c4-2737-471c-a12f-fdcdbc32f992 roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/silos
22632024-10-01T02:33:16.583ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:49233 req_id = b02f75c4-2737-471c-a12f-fdcdbc32f992 resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/silos
22642024-10-01T02:33:16.585ZDEBGnexus (dropshot_external): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:49233 req_id = b02f75c4-2737-471c-a12f-fdcdbc32f992 roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/silos
22652024-10-01T02:33:16.585ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:49233 req_id = b02f75c4-2737-471c-a12f-fdcdbc32f992 resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/silos
22662024-10-01T02:33:16.588ZDEBGnexus (dropshot_external): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:49233 req_id = b02f75c4-2737-471c-a12f-fdcdbc32f992 roles = RoleSet { roles: {(Silo, 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, "admin")} } uri = /v1/system/ip-pools/default/silos
22672024-10-01T02:33:16.589ZDEBGnexus (dropshot_external): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:49233 req_id = b02f75c4-2737-471c-a12f-fdcdbc32f992 resource = Silo { parent: Fleet, key: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, lookup_type: ByName("recovery") } result = Ok(()) uri = /v1/system/ip-pools/default/silos
22682024-10-01T02:33:16.589ZDEBGnexus (dropshot_external): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:49233 req_id = b02f75c4-2737-471c-a12f-fdcdbc32f992 roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/silos
22692024-10-01T02:33:16.589ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:49233 req_id = b02f75c4-2737-471c-a12f-fdcdbc32f992 resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/silos
22702024-10-01T02:33:16.591ZDEBGnexus (dropshot_external): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:49233 req_id = b02f75c4-2737-471c-a12f-fdcdbc32f992 roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/silos
22712024-10-01T02:33:16.591ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:49233 req_id = b02f75c4-2737-471c-a12f-fdcdbc32f992 resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/silos
22722024-10-01T02:33:16.594ZDEBGnexus (dropshot_external): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:49233 req_id = b02f75c4-2737-471c-a12f-fdcdbc32f992 roles = RoleSet { roles: {(Silo, 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, "admin")} } uri = /v1/system/ip-pools/default/silos
22732024-10-01T02:33:16.596ZDEBGnexus (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:49233 req_id = b02f75c4-2737-471c-a12f-fdcdbc32f992 resource = IpPoolList result = Ok(()) uri = /v1/system/ip-pools/default/silos
22742024-10-01T02:33:16.596ZDEBGnexus (dropshot_external): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:49233 req_id = b02f75c4-2737-471c-a12f-fdcdbc32f992 roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/silos
22752024-10-01T02:33:16.596ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:49233 req_id = b02f75c4-2737-471c-a12f-fdcdbc32f992 resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/silos
22762024-10-01T02:33:16.659ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 154719 local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:49233 req_id = b02f75c4-2737-471c-a12f-fdcdbc32f992 response_code = 201 uri = /v1/system/ip-pools/default/silos
22772024-10-01T02:33:16.662ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
22782024-10-01T02:33:16.663ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
22792024-10-01T02:33:16.672ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
22802024-10-01T02:33:16.672ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
22812024-10-01T02:33:16.674ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
22822024-10-01T02:33:16.675ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "b2603776c17391bc0ca280d341de87edae62e8df", lookup_type: ByCompositeId("token = \\"b2603776c17391bc0ca280d341de87edae62e8df\\"") } result = Ok(())
22832024-10-01T02:33:16.675ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
22842024-10-01T02:33:16.675ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
22852024-10-01T02:33:16.676ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
22862024-10-01T02:33:16.677ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
22872024-10-01T02:33:16.678ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
22882024-10-01T02:33:16.678ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
22892024-10-01T02:33:16.680ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
22902024-10-01T02:33:16.680ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
22912024-10-01T02:33:16.681ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
22922024-10-01T02:33:16.683ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, lookup_type: ById(21983b87-d6d0-47c6-a33c-5fe68fbed0c6) }, key: 8fbcb238-2807-4312-9499-49292447c1fc, lookup_type: ById(8fbcb238-2807-4312-9499-49292447c1fc) } result = Ok(())
22932024-10-01T02:33:16.683ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
22942024-10-01T02:33:16.683ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
22952024-10-01T02:33:16.684ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
22962024-10-01T02:33:16.685ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "b2603776c17391bc0ca280d341de87edae62e8df", lookup_type: ByCompositeId("b2603776c17391bc0ca280d341de87edae62e8df") } result = Ok(())
22972024-10-01T02:33:16.685ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
22982024-10-01T02:33:16.686ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
22992024-10-01T02:33:16.693ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
23002024-10-01T02:33:16.693ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
23012024-10-01T02:33:16.694ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
23022024-10-01T02:33:16.695ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
23032024-10-01T02:33:16.696ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
23042024-10-01T02:33:16.696ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
23052024-10-01T02:33:16.698ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
23062024-10-01T02:33:16.698ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
23072024-10-01T02:33:16.699ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
23082024-10-01T02:33:16.700ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, lookup_type: ById(21983b87-d6d0-47c6-a33c-5fe68fbed0c6) }, key: 8fbcb238-2807-4312-9499-49292447c1fc, lookup_type: ById(8fbcb238-2807-4312-9499-49292447c1fc) } result = Ok(())
23092024-10-01T02:33:16.700ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
23102024-10-01T02:33:16.701ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
23112024-10-01T02:33:16.702ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
23122024-10-01T02:33:16.702ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
23132024-10-01T02:33:16.703ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
23142024-10-01T02:33:16.704ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
23152024-10-01T02:33:16.705ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
23162024-10-01T02:33:16.706ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, lookup_type: ById(21983b87-d6d0-47c6-a33c-5fe68fbed0c6) } result = Ok(())
23172024-10-01T02:33:16.706ZDEBGnexus (dropshot_external): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:49233 req_id = 8d7cc351-6acc-44a8-aca5-88548479d302 roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/ranges/add
23182024-10-01T02:33:16.706ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:49233 req_id = 8d7cc351-6acc-44a8-aca5-88548479d302 resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/ranges/add
23192024-10-01T02:33:16.708ZDEBGnexus (dropshot_external): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:49233 req_id = 8d7cc351-6acc-44a8-aca5-88548479d302 roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/ranges/add
23202024-10-01T02:33:16.708ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:49233 req_id = 8d7cc351-6acc-44a8-aca5-88548479d302 resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/ranges/add
23212024-10-01T02:33:16.710ZDEBGnexus (dropshot_external): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:49233 req_id = 8d7cc351-6acc-44a8-aca5-88548479d302 roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/ranges/add
23222024-10-01T02:33:16.710ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:49233 req_id = 8d7cc351-6acc-44a8-aca5-88548479d302 resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/ranges/add
23232024-10-01T02:33:16.712ZDEBGnexus (dropshot_external): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:49233 req_id = 8d7cc351-6acc-44a8-aca5-88548479d302 roles = RoleSet { roles: {(Silo, 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, "admin")} } uri = /v1/system/ip-pools/default/ranges/add
23242024-10-01T02:33:16.714ZDEBGnexus (dropshot_external): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:49233 req_id = 8d7cc351-6acc-44a8-aca5-88548479d302 resource = IpPool { parent: Fleet, key: 3e03fcf2-c865-46d8-8f8c-82c502a21ef4, lookup_type: ByName("default") } result = Ok(()) uri = /v1/system/ip-pools/default/ranges/add
23252024-10-01T02:33:16.714ZDEBGnexus (dropshot_external): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:49233 req_id = 8d7cc351-6acc-44a8-aca5-88548479d302 roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/ranges/add
23262024-10-01T02:33:16.715ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:49233 req_id = 8d7cc351-6acc-44a8-aca5-88548479d302 resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/ranges/add
23272024-10-01T02:33:16.716ZDEBGnexus (dropshot_external): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:49233 req_id = 8d7cc351-6acc-44a8-aca5-88548479d302 roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/ranges/add
23282024-10-01T02:33:16.716ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:49233 req_id = 8d7cc351-6acc-44a8-aca5-88548479d302 resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/ranges/add
23292024-10-01T02:33:16.717ZDEBGnexus (dropshot_external): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:49233 req_id = 8d7cc351-6acc-44a8-aca5-88548479d302 roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/ranges/add
23302024-10-01T02:33:16.717ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:49233 req_id = 8d7cc351-6acc-44a8-aca5-88548479d302 resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/ranges/add
23312024-10-01T02:33:16.720ZDEBGnexus (dropshot_external): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:49233 req_id = 8d7cc351-6acc-44a8-aca5-88548479d302 roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/ranges/add
23322024-10-01T02:33:16.720ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:49233 req_id = 8d7cc351-6acc-44a8-aca5-88548479d302 resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/ranges/add
23332024-10-01T02:33:16.722ZDEBGnexus (dropshot_external): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:49233 req_id = 8d7cc351-6acc-44a8-aca5-88548479d302 roles = RoleSet { roles: {(Silo, 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, "admin")} } uri = /v1/system/ip-pools/default/ranges/add
23342024-10-01T02:33:16.723ZDEBGnexus (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:49233 req_id = 8d7cc351-6acc-44a8-aca5-88548479d302 resource = IpPool { parent: Fleet, key: 3e03fcf2-c865-46d8-8f8c-82c502a21ef4, lookup_type: ByName("default") } result = Ok(()) uri = /v1/system/ip-pools/default/ranges/add
23352024-10-01T02:33:16.748ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 86617 local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:49233 req_id = 8d7cc351-6acc-44a8-aca5-88548479d302 response_code = 201 uri = /v1/system/ip-pools/default/ranges/add
23362024-10-01T02:33:16.752ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
23372024-10-01T02:33:16.753ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
23382024-10-01T02:33:16.754ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
23392024-10-01T02:33:16.754ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
23402024-10-01T02:33:16.755ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
23412024-10-01T02:33:16.757ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "b2603776c17391bc0ca280d341de87edae62e8df", lookup_type: ByCompositeId("token = \\"b2603776c17391bc0ca280d341de87edae62e8df\\"") } result = Ok(())
23422024-10-01T02:33:16.757ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
23432024-10-01T02:33:16.757ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
23442024-10-01T02:33:16.758ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
23452024-10-01T02:33:16.758ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
23462024-10-01T02:33:16.760ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
23472024-10-01T02:33:16.760ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
23482024-10-01T02:33:16.762ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
23492024-10-01T02:33:16.762ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
23502024-10-01T02:33:16.763ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
23512024-10-01T02:33:16.764ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, lookup_type: ById(21983b87-d6d0-47c6-a33c-5fe68fbed0c6) }, key: 8fbcb238-2807-4312-9499-49292447c1fc, lookup_type: ById(8fbcb238-2807-4312-9499-49292447c1fc) } result = Ok(())
23522024-10-01T02:33:16.764ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
23532024-10-01T02:33:16.764ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
23542024-10-01T02:33:16.766ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
23552024-10-01T02:33:16.767ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "b2603776c17391bc0ca280d341de87edae62e8df", lookup_type: ByCompositeId("b2603776c17391bc0ca280d341de87edae62e8df") } result = Ok(())
23562024-10-01T02:33:16.767ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
23572024-10-01T02:33:16.767ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
23582024-10-01T02:33:16.777ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
23592024-10-01T02:33:16.777ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
23602024-10-01T02:33:16.779ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
23612024-10-01T02:33:16.779ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
23622024-10-01T02:33:16.780ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
23632024-10-01T02:33:16.781ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
23642024-10-01T02:33:16.782ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
23652024-10-01T02:33:16.782ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
23662024-10-01T02:33:16.783ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
23672024-10-01T02:33:16.785ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, lookup_type: ById(21983b87-d6d0-47c6-a33c-5fe68fbed0c6) }, key: 8fbcb238-2807-4312-9499-49292447c1fc, lookup_type: ById(8fbcb238-2807-4312-9499-49292447c1fc) } result = Ok(())
23682024-10-01T02:33:16.785ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
23692024-10-01T02:33:16.785ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
23702024-10-01T02:33:16.787ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
23712024-10-01T02:33:16.787ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
23722024-10-01T02:33:16.788ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
23732024-10-01T02:33:16.788ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
23742024-10-01T02:33:16.790ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
23752024-10-01T02:33:16.791ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, lookup_type: ById(21983b87-d6d0-47c6-a33c-5fe68fbed0c6) } result = Ok(())
23762024-10-01T02:33:16.791ZDEBGnexus (dropshot_external): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = PUT remote_addr = 10.151.1.100:49233 req_id = 970c14a1-f803-42bb-8195-4126281f0b5d roles = RoleSet { roles: {} } uri = /v1/system/silos/recovery/quotas
23772024-10-01T02:33:16.791ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = PUT remote_addr = 10.151.1.100:49233 req_id = 970c14a1-f803-42bb-8195-4126281f0b5d resource = Database result = Ok(()) uri = /v1/system/silos/recovery/quotas
23782024-10-01T02:33:16.792ZDEBGnexus (dropshot_external): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = PUT remote_addr = 10.151.1.100:49233 req_id = 970c14a1-f803-42bb-8195-4126281f0b5d roles = RoleSet { roles: {} } uri = /v1/system/silos/recovery/quotas
23792024-10-01T02:33:16.792ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = PUT remote_addr = 10.151.1.100:49233 req_id = 970c14a1-f803-42bb-8195-4126281f0b5d resource = Database result = Ok(()) uri = /v1/system/silos/recovery/quotas
23802024-10-01T02:33:16.795ZDEBGnexus (dropshot_external): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = PUT remote_addr = 10.151.1.100:49233 req_id = 970c14a1-f803-42bb-8195-4126281f0b5d roles = RoleSet { roles: {} } uri = /v1/system/silos/recovery/quotas
23812024-10-01T02:33:16.795ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = PUT remote_addr = 10.151.1.100:49233 req_id = 970c14a1-f803-42bb-8195-4126281f0b5d resource = Database result = Ok(()) uri = /v1/system/silos/recovery/quotas
23822024-10-01T02:33:16.797ZDEBGnexus (dropshot_external): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = PUT remote_addr = 10.151.1.100:49233 req_id = 970c14a1-f803-42bb-8195-4126281f0b5d roles = RoleSet { roles: {} } uri = /v1/system/silos/recovery/quotas
23832024-10-01T02:33:16.797ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = PUT remote_addr = 10.151.1.100:49233 req_id = 970c14a1-f803-42bb-8195-4126281f0b5d resource = Database result = Ok(()) uri = /v1/system/silos/recovery/quotas
23842024-10-01T02:33:16.800ZDEBGnexus (dropshot_external): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = PUT remote_addr = 10.151.1.100:49233 req_id = 970c14a1-f803-42bb-8195-4126281f0b5d roles = RoleSet { roles: {(Silo, 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, "admin")} } uri = /v1/system/silos/recovery/quotas
23852024-10-01T02:33:16.801ZDEBGnexus (dropshot_external): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = PUT remote_addr = 10.151.1.100:49233 req_id = 970c14a1-f803-42bb-8195-4126281f0b5d resource = Silo { parent: Fleet, key: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, lookup_type: ByName("recovery") } result = Ok(()) uri = /v1/system/silos/recovery/quotas
23862024-10-01T02:33:16.801ZDEBGnexus (dropshot_external): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = PUT remote_addr = 10.151.1.100:49233 req_id = 970c14a1-f803-42bb-8195-4126281f0b5d roles = RoleSet { roles: {} } uri = /v1/system/silos/recovery/quotas
23872024-10-01T02:33:16.801ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = PUT remote_addr = 10.151.1.100:49233 req_id = 970c14a1-f803-42bb-8195-4126281f0b5d resource = Database result = Ok(()) uri = /v1/system/silos/recovery/quotas
23882024-10-01T02:33:16.804ZDEBGnexus (dropshot_external): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = PUT remote_addr = 10.151.1.100:49233 req_id = 970c14a1-f803-42bb-8195-4126281f0b5d roles = RoleSet { roles: {} } uri = /v1/system/silos/recovery/quotas
23892024-10-01T02:33:16.804ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = PUT remote_addr = 10.151.1.100:49233 req_id = 970c14a1-f803-42bb-8195-4126281f0b5d resource = Database result = Ok(()) uri = /v1/system/silos/recovery/quotas
23902024-10-01T02:33:16.805ZDEBGnexus (dropshot_external): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = PUT remote_addr = 10.151.1.100:49233 req_id = 970c14a1-f803-42bb-8195-4126281f0b5d roles = RoleSet { roles: {} } uri = /v1/system/silos/recovery/quotas
23912024-10-01T02:33:16.806ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = PUT remote_addr = 10.151.1.100:49233 req_id = 970c14a1-f803-42bb-8195-4126281f0b5d resource = Database result = Ok(()) uri = /v1/system/silos/recovery/quotas
23922024-10-01T02:33:16.808ZDEBGnexus (dropshot_external): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = PUT remote_addr = 10.151.1.100:49233 req_id = 970c14a1-f803-42bb-8195-4126281f0b5d roles = RoleSet { roles: {(Silo, 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, "admin")} } uri = /v1/system/silos/recovery/quotas
23932024-10-01T02:33:16.809ZDEBGnexus (dropshot_external): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = PUT remote_addr = 10.151.1.100:49233 req_id = 970c14a1-f803-42bb-8195-4126281f0b5d resource = Silo { parent: Fleet, key: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, lookup_type: ByName("recovery") } result = Ok(()) uri = /v1/system/silos/recovery/quotas
23942024-10-01T02:33:16.809ZDEBGnexus (dropshot_external): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = PUT remote_addr = 10.151.1.100:49233 req_id = 970c14a1-f803-42bb-8195-4126281f0b5d roles = RoleSet { roles: {} } uri = /v1/system/silos/recovery/quotas
23952024-10-01T02:33:16.809ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = PUT remote_addr = 10.151.1.100:49233 req_id = 970c14a1-f803-42bb-8195-4126281f0b5d resource = Database result = Ok(()) uri = /v1/system/silos/recovery/quotas
23962024-10-01T02:33:16.816ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 63362 local_addr = 172.30.2.7:443 method = PUT remote_addr = 10.151.1.100:49233 req_id = 970c14a1-f803-42bb-8195-4126281f0b5d response_code = 200 uri = /v1/system/silos/recovery/quotas
23972024-10-01T02:33:16.818ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
23982024-10-01T02:33:16.818ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
23992024-10-01T02:33:16.819ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
24002024-10-01T02:33:16.819ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24012024-10-01T02:33:16.821ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
24022024-10-01T02:33:16.822ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "b2603776c17391bc0ca280d341de87edae62e8df", lookup_type: ByCompositeId("token = \\"b2603776c17391bc0ca280d341de87edae62e8df\\"") } result = Ok(())
24032024-10-01T02:33:16.822ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
24042024-10-01T02:33:16.822ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24052024-10-01T02:33:16.823ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
24062024-10-01T02:33:16.823ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24072024-10-01T02:33:16.825ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
24082024-10-01T02:33:16.825ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24092024-10-01T02:33:16.826ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
24102024-10-01T02:33:16.826ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24112024-10-01T02:33:16.828ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
24122024-10-01T02:33:16.829ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, lookup_type: ById(21983b87-d6d0-47c6-a33c-5fe68fbed0c6) }, key: 8fbcb238-2807-4312-9499-49292447c1fc, lookup_type: ById(8fbcb238-2807-4312-9499-49292447c1fc) } result = Ok(())
24132024-10-01T02:33:16.829ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
24142024-10-01T02:33:16.829ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24152024-10-01T02:33:16.830ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
24162024-10-01T02:33:16.831ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "b2603776c17391bc0ca280d341de87edae62e8df", lookup_type: ByCompositeId("b2603776c17391bc0ca280d341de87edae62e8df") } result = Ok(())
24172024-10-01T02:33:16.831ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
24182024-10-01T02:33:16.832ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24192024-10-01T02:33:16.836ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
24202024-10-01T02:33:16.836ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24212024-10-01T02:33:16.837ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
24222024-10-01T02:33:16.838ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24232024-10-01T02:33:16.839ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
24242024-10-01T02:33:16.839ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24252024-10-01T02:33:16.840ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
24262024-10-01T02:33:16.841ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24272024-10-01T02:33:16.842ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
24282024-10-01T02:33:16.843ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, lookup_type: ById(21983b87-d6d0-47c6-a33c-5fe68fbed0c6) }, key: 8fbcb238-2807-4312-9499-49292447c1fc, lookup_type: ById(8fbcb238-2807-4312-9499-49292447c1fc) } result = Ok(())
24292024-10-01T02:33:16.843ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
24302024-10-01T02:33:16.843ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24312024-10-01T02:33:16.844ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
24322024-10-01T02:33:16.845ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24332024-10-01T02:33:16.846ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
24342024-10-01T02:33:16.846ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24352024-10-01T02:33:16.847ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
24362024-10-01T02:33:16.848ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, lookup_type: ById(21983b87-d6d0-47c6-a33c-5fe68fbed0c6) } result = Ok(())
24372024-10-01T02:33:16.848ZDEBGnexus (dropshot_external): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:49233 req_id = fac2eeac-b884-4a0d-8bc8-d1c656c09a4f roles = RoleSet { roles: {} } uri = /v1/projects
24382024-10-01T02:33:16.849ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:49233 req_id = fac2eeac-b884-4a0d-8bc8-d1c656c09a4f resource = Database result = Ok(()) uri = /v1/projects
24392024-10-01T02:33:16.851ZDEBGnexus (dropshot_external): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:49233 req_id = fac2eeac-b884-4a0d-8bc8-d1c656c09a4f roles = RoleSet { roles: {} } uri = /v1/projects
24402024-10-01T02:33:16.852ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:49233 req_id = fac2eeac-b884-4a0d-8bc8-d1c656c09a4f resource = Database result = Ok(()) uri = /v1/projects
24412024-10-01T02:33:16.854ZDEBGnexus (dropshot_external): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:49233 req_id = fac2eeac-b884-4a0d-8bc8-d1c656c09a4f roles = RoleSet { roles: {} } uri = /v1/projects
24422024-10-01T02:33:16.854ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:49233 req_id = fac2eeac-b884-4a0d-8bc8-d1c656c09a4f resource = Database result = Ok(()) uri = /v1/projects
24432024-10-01T02:33:16.856ZDEBGnexus (dropshot_external): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:49233 req_id = fac2eeac-b884-4a0d-8bc8-d1c656c09a4f roles = RoleSet { roles: {(Silo, 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, "admin")} } uri = /v1/projects
24442024-10-01T02:33:16.857ZDEBGnexus (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:49233 req_id = fac2eeac-b884-4a0d-8bc8-d1c656c09a4f resource = Silo { parent: Fleet, key: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, lookup_type: ById(21983b87-d6d0-47c6-a33c-5fe68fbed0c6) } result = Ok(()) uri = /v1/projects
24452024-10-01T02:33:16.858ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = 988c83d6-6c22-4e63-9439-7462ce949335 saga_name = project-create
24462024-10-01T02:33:16.858ZINFOnexus (SEC): saga create dag = {"end_node":17,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[3,4,null],[4,5,null],[5,6,null],[6,7,null],[7,8,null],[8,9,null],[9,10,null],[10,11,null],[11,12,null],[12,13,null],[13,14,null],[2,3,null],[14,15,null],[16,0,null],[15,17,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"project_create.project_create_record","label":"ProjectCreateRecord","name":"project"}},{"Action":{"action_name":"project_create.project_create_vpc_params","label":"ProjectCreateVpcParams","name":"vpc_create_params"}},{"SubsagaStart":{"params_node_name":"vpc_create_params","saga_name":"vpc-create"}},{"Action":{"action_name":"common.uuid_generate","label":"GenerateVpcId","name":"vpc_id"}},{"Action":{"action_name":"common.uuid_generate","label":"GenerateSystemRouterId","name":"system_router_id"}},{"Action":{"action_name":"common.uuid_generate","label":"GenerateDefaultV4RouteId","name":"default_v4_route_id"}},{"Action":{"action_name":"common.uuid_generate","label":"GenerateDefaultV6RouteId","name":"default_v6_route_id"}},{"Action":{"action_name":"common.uuid_generate","label":"GenerateDefaultSubnetId","name":"default_subnet_id"}},{"Action":{"action_name":"vpc_create.vpc_create_vpc","label":"VpcCreateVpc","name":"vpc"}},{"Action":{"action_name":"vpc_create.vpc_create_router","label":"VpcCreateRouter","name":"router"}},{"Action":{"action_name":"vpc_create.vpc_create_v4_route","label":"VpcCreateV4Route","name":"route4"}},{"Action":{"action_name":"vpc_create.vpc_create_v6_route","label":"VpcCreateV6Route","name":"route6"}},{"Action":{"action_name":"vpc_create.vpc_create_subnet","label":"VpcCreateSubnet","name":"subnet"}},{"Action":{"action_name":"vpc_create.vpc_update_firewall","label":"VpcUpdateFirewall","name":"firewall"}},{"Action":{"action_name":"vpc_create.vpc_notify_sleds","label":"VpcNotifySleds","name":"no_result"}},{"SubsagaEnd":{"name":"vpc"}},{"Start":{"params":{"authz_silo":{"key":"21983b87-d6d0-47c6-a33c-5fe68fbed0c6","lookup_type":{"ById":"21983b87-d6d0-47c6-a33c-5fe68fbed0c6"},"parent":null},"project_create":{"description":"","name":"proj-815f1091374"},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"SiloUser":{"silo_id":"21983b87-d6d0-47c6-a33c-5fe68fbed0c6","silo_user_id":"8fbcb238-2807-4312-9499-49292447c1fc"}}},{"mapped_fleet_roles":{"admin":["admin"]}}]}}}}},"End"]},"saga_name":"project-create","start_node":16} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = 988c83d6-6c22-4e63-9439-7462ce949335 saga_name = project-create sec_id = 3dfd7033-71d8-4eb9-bb97-49dae3b5cd35
24472024-10-01T02:33:16.858ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = 988c83d6-6c22-4e63-9439-7462ce949335 saga_name = project-create
24482024-10-01T02:33:16.911ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = 988c83d6-6c22-4e63-9439-7462ce949335 saga_name = project-create
24492024-10-01T02:33:16.911ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = 988c83d6-6c22-4e63-9439-7462ce949335 saga_name = project-create sec_id = 3dfd7033-71d8-4eb9-bb97-49dae3b5cd35
24502024-10-01T02:33:16.911ZDEBGnexus (SEC): saga log event new_state = N016 started sec_id = 3dfd7033-71d8-4eb9-bb97-49dae3b5cd35
24512024-10-01T02:33:16.911ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 16 saga_id = 988c83d6-6c22-4e63-9439-7462ce949335
24522024-10-01T02:33:16.935ZDEBGnexus (SEC): saga log event new_state = N016 succeeded sec_id = 3dfd7033-71d8-4eb9-bb97-49dae3b5cd35
24532024-10-01T02:33:16.935ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 16 saga_id = 988c83d6-6c22-4e63-9439-7462ce949335
24542024-10-01T02:33:16.948ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 3dfd7033-71d8-4eb9-bb97-49dae3b5cd35
24552024-10-01T02:33:16.948ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = 988c83d6-6c22-4e63-9439-7462ce949335
24562024-10-01T02:33:16.970ZDEBGnexus (SagaExecutor): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true roles = RoleSet { roles: {} } saga_id = 988c83d6-6c22-4e63-9439-7462ce949335 saga_name = project-create saga_node = ProjectCreateRecord
24572024-10-01T02:33:16.970ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true resource = Database result = Ok(()) saga_id = 988c83d6-6c22-4e63-9439-7462ce949335 saga_name = project-create saga_node = ProjectCreateRecord
24582024-10-01T02:33:16.972ZDEBGnexus (SagaExecutor): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true roles = RoleSet { roles: {} } saga_id = 988c83d6-6c22-4e63-9439-7462ce949335 saga_name = project-create saga_node = ProjectCreateRecord
24592024-10-01T02:33:16.972ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true resource = Database result = Ok(()) saga_id = 988c83d6-6c22-4e63-9439-7462ce949335 saga_name = project-create saga_node = ProjectCreateRecord
24602024-10-01T02:33:16.975ZDEBGnexus (SagaExecutor): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true roles = RoleSet { roles: {} } saga_id = 988c83d6-6c22-4e63-9439-7462ce949335 saga_name = project-create saga_node = ProjectCreateRecord
24612024-10-01T02:33:16.975ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true resource = Database result = Ok(()) saga_id = 988c83d6-6c22-4e63-9439-7462ce949335 saga_name = project-create saga_node = ProjectCreateRecord
24622024-10-01T02:33:16.977ZDEBGnexus (SagaExecutor): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true roles = RoleSet { roles: {(Silo, 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, "admin")} } saga_id = 988c83d6-6c22-4e63-9439-7462ce949335 saga_name = project-create saga_node = ProjectCreateRecord
24632024-10-01T02:33:16.979ZDEBGnexus (SagaExecutor): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true resource = Silo { parent: Fleet, key: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, lookup_type: ById(21983b87-d6d0-47c6-a33c-5fe68fbed0c6) } result = Ok(()) saga_id = 988c83d6-6c22-4e63-9439-7462ce949335 saga_name = project-create saga_node = ProjectCreateRecord
24642024-10-01T02:33:16.979ZDEBGnexus (SagaExecutor): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true roles = RoleSet { roles: {} } saga_id = 988c83d6-6c22-4e63-9439-7462ce949335 saga_name = project-create saga_node = ProjectCreateRecord
24652024-10-01T02:33:16.979ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true resource = Database result = Ok(()) saga_id = 988c83d6-6c22-4e63-9439-7462ce949335 saga_name = project-create saga_node = ProjectCreateRecord
24662024-10-01T02:33:16.996ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 3dfd7033-71d8-4eb9-bb97-49dae3b5cd35
24672024-10-01T02:33:16.996ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Array [Object {"key": String("d6cd5e95-82db-413f-aa24-4fc56edfc65a"), "lookup_type": Object {"ByName": String("proj-815f1091374")}, "parent": Object {"key": String("21983b87-d6d0-47c6-a33c-5fe68fbed0c6"), "lookup_type": Object {"ById": String("21983b87-d6d0-47c6-a33c-5fe68fbed0c6")}, "parent": Null}}, Object {"identity": Object {"description": String(""), "id": String("d6cd5e95-82db-413f-aa24-4fc56edfc65a"), "name": String("proj-815f1091374"), "time_created": String("2024-10-01T02:33:16.969991Z"), "time_deleted": Null, "time_modified": String("2024-10-01T02:33:16.969991Z")}, "rcgen": Number(1), "silo_id": String("21983b87-d6d0-47c6-a33c-5fe68fbed0c6")}]) node_id = 0 saga_id = 988c83d6-6c22-4e63-9439-7462ce949335
24682024-10-01T02:33:17.003ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 3dfd7033-71d8-4eb9-bb97-49dae3b5cd35
24692024-10-01T02:33:17.003ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = 988c83d6-6c22-4e63-9439-7462ce949335
24702024-10-01T02:33:17.032ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 3dfd7033-71d8-4eb9-bb97-49dae3b5cd35
24712024-10-01T02:33:17.032ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"authz_project": Object {"key": String("d6cd5e95-82db-413f-aa24-4fc56edfc65a"), "lookup_type": Object {"ByName": String("proj-815f1091374")}, "parent": Object {"key": String("21983b87-d6d0-47c6-a33c-5fe68fbed0c6"), "lookup_type": Object {"ById": String("21983b87-d6d0-47c6-a33c-5fe68fbed0c6")}, "parent": Null}}, "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"SiloUser": Object {"silo_id": String("21983b87-d6d0-47c6-a33c-5fe68fbed0c6"), "silo_user_id": String("8fbcb238-2807-4312-9499-49292447c1fc")}}}, Object {"mapped_fleet_roles": Object {"admin": Array [String("admin")]}}]}}, "vpc_create": Object {"description": String("Default VPC"), "dns_name": String("default"), "ipv6_prefix": String("fd4c:3e4e:4d9c::/48"), "name": String("default")}}) node_id = 1 saga_id = 988c83d6-6c22-4e63-9439-7462ce949335
24722024-10-01T02:33:17.045ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 3dfd7033-71d8-4eb9-bb97-49dae3b5cd35
24732024-10-01T02:33:17.045ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = 988c83d6-6c22-4e63-9439-7462ce949335
24742024-10-01T02:33:17.049ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 3dfd7033-71d8-4eb9-bb97-49dae3b5cd35
24752024-10-01T02:33:17.049ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 2 saga_id = 988c83d6-6c22-4e63-9439-7462ce949335
24762024-10-01T02:33:17.054ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 3dfd7033-71d8-4eb9-bb97-49dae3b5cd35
24772024-10-01T02:33:17.054ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = 988c83d6-6c22-4e63-9439-7462ce949335
24782024-10-01T02:33:17.061ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 3dfd7033-71d8-4eb9-bb97-49dae3b5cd35
24792024-10-01T02:33:17.061ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("d0c53fd8-2027-48ed-90fd-8a4e218435fa")) node_id = 3 saga_id = 988c83d6-6c22-4e63-9439-7462ce949335
24802024-10-01T02:33:17.066ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 3dfd7033-71d8-4eb9-bb97-49dae3b5cd35
24812024-10-01T02:33:17.066ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = 988c83d6-6c22-4e63-9439-7462ce949335
24822024-10-01T02:33:17.077ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 3dfd7033-71d8-4eb9-bb97-49dae3b5cd35
24832024-10-01T02:33:17.077ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("3ee099b5-5648-4743-8f10-a56b8719e19d")) node_id = 4 saga_id = 988c83d6-6c22-4e63-9439-7462ce949335
24842024-10-01T02:33:17.083ZDEBGnexus (SEC): saga log event new_state = N005 started sec_id = 3dfd7033-71d8-4eb9-bb97-49dae3b5cd35
24852024-10-01T02:33:17.083ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 5 saga_id = 988c83d6-6c22-4e63-9439-7462ce949335
24862024-10-01T02:33:17.090ZDEBGnexus (SEC): saga log event new_state = N005 succeeded sec_id = 3dfd7033-71d8-4eb9-bb97-49dae3b5cd35
24872024-10-01T02:33:17.090ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("cfaa265f-8161-43fc-b160-95cd423a72bf")) node_id = 5 saga_id = 988c83d6-6c22-4e63-9439-7462ce949335
24882024-10-01T02:33:17.100ZDEBGnexus (SEC): saga log event new_state = N006 started sec_id = 3dfd7033-71d8-4eb9-bb97-49dae3b5cd35
24892024-10-01T02:33:17.100ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 6 saga_id = 988c83d6-6c22-4e63-9439-7462ce949335
24902024-10-01T02:33:17.108ZDEBGnexus (SEC): saga log event new_state = N006 succeeded sec_id = 3dfd7033-71d8-4eb9-bb97-49dae3b5cd35
24912024-10-01T02:33:17.108ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("fc7e43a6-e247-4f12-ae73-ed01dfaa49e0")) node_id = 6 saga_id = 988c83d6-6c22-4e63-9439-7462ce949335
24922024-10-01T02:33:17.124ZDEBGnexus (SEC): saga log event new_state = N007 started sec_id = 3dfd7033-71d8-4eb9-bb97-49dae3b5cd35
24932024-10-01T02:33:17.124ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 7 saga_id = 988c83d6-6c22-4e63-9439-7462ce949335
24942024-10-01T02:33:17.131ZDEBGnexus (SEC): saga log event new_state = N007 succeeded sec_id = 3dfd7033-71d8-4eb9-bb97-49dae3b5cd35
24952024-10-01T02:33:17.131ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("050ff4b6-0012-4a9f-a32d-f71a94895be6")) node_id = 7 saga_id = 988c83d6-6c22-4e63-9439-7462ce949335
24962024-10-01T02:33:17.141ZDEBGnexus (SEC): saga log event new_state = N008 started sec_id = 3dfd7033-71d8-4eb9-bb97-49dae3b5cd35
24972024-10-01T02:33:17.141ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 8 saga_id = 988c83d6-6c22-4e63-9439-7462ce949335
24982024-10-01T02:33:17.149ZDEBGnexus (SagaExecutor): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true roles = RoleSet { roles: {} } saga_id = 988c83d6-6c22-4e63-9439-7462ce949335 saga_name = project-create saga_node = VpcCreateVpc
24992024-10-01T02:33:17.149ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true resource = Database result = Ok(()) saga_id = 988c83d6-6c22-4e63-9439-7462ce949335 saga_name = project-create saga_node = VpcCreateVpc
25002024-10-01T02:33:17.151ZDEBGnexus (SagaExecutor): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true roles = RoleSet { roles: {} } saga_id = 988c83d6-6c22-4e63-9439-7462ce949335 saga_name = project-create saga_node = VpcCreateVpc
25012024-10-01T02:33:17.151ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true resource = Database result = Ok(()) saga_id = 988c83d6-6c22-4e63-9439-7462ce949335 saga_name = project-create saga_node = VpcCreateVpc
25022024-10-01T02:33:17.154ZDEBGnexus (SagaExecutor): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true roles = RoleSet { roles: {} } saga_id = 988c83d6-6c22-4e63-9439-7462ce949335 saga_name = project-create saga_node = VpcCreateVpc
25032024-10-01T02:33:17.154ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true resource = Database result = Ok(()) saga_id = 988c83d6-6c22-4e63-9439-7462ce949335 saga_name = project-create saga_node = VpcCreateVpc
25042024-10-01T02:33:17.157ZDEBGnexus (SagaExecutor): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true roles = RoleSet { roles: {} } saga_id = 988c83d6-6c22-4e63-9439-7462ce949335 saga_name = project-create saga_node = VpcCreateVpc
25052024-10-01T02:33:17.157ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true resource = Database result = Ok(()) saga_id = 988c83d6-6c22-4e63-9439-7462ce949335 saga_name = project-create saga_node = VpcCreateVpc
25062024-10-01T02:33:17.159ZDEBGnexus (SagaExecutor): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true roles = RoleSet { roles: {(Silo, 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, "admin")} } saga_id = 988c83d6-6c22-4e63-9439-7462ce949335 saga_name = project-create saga_node = VpcCreateVpc
25072024-10-01T02:33:17.162ZDEBGnexus (SagaExecutor): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true resource = Project { parent: Silo { parent: Fleet, key: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, lookup_type: ById(21983b87-d6d0-47c6-a33c-5fe68fbed0c6) }, key: d6cd5e95-82db-413f-aa24-4fc56edfc65a, lookup_type: ByName("proj-815f1091374") } result = Ok(()) saga_id = 988c83d6-6c22-4e63-9439-7462ce949335 saga_name = project-create saga_node = VpcCreateVpc
25082024-10-01T02:33:17.162ZDEBGnexus (SagaExecutor): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true roles = RoleSet { roles: {} } saga_id = 988c83d6-6c22-4e63-9439-7462ce949335 saga_name = project-create saga_node = VpcCreateVpc
25092024-10-01T02:33:17.162ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true resource = Database result = Ok(()) saga_id = 988c83d6-6c22-4e63-9439-7462ce949335 saga_name = project-create saga_node = VpcCreateVpc
25102024-10-01T02:33:17.185ZDEBGnexus (SEC): saga log event new_state = N008 succeeded sec_id = 3dfd7033-71d8-4eb9-bb97-49dae3b5cd35
25112024-10-01T02:33:17.185ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Array [Object {"key": String("d0c53fd8-2027-48ed-90fd-8a4e218435fa"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("d6cd5e95-82db-413f-aa24-4fc56edfc65a"), "lookup_type": Object {"ByName": String("proj-815f1091374")}, "parent": Object {"key": String("21983b87-d6d0-47c6-a33c-5fe68fbed0c6"), "lookup_type": Object {"ById": String("21983b87-d6d0-47c6-a33c-5fe68fbed0c6")}, "parent": Null}}}, Object {"dns_name": String("default"), "firewall_gen": Number(1), "identity": Object {"description": String("Default VPC"), "id": String("d0c53fd8-2027-48ed-90fd-8a4e218435fa"), "name": String("default"), "time_created": String("2024-10-01T02:33:17.149475Z"), "time_deleted": Null, "time_modified": String("2024-10-01T02:33:17.149475Z")}, "ipv6_prefix": String("fd4c:3e4e:4d9c::/48"), "project_id": String("d6cd5e95-82db-413f-aa24-4fc56edfc65a"), "subnet_gen": Number(1), "system_router_id": String("3ee099b5-5648-4743-8f10-a56b8719e19d"), "vni": Number(16045052)}]) node_id = 8 saga_id = 988c83d6-6c22-4e63-9439-7462ce949335
25122024-10-01T02:33:17.190ZDEBGnexus (SEC): saga log event new_state = N009 started sec_id = 3dfd7033-71d8-4eb9-bb97-49dae3b5cd35
25132024-10-01T02:33:17.190ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 9 saga_id = 988c83d6-6c22-4e63-9439-7462ce949335
25142024-10-01T02:33:17.196ZDEBGnexus (SagaExecutor): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true roles = RoleSet { roles: {} } saga_id = 988c83d6-6c22-4e63-9439-7462ce949335 saga_name = project-create saga_node = VpcCreateRouter
25152024-10-01T02:33:17.196ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true resource = Database result = Ok(()) saga_id = 988c83d6-6c22-4e63-9439-7462ce949335 saga_name = project-create saga_node = VpcCreateRouter
25162024-10-01T02:33:17.199ZDEBGnexus (SagaExecutor): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true roles = RoleSet { roles: {} } saga_id = 988c83d6-6c22-4e63-9439-7462ce949335 saga_name = project-create saga_node = VpcCreateRouter
25172024-10-01T02:33:17.199ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true resource = Database result = Ok(()) saga_id = 988c83d6-6c22-4e63-9439-7462ce949335 saga_name = project-create saga_node = VpcCreateRouter
25182024-10-01T02:33:17.201ZDEBGnexus (SagaExecutor): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true roles = RoleSet { roles: {} } saga_id = 988c83d6-6c22-4e63-9439-7462ce949335 saga_name = project-create saga_node = VpcCreateRouter
25192024-10-01T02:33:17.202ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true resource = Database result = Ok(()) saga_id = 988c83d6-6c22-4e63-9439-7462ce949335 saga_name = project-create saga_node = VpcCreateRouter
25202024-10-01T02:33:17.204ZDEBGnexus (SagaExecutor): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true roles = RoleSet { roles: {} } saga_id = 988c83d6-6c22-4e63-9439-7462ce949335 saga_name = project-create saga_node = VpcCreateRouter
25212024-10-01T02:33:17.204ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true resource = Database result = Ok(()) saga_id = 988c83d6-6c22-4e63-9439-7462ce949335 saga_name = project-create saga_node = VpcCreateRouter
25222024-10-01T02:33:17.206ZDEBGnexus (SagaExecutor): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true roles = RoleSet { roles: {(Silo, 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, "admin")} } saga_id = 988c83d6-6c22-4e63-9439-7462ce949335 saga_name = project-create saga_node = VpcCreateRouter
25232024-10-01T02:33:17.209ZDEBGnexus (SagaExecutor): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, lookup_type: ById(21983b87-d6d0-47c6-a33c-5fe68fbed0c6) }, key: d6cd5e95-82db-413f-aa24-4fc56edfc65a, lookup_type: ByName("proj-815f1091374") }, key: d0c53fd8-2027-48ed-90fd-8a4e218435fa, lookup_type: ByName("default") } result = Ok(()) saga_id = 988c83d6-6c22-4e63-9439-7462ce949335 saga_name = project-create saga_node = VpcCreateRouter
25242024-10-01T02:33:17.209ZDEBGnexus (SagaExecutor): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true roles = RoleSet { roles: {} } saga_id = 988c83d6-6c22-4e63-9439-7462ce949335 saga_name = project-create saga_node = VpcCreateRouter
25252024-10-01T02:33:17.209ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true resource = Database result = Ok(()) saga_id = 988c83d6-6c22-4e63-9439-7462ce949335 saga_name = project-create saga_node = VpcCreateRouter
25262024-10-01T02:33:17.255ZDEBGnexus (SEC): saga log event new_state = N009 succeeded sec_id = 3dfd7033-71d8-4eb9-bb97-49dae3b5cd35
25272024-10-01T02:33:17.255ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"key": String("3ee099b5-5648-4743-8f10-a56b8719e19d"), "lookup_type": Object {"ById": String("3ee099b5-5648-4743-8f10-a56b8719e19d")}, "parent": Object {"key": String("d0c53fd8-2027-48ed-90fd-8a4e218435fa"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("d6cd5e95-82db-413f-aa24-4fc56edfc65a"), "lookup_type": Object {"ByName": String("proj-815f1091374")}, "parent": Object {"key": String("21983b87-d6d0-47c6-a33c-5fe68fbed0c6"), "lookup_type": Object {"ById": String("21983b87-d6d0-47c6-a33c-5fe68fbed0c6")}, "parent": Null}}}}) node_id = 9 saga_id = 988c83d6-6c22-4e63-9439-7462ce949335
25282024-10-01T02:33:17.264ZDEBGnexus (SEC): saga log event new_state = N010 started sec_id = 3dfd7033-71d8-4eb9-bb97-49dae3b5cd35
25292024-10-01T02:33:17.264ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 10 saga_id = 988c83d6-6c22-4e63-9439-7462ce949335
25302024-10-01T02:33:17.270ZDEBGnexus (SagaExecutor): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true roles = RoleSet { roles: {} } saga_id = 988c83d6-6c22-4e63-9439-7462ce949335 saga_name = project-create saga_node = VpcCreateV4Route
25312024-10-01T02:33:17.271ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true resource = Database result = Ok(()) saga_id = 988c83d6-6c22-4e63-9439-7462ce949335 saga_name = project-create saga_node = VpcCreateV4Route
25322024-10-01T02:33:17.273ZDEBGnexus (SagaExecutor): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true roles = RoleSet { roles: {} } saga_id = 988c83d6-6c22-4e63-9439-7462ce949335 saga_name = project-create saga_node = VpcCreateV4Route
25332024-10-01T02:33:17.273ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true resource = Database result = Ok(()) saga_id = 988c83d6-6c22-4e63-9439-7462ce949335 saga_name = project-create saga_node = VpcCreateV4Route
25342024-10-01T02:33:17.276ZDEBGnexus (SagaExecutor): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true roles = RoleSet { roles: {} } saga_id = 988c83d6-6c22-4e63-9439-7462ce949335 saga_name = project-create saga_node = VpcCreateV4Route
25352024-10-01T02:33:17.276ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true resource = Database result = Ok(()) saga_id = 988c83d6-6c22-4e63-9439-7462ce949335 saga_name = project-create saga_node = VpcCreateV4Route
25362024-10-01T02:33:17.279ZDEBGnexus (SagaExecutor): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true roles = RoleSet { roles: {} } saga_id = 988c83d6-6c22-4e63-9439-7462ce949335 saga_name = project-create saga_node = VpcCreateV4Route
25372024-10-01T02:33:17.279ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true resource = Database result = Ok(()) saga_id = 988c83d6-6c22-4e63-9439-7462ce949335 saga_name = project-create saga_node = VpcCreateV4Route
25382024-10-01T02:33:17.281ZDEBGnexus (SagaExecutor): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true roles = RoleSet { roles: {(Silo, 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, "admin")} } saga_id = 988c83d6-6c22-4e63-9439-7462ce949335 saga_name = project-create saga_node = VpcCreateV4Route
25392024-10-01T02:33:17.284ZDEBGnexus (SagaExecutor): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, lookup_type: ById(21983b87-d6d0-47c6-a33c-5fe68fbed0c6) }, key: d6cd5e95-82db-413f-aa24-4fc56edfc65a, lookup_type: ByName("proj-815f1091374") }, key: d0c53fd8-2027-48ed-90fd-8a4e218435fa, lookup_type: ByName("default") }, key: 3ee099b5-5648-4743-8f10-a56b8719e19d, lookup_type: ById(3ee099b5-5648-4743-8f10-a56b8719e19d) } result = Ok(()) saga_id = 988c83d6-6c22-4e63-9439-7462ce949335 saga_name = project-create saga_node = VpcCreateV4Route
25402024-10-01T02:33:17.284ZDEBGnexus (SagaExecutor): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true roles = RoleSet { roles: {} } saga_id = 988c83d6-6c22-4e63-9439-7462ce949335 saga_name = project-create saga_node = VpcCreateV4Route
25412024-10-01T02:33:17.284ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true resource = Database result = Ok(()) saga_id = 988c83d6-6c22-4e63-9439-7462ce949335 saga_name = project-create saga_node = VpcCreateV4Route
25422024-10-01T02:33:17.339ZDEBGnexus (SEC): saga log event new_state = N010 succeeded sec_id = 3dfd7033-71d8-4eb9-bb97-49dae3b5cd35
25432024-10-01T02:33:17.339ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 10 saga_id = 988c83d6-6c22-4e63-9439-7462ce949335
25442024-10-01T02:33:17.344ZDEBGnexus (SEC): saga log event new_state = N011 started sec_id = 3dfd7033-71d8-4eb9-bb97-49dae3b5cd35
25452024-10-01T02:33:17.344ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 11 saga_id = 988c83d6-6c22-4e63-9439-7462ce949335
25462024-10-01T02:33:17.348ZDEBGnexus (SagaExecutor): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true roles = RoleSet { roles: {} } saga_id = 988c83d6-6c22-4e63-9439-7462ce949335 saga_name = project-create saga_node = VpcCreateV6Route
25472024-10-01T02:33:17.348ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true resource = Database result = Ok(()) saga_id = 988c83d6-6c22-4e63-9439-7462ce949335 saga_name = project-create saga_node = VpcCreateV6Route
25482024-10-01T02:33:17.351ZDEBGnexus (SagaExecutor): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true roles = RoleSet { roles: {} } saga_id = 988c83d6-6c22-4e63-9439-7462ce949335 saga_name = project-create saga_node = VpcCreateV6Route
25492024-10-01T02:33:17.351ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true resource = Database result = Ok(()) saga_id = 988c83d6-6c22-4e63-9439-7462ce949335 saga_name = project-create saga_node = VpcCreateV6Route
25502024-10-01T02:33:17.354ZDEBGnexus (SagaExecutor): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true roles = RoleSet { roles: {} } saga_id = 988c83d6-6c22-4e63-9439-7462ce949335 saga_name = project-create saga_node = VpcCreateV6Route
25512024-10-01T02:33:17.354ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true resource = Database result = Ok(()) saga_id = 988c83d6-6c22-4e63-9439-7462ce949335 saga_name = project-create saga_node = VpcCreateV6Route
25522024-10-01T02:33:17.357ZDEBGnexus (SagaExecutor): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true roles = RoleSet { roles: {} } saga_id = 988c83d6-6c22-4e63-9439-7462ce949335 saga_name = project-create saga_node = VpcCreateV6Route
25532024-10-01T02:33:17.357ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true resource = Database result = Ok(()) saga_id = 988c83d6-6c22-4e63-9439-7462ce949335 saga_name = project-create saga_node = VpcCreateV6Route
25542024-10-01T02:33:17.359ZDEBGnexus (SagaExecutor): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true roles = RoleSet { roles: {(Silo, 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, "admin")} } saga_id = 988c83d6-6c22-4e63-9439-7462ce949335 saga_name = project-create saga_node = VpcCreateV6Route
25552024-10-01T02:33:17.362ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:61265
25562024-10-01T02:33:17.362ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:61265 req_id = 1a071adf-736e-4e5f-b476-3f0a38591cf0 roles = RoleSet { roles: {} } uri = /metrics/producers
25572024-10-01T02:33:17.362ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:61265 req_id = 1a071adf-736e-4e5f-b476-3f0a38591cf0 resource = Database result = Ok(()) uri = /metrics/producers
25582024-10-01T02:33:17.363ZDEBGnexus (SagaExecutor): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, lookup_type: ById(21983b87-d6d0-47c6-a33c-5fe68fbed0c6) }, key: d6cd5e95-82db-413f-aa24-4fc56edfc65a, lookup_type: ByName("proj-815f1091374") }, key: d0c53fd8-2027-48ed-90fd-8a4e218435fa, lookup_type: ByName("default") }, key: 3ee099b5-5648-4743-8f10-a56b8719e19d, lookup_type: ById(3ee099b5-5648-4743-8f10-a56b8719e19d) } result = Ok(()) saga_id = 988c83d6-6c22-4e63-9439-7462ce949335 saga_name = project-create saga_node = VpcCreateV6Route
25592024-10-01T02:33:17.363ZDEBGnexus (SagaExecutor): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true roles = RoleSet { roles: {} } saga_id = 988c83d6-6c22-4e63-9439-7462ce949335 saga_name = project-create saga_node = VpcCreateV6Route
25602024-10-01T02:33:17.363ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true resource = Database result = Ok(()) saga_id = 988c83d6-6c22-4e63-9439-7462ce949335 saga_name = project-create saga_node = VpcCreateV6Route
25612024-10-01T02:33:17.398ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 41f2943e-6041-44c9-a47a-3cf5fb012644
25622024-10-01T02:33:17.398ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:61265 req_id = 1a071adf-736e-4e5f-b476-3f0a38591cf0 roles = RoleSet { roles: {} } uri = /metrics/producers
25632024-10-01T02:33:17.398ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:61265 req_id = 1a071adf-736e-4e5f-b476-3f0a38591cf0 resource = Database result = Ok(()) uri = /metrics/producers
25642024-10-01T02:33:17.401ZDEBGnexus (SEC): saga log event new_state = N011 succeeded sec_id = 3dfd7033-71d8-4eb9-bb97-49dae3b5cd35
25652024-10-01T02:33:17.401ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 11 saga_id = 988c83d6-6c22-4e63-9439-7462ce949335
25662024-10-01T02:33:17.407ZDEBGnexus (SEC): saga log event new_state = N012 started sec_id = 3dfd7033-71d8-4eb9-bb97-49dae3b5cd35
25672024-10-01T02:33:17.407ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 12 saga_id = 988c83d6-6c22-4e63-9439-7462ce949335
25682024-10-01T02:33:17.412ZDEBGnexus (SagaExecutor): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true roles = RoleSet { roles: {} } saga_id = 988c83d6-6c22-4e63-9439-7462ce949335 saga_name = project-create saga_node = VpcCreateSubnet
25692024-10-01T02:33:17.412ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true resource = Database result = Ok(()) saga_id = 988c83d6-6c22-4e63-9439-7462ce949335 saga_name = project-create saga_node = VpcCreateSubnet
25702024-10-01T02:33:17.414ZDEBGnexus (SagaExecutor): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true roles = RoleSet { roles: {} } saga_id = 988c83d6-6c22-4e63-9439-7462ce949335 saga_name = project-create saga_node = VpcCreateSubnet
25712024-10-01T02:33:17.414ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true resource = Database result = Ok(()) saga_id = 988c83d6-6c22-4e63-9439-7462ce949335 saga_name = project-create saga_node = VpcCreateSubnet
25722024-10-01T02:33:17.417ZDEBGnexus (SagaExecutor): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true roles = RoleSet { roles: {} } saga_id = 988c83d6-6c22-4e63-9439-7462ce949335 saga_name = project-create saga_node = VpcCreateSubnet
25732024-10-01T02:33:17.417ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true resource = Database result = Ok(()) saga_id = 988c83d6-6c22-4e63-9439-7462ce949335 saga_name = project-create saga_node = VpcCreateSubnet
25742024-10-01T02:33:17.420ZDEBGnexus (SagaExecutor): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true roles = RoleSet { roles: {} } saga_id = 988c83d6-6c22-4e63-9439-7462ce949335 saga_name = project-create saga_node = VpcCreateSubnet
25752024-10-01T02:33:17.420ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true resource = Database result = Ok(()) saga_id = 988c83d6-6c22-4e63-9439-7462ce949335 saga_name = project-create saga_node = VpcCreateSubnet
25762024-10-01T02:33:17.422ZDEBGnexus (SagaExecutor): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true roles = RoleSet { roles: {(Silo, 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, "admin")} } saga_id = 988c83d6-6c22-4e63-9439-7462ce949335 saga_name = project-create saga_node = VpcCreateSubnet
25772024-10-01T02:33:17.426ZDEBGnexus (SagaExecutor): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, lookup_type: ById(21983b87-d6d0-47c6-a33c-5fe68fbed0c6) }, key: d6cd5e95-82db-413f-aa24-4fc56edfc65a, lookup_type: ByName("proj-815f1091374") }, key: d0c53fd8-2027-48ed-90fd-8a4e218435fa, lookup_type: ByName("default") } result = Ok(()) saga_id = 988c83d6-6c22-4e63-9439-7462ce949335 saga_name = project-create saga_node = VpcCreateSubnet
25782024-10-01T02:33:17.444ZDEBGnexus (SagaExecutor): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true roles = RoleSet { roles: {} } saga_id = 988c83d6-6c22-4e63-9439-7462ce949335 saga_name = project-create saga_node = VpcCreateSubnet
25792024-10-01T02:33:17.444ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 41f2943e-6041-44c9-a47a-3cf5fb012644 uri = http://[fd00:1122:3344:101::d]:12223/producers
25802024-10-01T02:33:17.444ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true resource = Database result = Ok(()) saga_id = 988c83d6-6c22-4e63-9439-7462ce949335 saga_name = project-create saga_node = VpcCreateSubnet
25812024-10-01T02:33:17.445ZDEBGnexus: client response oximeter-collector = 41f2943e-6041-44c9-a47a-3cf5fb012644 result = Ok(Response { url: "http://[fd00:1122:3344:101::d]:12223/producers", status: 204, headers: {"x-request-id": "a54e666e-9c37-4afb-9c71-e1f6d2bd5c53", "date": "Tue, 01 Oct 2024 02:33:17 GMT"} })
25822024-10-01T02:33:17.445ZINFOnexus: assigned collector to new producer collector_id = 41f2943e-6041-44c9-a47a-3cf5fb012644 file = nexus/src/app/oximeter.rs:125 producer_id = d6787ad6-35ff-481f-bec7-5f0d93835d2a
25832024-10-01T02:33:17.447ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 84507 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:61265 req_id = 1a071adf-736e-4e5f-b476-3f0a38591cf0 response_code = 201 uri = /metrics/producers
25842024-10-01T02:33:17.517ZDEBGnexus (SagaExecutor): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true roles = RoleSet { roles: {} } saga_id = 988c83d6-6c22-4e63-9439-7462ce949335 saga_name = project-create saga_node = VpcCreateSubnet
25852024-10-01T02:33:17.518ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true resource = Database result = Ok(()) saga_id = 988c83d6-6c22-4e63-9439-7462ce949335 saga_name = project-create saga_node = VpcCreateSubnet
25862024-10-01T02:33:17.557ZDEBGnexus (SEC): saga log event new_state = N012 succeeded sec_id = 3dfd7033-71d8-4eb9-bb97-49dae3b5cd35
25872024-10-01T02:33:17.557ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Array [Object {"key": String("050ff4b6-0012-4a9f-a32d-f71a94895be6"), "lookup_type": Object {"ById": String("050ff4b6-0012-4a9f-a32d-f71a94895be6")}, "parent": Object {"key": String("d0c53fd8-2027-48ed-90fd-8a4e218435fa"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("d6cd5e95-82db-413f-aa24-4fc56edfc65a"), "lookup_type": Object {"ByName": String("proj-815f1091374")}, "parent": Object {"key": String("21983b87-d6d0-47c6-a33c-5fe68fbed0c6"), "lookup_type": Object {"ById": String("21983b87-d6d0-47c6-a33c-5fe68fbed0c6")}, "parent": Null}}}}, Object {"custom_router_id": Null, "identity": Object {"description": String("The default subnet for default"), "id": String("050ff4b6-0012-4a9f-a32d-f71a94895be6"), "name": String("default"), "time_created": String("2024-10-01T02:33:17.412373Z"), "time_deleted": Null, "time_modified": String("2024-10-01T02:33:17.412373Z")}, "ipv4_block": String("172.30.0.0/22"), "ipv6_block": String("fd4c:3e4e:4d9c::/64"), "rcgen": Number(1), "vpc_id": String("d0c53fd8-2027-48ed-90fd-8a4e218435fa")}]) node_id = 12 saga_id = 988c83d6-6c22-4e63-9439-7462ce949335
25882024-10-01T02:33:17.570ZDEBGnexus (SEC): saga log event new_state = N013 started sec_id = 3dfd7033-71d8-4eb9-bb97-49dae3b5cd35
25892024-10-01T02:33:17.570ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 13 saga_id = 988c83d6-6c22-4e63-9439-7462ce949335
25902024-10-01T02:33:17.587ZDEBGnexus: default firewall rules for vpc default rules = [VpcFirewallRule { identity: VpcFirewallRuleIdentity { id: b72f6c12-211b-44eb-a71a-af56d936def3, name: Name(Name("allow-internal-inbound")), description: "allow inbound traffic to all instances within the VPC if originated within the VPC", time_created: 2024-10-01T02:33:17.587334291Z, time_modified: 2024-10-01T02:33:17.587334291Z, time_deleted: None }, vpc_id: d0c53fd8-2027-48ed-90fd-8a4e218435fa, status: VpcFirewallRuleStatus(Enabled), direction: VpcFirewallRuleDirection(Inbound), targets: [VpcFirewallRuleTarget(Vpc(Name("default")))], filter_hosts: Some([VpcFirewallRuleHostFilter(Vpc(Name("default")))]), filter_ports: None, filter_protocols: None, action: VpcFirewallRuleAction(Allow), priority: VpcFirewallRulePriority(VpcFirewallRulePriority(65534)) }, VpcFirewallRule { identity: VpcFirewallRuleIdentity { id: 10595d10-1c9f-4a2b-9b78-fb3c9058c64b, name: Name(Name("allow-ssh")), description: "allow inbound TCP connections on port 22 from anywhere", time_created: 2024-10-01T02:33:17.587339811Z, time_modified: 2024-10-01T02:33:17.587339811Z, time_deleted: None }, vpc_id: d0c53fd8-2027-48ed-90fd-8a4e218435fa, status: VpcFirewallRuleStatus(Enabled), direction: VpcFirewallRuleDirection(Inbound), targets: [VpcFirewallRuleTarget(Vpc(Name("default")))], filter_hosts: None, filter_ports: Some([L4PortRange(L4PortRange { first: L4Port(22), last: L4Port(22) })]), filter_protocols: Some([VpcFirewallRuleProtocol(Tcp)]), action: VpcFirewallRuleAction(Allow), priority: VpcFirewallRulePriority(VpcFirewallRulePriority(65534)) }, VpcFirewallRule { identity: VpcFirewallRuleIdentity { id: 26a52ad0-debc-409b-8f2d-8ddab8490271, name: Name(Name("allow-icmp")), description: "allow inbound ICMP traffic from anywhere", time_created: 2024-10-01T02:33:17.587340681Z, time_modified: 2024-10-01T02:33:17.587340681Z, time_deleted: None }, vpc_id: d0c53fd8-2027-48ed-90fd-8a4e218435fa, status: VpcFirewallRuleStatus(Enabled), direction: VpcFirewallRuleDirection(Inbound), targets: [VpcFirewallRuleTarget(Vpc(Name("default")))], filter_hosts: None, filter_ports: None, filter_protocols: Some([VpcFirewallRuleProtocol(Icmp)]), action: VpcFirewallRuleAction(Allow), priority: VpcFirewallRulePriority(VpcFirewallRulePriority(65534)) }]
25912024-10-01T02:33:17.587ZDEBGnexus (SagaExecutor): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true roles = RoleSet { roles: {} } saga_id = 988c83d6-6c22-4e63-9439-7462ce949335 saga_name = project-create saga_node = VpcUpdateFirewall
25922024-10-01T02:33:17.587ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true resource = Database result = Ok(()) saga_id = 988c83d6-6c22-4e63-9439-7462ce949335 saga_name = project-create saga_node = VpcUpdateFirewall
25932024-10-01T02:33:17.590ZDEBGnexus (SagaExecutor): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true roles = RoleSet { roles: {} } saga_id = 988c83d6-6c22-4e63-9439-7462ce949335 saga_name = project-create saga_node = VpcUpdateFirewall
25942024-10-01T02:33:17.590ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true resource = Database result = Ok(()) saga_id = 988c83d6-6c22-4e63-9439-7462ce949335 saga_name = project-create saga_node = VpcUpdateFirewall
25952024-10-01T02:33:17.592ZDEBGnexus (SagaExecutor): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true roles = RoleSet { roles: {} } saga_id = 988c83d6-6c22-4e63-9439-7462ce949335 saga_name = project-create saga_node = VpcUpdateFirewall
25962024-10-01T02:33:17.592ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true resource = Database result = Ok(()) saga_id = 988c83d6-6c22-4e63-9439-7462ce949335 saga_name = project-create saga_node = VpcUpdateFirewall
25972024-10-01T02:33:17.595ZDEBGnexus (SagaExecutor): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true roles = RoleSet { roles: {} } saga_id = 988c83d6-6c22-4e63-9439-7462ce949335 saga_name = project-create saga_node = VpcUpdateFirewall
25982024-10-01T02:33:17.595ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true resource = Database result = Ok(()) saga_id = 988c83d6-6c22-4e63-9439-7462ce949335 saga_name = project-create saga_node = VpcUpdateFirewall
25992024-10-01T02:33:17.598ZDEBGnexus (SagaExecutor): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true roles = RoleSet { roles: {(Silo, 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, "admin")} } saga_id = 988c83d6-6c22-4e63-9439-7462ce949335 saga_name = project-create saga_node = VpcUpdateFirewall
26002024-10-01T02:33:17.600ZDEBGnexus (SagaExecutor): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, lookup_type: ById(21983b87-d6d0-47c6-a33c-5fe68fbed0c6) }, key: d6cd5e95-82db-413f-aa24-4fc56edfc65a, lookup_type: ByName("proj-815f1091374") }, key: d0c53fd8-2027-48ed-90fd-8a4e218435fa, lookup_type: ByName("default") } result = Ok(()) saga_id = 988c83d6-6c22-4e63-9439-7462ce949335 saga_name = project-create saga_node = VpcUpdateFirewall
26012024-10-01T02:33:17.600ZDEBGnexus (SagaExecutor): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true roles = RoleSet { roles: {} } saga_id = 988c83d6-6c22-4e63-9439-7462ce949335 saga_name = project-create saga_node = VpcUpdateFirewall
26022024-10-01T02:33:17.601ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true resource = Database result = Ok(()) saga_id = 988c83d6-6c22-4e63-9439-7462ce949335 saga_name = project-create saga_node = VpcUpdateFirewall
26032024-10-01T02:33:17.655ZDEBGnexus (SEC): saga log event new_state = N013 succeeded sec_id = 3dfd7033-71d8-4eb9-bb97-49dae3b5cd35
26042024-10-01T02:33:17.655ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Array [Object {"action": String("allow"), "direction": String("inbound"), "filter_hosts": Array [Object {"type": String("vpc"), "value": String("default")}], "filter_ports": Null, "filter_protocols": Null, "identity": Object {"description": String("allow inbound traffic to all instances within the VPC if originated within the VPC"), "id": String("b72f6c12-211b-44eb-a71a-af56d936def3"), "name": String("allow-internal-inbound"), "time_created": String("2024-10-01T02:33:17.587334291Z"), "time_deleted": Null, "time_modified": String("2024-10-01T02:33:17.587334291Z")}, "priority": Number(65534), "status": String("enabled"), "targets": Array [Object {"type": String("vpc"), "value": String("default")}], "vpc_id": String("d0c53fd8-2027-48ed-90fd-8a4e218435fa")}, Object {"action": String("allow"), "direction": String("inbound"), "filter_hosts": Null, "filter_ports": Array [String("22")], "filter_protocols": Array [String("TCP")], "identity": Object {"description": String("allow inbound TCP connections on port 22 from anywhere"), "id": String("10595d10-1c9f-4a2b-9b78-fb3c9058c64b"), "name": String("allow-ssh"), "time_created": String("2024-10-01T02:33:17.587339811Z"), "time_deleted": Null, "time_modified": String("2024-10-01T02:33:17.587339811Z")}, "priority": Number(65534), "status": String("enabled"), "targets": Array [Object {"type": String("vpc"), "value": String("default")}], "vpc_id": String("d0c53fd8-2027-48ed-90fd-8a4e218435fa")}, Object {"action": String("allow"), "direction": String("inbound"), "filter_hosts": Null, "filter_ports": Null, "filter_protocols": Array [String("ICMP")], "identity": Object {"description": String("allow inbound ICMP traffic from anywhere"), "id": String("26a52ad0-debc-409b-8f2d-8ddab8490271"), "name": String("allow-icmp"), "time_created": String("2024-10-01T02:33:17.587340681Z"), "time_deleted": Null, "time_modified": String("2024-10-01T02:33:17.587340681Z")}, "priority": Number(65534), "status": String("enabled"), "targets": Array [Object {"type": String("vpc"), "value": String("default")}], "vpc_id": String("d0c53fd8-2027-48ed-90fd-8a4e218435fa")}]) node_id = 13 saga_id = 988c83d6-6c22-4e63-9439-7462ce949335
26052024-10-01T02:33:17.660ZDEBGnexus (SEC): saga log event new_state = N014 started sec_id = 3dfd7033-71d8-4eb9-bb97-49dae3b5cd35
26062024-10-01T02:33:17.660ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 14 saga_id = 988c83d6-6c22-4e63-9439-7462ce949335
26072024-10-01T02:33:17.665ZDEBGnexus (SagaExecutor): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true roles = RoleSet { roles: {} } saga_id = 988c83d6-6c22-4e63-9439-7462ce949335 saga_name = project-create saga_node = VpcNotifySleds
26082024-10-01T02:33:17.665ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true resource = Database result = Ok(()) saga_id = 988c83d6-6c22-4e63-9439-7462ce949335 saga_name = project-create saga_node = VpcNotifySleds
26092024-10-01T02:33:17.666ZDEBGnexus (SagaExecutor): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true roles = RoleSet { roles: {} } saga_id = 988c83d6-6c22-4e63-9439-7462ce949335 saga_name = project-create saga_node = VpcNotifySleds
26102024-10-01T02:33:17.667ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true resource = Database result = Ok(()) saga_id = 988c83d6-6c22-4e63-9439-7462ce949335 saga_name = project-create saga_node = VpcNotifySleds
26112024-10-01T02:33:17.668ZDEBGnexus (SagaExecutor): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true roles = RoleSet { roles: {} } saga_id = 988c83d6-6c22-4e63-9439-7462ce949335 saga_name = project-create saga_node = VpcNotifySleds
26122024-10-01T02:33:17.669ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true resource = Database result = Ok(()) saga_id = 988c83d6-6c22-4e63-9439-7462ce949335 saga_name = project-create saga_node = VpcNotifySleds
26132024-10-01T02:33:17.674ZDEBGnexus (SagaExecutor): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true roles = RoleSet { roles: {} } saga_id = 988c83d6-6c22-4e63-9439-7462ce949335 saga_name = project-create saga_node = VpcNotifySleds
26142024-10-01T02:33:17.675ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true resource = Database result = Ok(()) saga_id = 988c83d6-6c22-4e63-9439-7462ce949335 saga_name = project-create saga_node = VpcNotifySleds
26152024-10-01T02:33:17.677ZDEBGnexus (SagaExecutor): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true roles = RoleSet { roles: {} } saga_id = 988c83d6-6c22-4e63-9439-7462ce949335 saga_name = project-create saga_node = VpcNotifySleds
26162024-10-01T02:33:17.677ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true resource = Database result = Ok(()) saga_id = 988c83d6-6c22-4e63-9439-7462ce949335 saga_name = project-create saga_node = VpcNotifySleds
26172024-10-01T02:33:17.679ZDEBGnexus (SagaExecutor): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true roles = RoleSet { roles: {} } saga_id = 988c83d6-6c22-4e63-9439-7462ce949335 saga_name = project-create saga_node = VpcNotifySleds
26182024-10-01T02:33:17.679ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true resource = Database result = Ok(()) saga_id = 988c83d6-6c22-4e63-9439-7462ce949335 saga_name = project-create saga_node = VpcNotifySleds
26192024-10-01T02:33:17.682ZDEBGnexus (SagaExecutor): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true roles = RoleSet { roles: {} } saga_id = 988c83d6-6c22-4e63-9439-7462ce949335 saga_name = project-create saga_node = VpcNotifySleds
26202024-10-01T02:33:17.682ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true resource = Database result = Ok(()) saga_id = 988c83d6-6c22-4e63-9439-7462ce949335 saga_name = project-create saga_node = VpcNotifySleds
26212024-10-01T02:33:17.685ZDEBGnexus (SagaExecutor): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true roles = RoleSet { roles: {(Silo, 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, "admin")} } saga_id = 988c83d6-6c22-4e63-9439-7462ce949335 saga_name = project-create saga_node = VpcNotifySleds
26222024-10-01T02:33:17.687ZDEBGnexus (SagaExecutor): authorize result action = ListChildren actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, lookup_type: ById(21983b87-d6d0-47c6-a33c-5fe68fbed0c6) }, key: d6cd5e95-82db-413f-aa24-4fc56edfc65a, lookup_type: ById(d6cd5e95-82db-413f-aa24-4fc56edfc65a) }, key: d0c53fd8-2027-48ed-90fd-8a4e218435fa, lookup_type: ByName("default") } result = Ok(()) saga_id = 988c83d6-6c22-4e63-9439-7462ce949335 saga_name = project-create saga_node = VpcNotifySleds
26232024-10-01T02:33:17.687ZDEBGnexus (SagaExecutor): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true roles = RoleSet { roles: {} } saga_id = 988c83d6-6c22-4e63-9439-7462ce949335 saga_name = project-create saga_node = VpcNotifySleds
26242024-10-01T02:33:17.688ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true resource = Database result = Ok(()) saga_id = 988c83d6-6c22-4e63-9439-7462ce949335 saga_name = project-create saga_node = VpcNotifySleds
26252024-10-01T02:33:17.690ZDEBGnexus (SagaExecutor): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true roles = RoleSet { roles: {} } saga_id = 988c83d6-6c22-4e63-9439-7462ce949335 saga_name = project-create saga_node = VpcNotifySleds
26262024-10-01T02:33:17.691ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true resource = Database result = Ok(()) saga_id = 988c83d6-6c22-4e63-9439-7462ce949335 saga_name = project-create saga_node = VpcNotifySleds
26272024-10-01T02:33:17.693ZDEBGnexus (SagaExecutor): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true roles = RoleSet { roles: {} } saga_id = 988c83d6-6c22-4e63-9439-7462ce949335 saga_name = project-create saga_node = VpcNotifySleds
26282024-10-01T02:33:17.693ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true resource = Database result = Ok(()) saga_id = 988c83d6-6c22-4e63-9439-7462ce949335 saga_name = project-create saga_node = VpcNotifySleds
26292024-10-01T02:33:17.696ZDEBGnexus (SagaExecutor): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true roles = RoleSet { roles: {} } saga_id = 988c83d6-6c22-4e63-9439-7462ce949335 saga_name = project-create saga_node = VpcNotifySleds
26302024-10-01T02:33:17.696ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true resource = Database result = Ok(()) saga_id = 988c83d6-6c22-4e63-9439-7462ce949335 saga_name = project-create saga_node = VpcNotifySleds
26312024-10-01T02:33:17.700ZDEBGnexus (SagaExecutor): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true roles = RoleSet { roles: {(Silo, 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, "admin")} } saga_id = 988c83d6-6c22-4e63-9439-7462ce949335 saga_name = project-create saga_node = VpcNotifySleds
26322024-10-01T02:33:17.702ZDEBGnexus (SagaExecutor): authorize result action = ListChildren actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, lookup_type: ById(21983b87-d6d0-47c6-a33c-5fe68fbed0c6) }, key: d6cd5e95-82db-413f-aa24-4fc56edfc65a, lookup_type: ById(d6cd5e95-82db-413f-aa24-4fc56edfc65a) }, key: d0c53fd8-2027-48ed-90fd-8a4e218435fa, lookup_type: ByName("default") } result = Ok(()) saga_id = 988c83d6-6c22-4e63-9439-7462ce949335 saga_name = project-create saga_node = VpcNotifySleds
26332024-10-01T02:33:17.702ZDEBGnexus (SagaExecutor): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true roles = RoleSet { roles: {} } saga_id = 988c83d6-6c22-4e63-9439-7462ce949335 saga_name = project-create saga_node = VpcNotifySleds
26342024-10-01T02:33:17.702ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true resource = Database result = Ok(()) saga_id = 988c83d6-6c22-4e63-9439-7462ce949335 saga_name = project-create saga_node = VpcNotifySleds
26352024-10-01T02:33:17.708ZDEBGnexus: resolved names for firewall rules instance_interfaces = {} subnet_interfaces = {} subnet_networks = {} vpc_interfaces = {}
26362024-10-01T02:33:17.708ZDEBGnexus: resolved firewall rules for sled agents sled_agent_rules = []
26372024-10-01T02:33:17.708ZDEBGnexus: resolved 0 rules for sleds
26382024-10-01T02:33:17.730ZDEBGnexus: resolved sleds for vpc default vpc_to_sled = []
26392024-10-01T02:33:17.730ZDEBGnexus: sending firewall rules to sled agents
26402024-10-01T02:33:17.730ZINFOnexus: updated firewall rules on 0 sleds file = nexus/networking/src/firewall_rules.rs:496
26412024-10-01T02:33:17.730ZDEBGnexus (SEC): saga log event new_state = N014 succeeded sec_id = 3dfd7033-71d8-4eb9-bb97-49dae3b5cd35
26422024-10-01T02:33:17.730ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 14 saga_id = 988c83d6-6c22-4e63-9439-7462ce949335
26432024-10-01T02:33:17.735ZDEBGnexus (SEC): saga log event new_state = N015 started sec_id = 3dfd7033-71d8-4eb9-bb97-49dae3b5cd35
26442024-10-01T02:33:17.735ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 15 saga_id = 988c83d6-6c22-4e63-9439-7462ce949335
26452024-10-01T02:33:17.739ZDEBGnexus (SEC): saga log event new_state = N015 succeeded sec_id = 3dfd7033-71d8-4eb9-bb97-49dae3b5cd35
26462024-10-01T02:33:17.739ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 15 saga_id = 988c83d6-6c22-4e63-9439-7462ce949335
26472024-10-01T02:33:17.743ZDEBGnexus (SEC): saga log event new_state = N017 started sec_id = 3dfd7033-71d8-4eb9-bb97-49dae3b5cd35
26482024-10-01T02:33:17.743ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 17 saga_id = 988c83d6-6c22-4e63-9439-7462ce949335
26492024-10-01T02:33:17.747ZDEBGnexus (SEC): saga log event new_state = N017 succeeded sec_id = 3dfd7033-71d8-4eb9-bb97-49dae3b5cd35
26502024-10-01T02:33:17.747ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 17 saga_id = 988c83d6-6c22-4e63-9439-7462ce949335
26512024-10-01T02:33:17.751ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = 988c83d6-6c22-4e63-9439-7462ce949335 sec_id = 3dfd7033-71d8-4eb9-bb97-49dae3b5cd35
26522024-10-01T02:33:17.751ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = 988c83d6-6c22-4e63-9439-7462ce949335
26532024-10-01T02:33:17.791ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = 988c83d6-6c22-4e63-9439-7462ce949335 saga_name = project-create sec_id = 3dfd7033-71d8-4eb9-bb97-49dae3b5cd35
26542024-10-01T02:33:17.791ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = 988c83d6-6c22-4e63-9439-7462ce949335 saga_name = project-create saga_result = SagaResult { saga_id: 988c83d6-6c22-4e63-9439-7462ce949335, saga_log: SagaLog { saga_id: 988c83d6-6c22-4e63-9439-7462ce949335, unwinding: false, events: [N016 started, N016 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N003 started, N003 succeeded, N004 started, N004 succeeded, N005 started, N005 succeeded, N006 started, N006 succeeded, N007 started, N007 succeeded, N008 started, N008 succeeded, N009 started, N009 succeeded, N010 started, N010 succeeded, N011 started, N011 succeeded, N012 started, N012 succeeded, N013 started, N013 succeeded, N014 started, N014 succeeded, N015 started, N015 succeeded, N017 started, N017 succeeded], node_status: {0: Succeeded(Array [Object {"key": String("d6cd5e95-82db-413f-aa24-4fc56edfc65a"), "lookup_type": Object {"ByName": String("proj-815f1091374")}, "parent": Object {"key": String("21983b87-d6d0-47c6-a33c-5fe68fbed0c6"), "lookup_type": Object {"ById": String("21983b87-d6d0-47c6-a33c-5fe68fbed0c6")}, "parent": Null}}, Object {"identity": Object {"description": String(""), "id": String("d6cd5e95-82db-413f-aa24-4fc56edfc65a"), "name": String("proj-815f1091374"), "time_created": String("2024-10-01T02:33:16.969991Z"), "time_deleted": Null, "time_modified": String("2024-10-01T02:33:16.969991Z")}, "rcgen": Number(1), "silo_id": String("21983b87-d6d0-47c6-a33c-5fe68fbed0c6")}]), 1: Succeeded(Object {"authz_project": Object {"key": String("d6cd5e95-82db-413f-aa24-4fc56edfc65a"), "lookup_type": Object {"ByName": String("proj-815f1091374")}, "parent": Object {"key": String("21983b87-d6d0-47c6-a33c-5fe68fbed0c6"), "lookup_type": Object {"ById": String("21983b87-d6d0-47c6-a33c-5fe68fbed0c6")}, "parent": Null}}, "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"SiloUser": Object {"silo_id": String("21983b87-d6d0-47c6-a33c-5fe68fbed0c6"), "silo_user_id": String("8fbcb238-2807-4312-9499-49292447c1fc")}}}, Object {"mapped_fleet_roles": Object {"admin": Array [String("admin")]}}]}}, "vpc_create": Object {"description": String("Default VPC"), "dns_name": String("default"), "ipv6_prefix": String("fd4c:3e4e:4d9c::/48"), "name": String("default")}}), 2: Succeeded(Null), 3: Succeeded(String("d0c53fd8-2027-48ed-90fd-8a4e218435fa")), 4: Succeeded(String("3ee099b5-5648-4743-8f10-a56b8719e19d")), 5: Succeeded(String("cfaa265f-8161-43fc-b160-95cd423a72bf")), 6: Succeeded(String("fc7e43a6-e247-4f12-ae73-ed01dfaa49e0")), 7: Succeeded(String("050ff4b6-0012-4a9f-a32d-f71a94895be6")), 8: Succeeded(Array [Object {"key": String("d0c53fd8-2027-48ed-90fd-8a4e218435fa"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("d6cd5e95-82db-413f-aa24-4fc56edfc65a"), "lookup_type": Object {"ByName": String("proj-815f1091374")}, "parent": Object {"key": String("21983b87-d6d0-47c6-a33c-5fe68fbed0c6"), "lookup_type": Object {"ById": String("21983b87-d6d0-47c6-a33c-5fe68fbed0c6")}, "parent": Null}}}, Object {"dns_name": String("default"), "firewall_gen": Number(1), "identity": Object {"description": String("Default VPC"), "id": String("d0c53fd8-2027-48ed-90fd-8a4e218435fa"), "name": String("default"), "time_created": String("2024-10-01T02:33:17.149475Z"), "time_deleted": Null, "time_modified": String("2024-10-01T02:33:17.149475Z")}, "ipv6_prefix": String("fd4c:3e4e:4d9c::/48"), "project_id": String("d6cd5e95-82db-413f-aa24-4fc56edfc65a"), "subnet_gen": Number(1), "system_router_id": String("3ee099b5-5648-4743-8f10-a56b8719e19d"), "vni": Number(16045052)}]), 9: Succeeded(Object {"key": String("3ee099b5-5648-4743-8f10-a56b8719e19d"), "lookup_type": Object {"ById": String("3ee099b5-5648-4743-8f10-a56b8719e19d")}, "parent": Object {"key": String("d0c53fd8-2027-48ed-90fd-8a4e218435fa"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("d6cd5e95-82db-413f-aa24-4fc56edfc65a"), "lookup_type": Object {"ByName": String("proj-815f1091374")}, "parent": Object {"key": String("21983b87-d6d0-47c6-a33c-5fe68fbed0c6"), "lookup_type": Object {"ById": String("21983b87-d6d0-47c6-a33c-5fe68fbed0c6")}, "parent": Null}}}}), 10: Succeeded(Null), 11: Succeeded(Null), 12: Succeeded(Array [Object {"key": String("050ff4b6-0012-4a9f-a32d-f71a94895be6"), "lookup_type": Object {"ById": String("050ff4b6-0012-4a9f-a32d-f71a94895be6")}, "parent": Object {"key": String("d0c53fd8-2027-48ed-90fd-8a4e218435fa"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("d6cd5e95-82db-413f-aa24-4fc56edfc65a"), "lookup_type": Object {"ByName": String("proj-815f1091374")}, "parent": Object {"key": String("21983b87-d6d0-47c6-a33c-5fe68fbed0c6"), "lookup_type": Object {"ById": String("21983b87-d6d0-47c6-a33c-5fe68fbed0c6")}, "parent": Null}}}}, Object {"custom_router_id": Null, "identity": Object {"description": String("The default subnet for default"), "id": String("050ff4b6-0012-4a9f-a32d-f71a94895be6"), "name": String("default"), "time_created": String("2024-10-01T02:33:17.412373Z"), "time_deleted": Null, "time_modified": String("2024-10-01T02:33:17.412373Z")}, "ipv4_block": String("172.30.0.0/22"), "ipv6_block": String("fd4c:3e4e:4d9c::/64"), "rcgen": Number(1), "vpc_id": String("d0c53fd8-2027-48ed-90fd-8a4e218435fa")}]), 13: Succeeded(Array [Object {"action": String("allow"), "direction": String("inbound"), "filter_hosts": Array [Object {"type": String("vpc"), "value": String("default")}], "filter_ports": Null, "filter_protocols": Null, "identity": Object {"description": String("allow inbound traffic to all instances within the VPC if originated within the VPC"), "id": String("b72f6c12-211b-44eb-a71a-af56d936def3"), "name": String("allow-internal-inbound"), "time_created": String("2024-10-01T02:33:17.587334291Z"), "time_deleted": Null, "time_modified": String("2024-10-01T02:33:17.587334291Z")}, "priority": Number(65534), "status": String("enabled"), "targets": Array [Object {"type": String("vpc"), "value": String("default")}], "vpc_id": String("d0c53fd8-2027-48ed-90fd-8a4e218435fa")}, Object {"action": String("allow"), "direction": String("inbound"), "filter_hosts": Null, "filter_ports": Array [String("22")], "filter_protocols": Array [String("TCP")], "identity": Object {"description": String("allow inbound TCP connections on port 22 from anywhere"), "id": String("10595d10-1c9f-4a2b-9b78-fb3c9058c64b"), "name": String("allow-ssh"), "time_created": String("2024-10-01T02:33:17.587339811Z"), "time_deleted": Null, "time_modified": String("2024-10-01T02:33:17.587339811Z")}, "priority": Number(65534), "status": String("enabled"), "targets": Array [Object {"type": String("vpc"), "value": String("default")}], "vpc_id": String("d0c53fd8-2027-48ed-90fd-8a4e218435fa")}, Object {"action": String("allow"), "direction": String("inbound"), "filter_hosts": Null, "filter_ports": Null, "filter_protocols": Array [String("ICMP")], "identity": Object {"description": String("allow inbound ICMP traffic from anywhere"), "id": String("26a52ad0-debc-409b-8f2d-8ddab8490271"), "name": String("allow-icmp"), "time_created": String("2024-10-01T02:33:17.587340681Z"), "time_deleted": Null, "time_modified": String("2024-10-01T02:33:17.587340681Z")}, "priority": Number(65534), "status": String("enabled"), "targets": Array [Object {"type": String("vpc"), "value": String("default")}], "vpc_id": String("d0c53fd8-2027-48ed-90fd-8a4e218435fa")}]), 14: Succeeded(Null), 15: Succeeded(Null), 16: Succeeded(Null), 17: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"default_subnet_id": String("050ff4b6-0012-4a9f-a32d-f71a94895be6"), "default_v4_route_id": String("cfaa265f-8161-43fc-b160-95cd423a72bf"), "default_v6_route_id": String("fc7e43a6-e247-4f12-ae73-ed01dfaa49e0"), "firewall": Array [Object {"action": String("allow"), "direction": String("inbound"), "filter_hosts": Array [Object {"type": String("vpc"), "value": String("default")}], "filter_ports": Null, "filter_protocols": Null, "identity": Object {"description": String("allow inbound traffic to all instances within the VPC if originated within the VPC"), "id": String("b72f6c12-211b-44eb-a71a-af56d936def3"), "name": String("allow-internal-inbound"), "time_created": String("2024-10-01T02:33:17.587334291Z"), "time_deleted": Null, "time_modified": String("2024-10-01T02:33:17.587334291Z")}, "priority": Number(65534), "status": String("enabled"), "targets": Array [Object {"type": String("vpc"), "value": String("default")}], "vpc_id": String("d0c53fd8-2027-48ed-90fd-8a4e218435fa")}, Object {"action": String("allow"), "direction": String("inbound"), "filter_hosts": Null, "filter_ports": Array [String("22")], "filter_protocols": Array [String("TCP")], "identity": Object {"description": String("allow inbound TCP connections on port 22 from anywhere"), "id": String("10595d10-1c9f-4a2b-9b78-fb3c9058c64b"), "name": String("allow-ssh"), "time_created": String("2024-10-01T02:33:17.587339811Z"), "time_deleted": Null, "time_modified": String("2024-10-01T02:33:17.587339811Z")}, "priority": Number(65534), "status": String("enabled"), "targets": Array [Object {"type": String("vpc"), "value": String("default")}], "vpc_id": String("d0c53fd8-2027-48ed-90fd-8a4e218435fa")}, Object {"action": String("allow"), "direction": String("inbound"), "filter_hosts": Null, "filter_ports": Null, "filter_protocols": Array [String("ICMP")], "identity": Object {"description": String("allow inbound ICMP traffic from anywhere"), "id": String("26a52ad0-debc-409b-8f2d-8ddab8490271"), "name": String("allow-icmp"), "time_created": String("2024-10-01T02:33:17.587340681Z"), "time_deleted": Null, "time_modified": String("2024-10-01T02:33:17.587340681Z")}, "priority": Number(65534), "status": String("enabled"), "targets": Array [Object {"type": String("vpc"), "value": String("default")}], "vpc_id": String("d0c53fd8-2027-48ed-90fd-8a4e218435fa")}], "no_result": Null, "project": Array [Object {"key": String("d6cd5e95-82db-413f-aa24-4fc56edfc65a"), "lookup_type": Object {"ByName": String("proj-815f1091374")}, "parent": Object {"key": String("21983b87-d6d0-47c6-a33c-5fe68fbed0c6"), "lookup_type": Object {"ById": String("21983b87-d6d0-47c6-a33c-5fe68fbed0c6")}, "parent": Null}}, Object {"identity": Object {"description": String(""), "id": String("d6cd5e95-82db-413f-aa24-4fc56edfc65a"), "name": String("proj-815f1091374"), "time_created": String("2024-10-01T02:33:16.969991Z"), "time_deleted": Null, "time_modified": String("2024-10-01T02:33:16.969991Z")}, "rcgen": Number(1), "silo_id": String("21983b87-d6d0-47c6-a33c-5fe68fbed0c6")}], "route4": Null, "route6": Null, "router": Object {"key": String("3ee099b5-5648-4743-8f10-a56b8719e19d"), "lookup_type": Object {"ById": String("3ee099b5-5648-4743-8f10-a56b8719e19d")}, "parent": Object {"key": String("d0c53fd8-2027-48ed-90fd-8a4e218435fa"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("d6cd5e95-82db-413f-aa24-4fc56edfc65a"), "lookup_type": Object {"ByName": String("proj-815f1091374")}, "parent": Object {"key": String("21983b87-d6d0-47c6-a33c-5fe68fbed0c6"), "lookup_type": Object {"ById": String("21983b87-d6d0-47c6-a33c-5fe68fbed0c6")}, "parent": Null}}}}, "subnet": Array [Object {"key": String("050ff4b6-0012-4a9f-a32d-f71a94895be6"), "lookup_type": Object {"ById": String("050ff4b6-0012-4a9f-a32d-f71a94895be6")}, "parent": Object {"key": String("d0c53fd8-2027-48ed-90fd-8a4e218435fa"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("d6cd5e95-82db-413f-aa24-4fc56edfc65a"), "lookup_type": Object {"ByName": String("proj-815f1091374")}, "parent": Object {"key": String("21983b87-d6d0-47c6-a33c-5fe68fbed0c6"), "lookup_type": Object {"ById": String("21983b87-d6d0-47c6-a33c-5fe68fbed0c6")}, "parent": Null}}}}, Object {"custom_router_id": Null, "identity": Object {"description": String("The default subnet for default"), "id": String("050ff4b6-0012-4a9f-a32d-f71a94895be6"), "name": String("default"), "time_created": String("2024-10-01T02:33:17.412373Z"), "time_deleted": Null, "time_modified": String("2024-10-01T02:33:17.412373Z")}, "ipv4_block": String("172.30.0.0/22"), "ipv6_block": String("fd4c:3e4e:4d9c::/64"), "rcgen": Number(1), "vpc_id": String("d0c53fd8-2027-48ed-90fd-8a4e218435fa")}], "system_router_id": String("3ee099b5-5648-4743-8f10-a56b8719e19d"), "vpc": Null, "vpc_create_params": Object {"authz_project": Object {"key": String("d6cd5e95-82db-413f-aa24-4fc56edfc65a"), "lookup_type": Object {"ByName": String("proj-815f1091374")}, "parent": Object {"key": String("21983b87-d6d0-47c6-a33c-5fe68fbed0c6"), "lookup_type": Object {"ById": String("21983b87-d6d0-47c6-a33c-5fe68fbed0c6")}, "parent": Null}}, "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"SiloUser": Object {"silo_id": String("21983b87-d6d0-47c6-a33c-5fe68fbed0c6"), "silo_user_id": String("8fbcb238-2807-4312-9499-49292447c1fc")}}}, Object {"mapped_fleet_roles": Object {"admin": Array [String("admin")]}}]}}, "vpc_create": Object {"description": String("Default VPC"), "dns_name": String("default"), "ipv6_prefix": String("fd4c:3e4e:4d9c::/48"), "name": String("default")}}, "vpc_id": String("d0c53fd8-2027-48ed-90fd-8a4e218435fa")} }) }
26552024-10-01T02:33:17.792ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 973724 local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:49233 req_id = fac2eeac-b884-4a0d-8bc8-d1c656c09a4f response_code = 201 uri = /v1/projects
26562024-10-01T02:33:17.796ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
26572024-10-01T02:33:17.796ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
26582024-10-01T02:33:17.798ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
26592024-10-01T02:33:17.798ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
26602024-10-01T02:33:17.800ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
26612024-10-01T02:33:17.801ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "b2603776c17391bc0ca280d341de87edae62e8df", lookup_type: ByCompositeId("token = \\"b2603776c17391bc0ca280d341de87edae62e8df\\"") } result = Ok(())
26622024-10-01T02:33:17.801ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
26632024-10-01T02:33:17.801ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
26642024-10-01T02:33:17.803ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
26652024-10-01T02:33:17.803ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
26662024-10-01T02:33:17.805ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
26672024-10-01T02:33:17.805ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
26682024-10-01T02:33:17.806ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
26692024-10-01T02:33:17.806ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
26702024-10-01T02:33:17.808ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
26712024-10-01T02:33:17.809ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, lookup_type: ById(21983b87-d6d0-47c6-a33c-5fe68fbed0c6) }, key: 8fbcb238-2807-4312-9499-49292447c1fc, lookup_type: ById(8fbcb238-2807-4312-9499-49292447c1fc) } result = Ok(())
26722024-10-01T02:33:17.809ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
26732024-10-01T02:33:17.809ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
26742024-10-01T02:33:17.811ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
26752024-10-01T02:33:17.812ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "b2603776c17391bc0ca280d341de87edae62e8df", lookup_type: ByCompositeId("b2603776c17391bc0ca280d341de87edae62e8df") } result = Ok(())
26762024-10-01T02:33:17.812ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
26772024-10-01T02:33:17.812ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
26782024-10-01T02:33:17.818ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
26792024-10-01T02:33:17.818ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
26802024-10-01T02:33:17.820ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
26812024-10-01T02:33:17.820ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
26822024-10-01T02:33:17.821ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
26832024-10-01T02:33:17.821ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
26842024-10-01T02:33:17.822ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
26852024-10-01T02:33:17.823ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
26862024-10-01T02:33:17.824ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
26872024-10-01T02:33:17.825ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, lookup_type: ById(21983b87-d6d0-47c6-a33c-5fe68fbed0c6) }, key: 8fbcb238-2807-4312-9499-49292447c1fc, lookup_type: ById(8fbcb238-2807-4312-9499-49292447c1fc) } result = Ok(())
26882024-10-01T02:33:17.825ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
26892024-10-01T02:33:17.825ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
26902024-10-01T02:33:17.826ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
26912024-10-01T02:33:17.827ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
26922024-10-01T02:33:17.828ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
26932024-10-01T02:33:17.828ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
26942024-10-01T02:33:17.829ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
26952024-10-01T02:33:17.830ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, lookup_type: ById(21983b87-d6d0-47c6-a33c-5fe68fbed0c6) } result = Ok(())
26962024-10-01T02:33:17.830ZDEBGnexus (dropshot_external): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:49233 req_id = 00e94326-cd80-4d58-84d4-67c33eb89b5d roles = RoleSet { roles: {} } uri = /v1/disks?project=proj-815f1091374
26972024-10-01T02:33:17.830ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:49233 req_id = 00e94326-cd80-4d58-84d4-67c33eb89b5d resource = Database result = Ok(()) uri = /v1/disks?project=proj-815f1091374
26982024-10-01T02:33:17.832ZDEBGnexus (dropshot_external): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:49233 req_id = 00e94326-cd80-4d58-84d4-67c33eb89b5d roles = RoleSet { roles: {} } uri = /v1/disks?project=proj-815f1091374
26992024-10-01T02:33:17.832ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:49233 req_id = 00e94326-cd80-4d58-84d4-67c33eb89b5d resource = Database result = Ok(()) uri = /v1/disks?project=proj-815f1091374
27002024-10-01T02:33:17.834ZDEBGnexus (dropshot_external): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:49233 req_id = 00e94326-cd80-4d58-84d4-67c33eb89b5d roles = RoleSet { roles: {} } uri = /v1/disks?project=proj-815f1091374
27012024-10-01T02:33:17.834ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:49233 req_id = 00e94326-cd80-4d58-84d4-67c33eb89b5d resource = Database result = Ok(()) uri = /v1/disks?project=proj-815f1091374
27022024-10-01T02:33:17.836ZDEBGnexus (dropshot_external): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:49233 req_id = 00e94326-cd80-4d58-84d4-67c33eb89b5d roles = RoleSet { roles: {} } uri = /v1/disks?project=proj-815f1091374
27032024-10-01T02:33:17.837ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:49233 req_id = 00e94326-cd80-4d58-84d4-67c33eb89b5d resource = Database result = Ok(()) uri = /v1/disks?project=proj-815f1091374
27042024-10-01T02:33:17.839ZDEBGnexus (dropshot_external): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:49233 req_id = 00e94326-cd80-4d58-84d4-67c33eb89b5d roles = RoleSet { roles: {} } uri = /v1/disks?project=proj-815f1091374
27052024-10-01T02:33:17.839ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:49233 req_id = 00e94326-cd80-4d58-84d4-67c33eb89b5d resource = Database result = Ok(()) uri = /v1/disks?project=proj-815f1091374
27062024-10-01T02:33:17.841ZDEBGnexus (dropshot_external): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:49233 req_id = 00e94326-cd80-4d58-84d4-67c33eb89b5d roles = RoleSet { roles: {} } uri = /v1/disks?project=proj-815f1091374
27072024-10-01T02:33:17.841ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:49233 req_id = 00e94326-cd80-4d58-84d4-67c33eb89b5d resource = Database result = Ok(()) uri = /v1/disks?project=proj-815f1091374
27082024-10-01T02:33:17.844ZDEBGnexus (dropshot_external): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:49233 req_id = 00e94326-cd80-4d58-84d4-67c33eb89b5d roles = RoleSet { roles: {(Silo, 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, "admin")} } uri = /v1/disks?project=proj-815f1091374
27092024-10-01T02:33:17.846ZDEBGnexus (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:49233 req_id = 00e94326-cd80-4d58-84d4-67c33eb89b5d resource = Project { parent: Silo { parent: Fleet, key: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, lookup_type: ById(21983b87-d6d0-47c6-a33c-5fe68fbed0c6) }, key: d6cd5e95-82db-413f-aa24-4fc56edfc65a, lookup_type: ByName("proj-815f1091374") } result = Ok(()) uri = /v1/disks?project=proj-815f1091374
27102024-10-01T02:33:17.847ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = 58cf44de-60f8-4b62-aa94-6dce88054f18 saga_name = disk-create
27112024-10-01T02:33:17.847ZINFOnexus (SEC): saga create dag = {"end_node":10,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[2,3,null],[3,4,null],[4,5,null],[5,6,null],[6,7,null],[7,8,null],[9,0,null],[8,10,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateDiskId","name":"disk_id"}},{"Action":{"action_name":"common.uuid_generate","label":"GenerateVolumeId","name":"volume_id"}},{"Action":{"action_name":"disk_create.create_disk_record","label":"CreateDiskRecord","name":"created_disk"}},{"Action":{"action_name":"disk_create.regions_alloc","label":"RegionsAlloc","name":"datasets_and_regions"}},{"Action":{"action_name":"disk_create.space_account","label":"SpaceAccount","name":"no_result"}},{"Action":{"action_name":"disk_create.regions_ensure_undo","label":"RegionsEnsureUndo","name":"regions_ensure_undo"}},{"Action":{"action_name":"disk_create.regions_ensure","label":"RegionsEnsure","name":"regions_ensure"}},{"Action":{"action_name":"disk_create.create_volume_record","label":"CreateVolumeRecord","name":"created_volume"}},{"Action":{"action_name":"disk_create.finalize_disk_record","label":"FinalizeDiskRecord","name":"disk_runtime"}},{"Start":{"params":{"create_params":{"description":"","disk_source":{"block_size":512,"type":"blank"},"name":"disk-c068ffa3994","size":1073741824},"project_id":"d6cd5e95-82db-413f-aa24-4fc56edfc65a","serialized_authn":{"kind":{"Authenticated":[{"actor":{"SiloUser":{"silo_id":"21983b87-d6d0-47c6-a33c-5fe68fbed0c6","silo_user_id":"8fbcb238-2807-4312-9499-49292447c1fc"}}},{"mapped_fleet_roles":{"admin":["admin"]}}]}}}}},"End"]},"saga_name":"disk-create","start_node":9} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = 58cf44de-60f8-4b62-aa94-6dce88054f18 saga_name = disk-create sec_id = 3dfd7033-71d8-4eb9-bb97-49dae3b5cd35
27122024-10-01T02:33:17.847ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = 58cf44de-60f8-4b62-aa94-6dce88054f18 saga_name = disk-create
27132024-10-01T02:33:17.903ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = 58cf44de-60f8-4b62-aa94-6dce88054f18 saga_name = disk-create
27142024-10-01T02:33:17.903ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = 58cf44de-60f8-4b62-aa94-6dce88054f18 saga_name = disk-create sec_id = 3dfd7033-71d8-4eb9-bb97-49dae3b5cd35
27152024-10-01T02:33:17.903ZDEBGnexus (SEC): saga log event new_state = N009 started sec_id = 3dfd7033-71d8-4eb9-bb97-49dae3b5cd35
27162024-10-01T02:33:17.903ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 9 saga_id = 58cf44de-60f8-4b62-aa94-6dce88054f18
27172024-10-01T02:33:17.908ZDEBGnexus (SEC): saga log event new_state = N009 succeeded sec_id = 3dfd7033-71d8-4eb9-bb97-49dae3b5cd35
27182024-10-01T02:33:17.908ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 9 saga_id = 58cf44de-60f8-4b62-aa94-6dce88054f18
27192024-10-01T02:33:17.912ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 3dfd7033-71d8-4eb9-bb97-49dae3b5cd35
27202024-10-01T02:33:17.912ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = 58cf44de-60f8-4b62-aa94-6dce88054f18
27212024-10-01T02:33:17.915ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 3dfd7033-71d8-4eb9-bb97-49dae3b5cd35
27222024-10-01T02:33:17.915ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("d13374f1-0b40-45c0-a61c-44a143e318c6")) node_id = 0 saga_id = 58cf44de-60f8-4b62-aa94-6dce88054f18
27232024-10-01T02:33:17.919ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 3dfd7033-71d8-4eb9-bb97-49dae3b5cd35
27242024-10-01T02:33:17.919ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = 58cf44de-60f8-4b62-aa94-6dce88054f18
27252024-10-01T02:33:17.924ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 3dfd7033-71d8-4eb9-bb97-49dae3b5cd35
27262024-10-01T02:33:17.924ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("a226f189-e7bc-4f2c-91d2-964190ce00d5")) node_id = 1 saga_id = 58cf44de-60f8-4b62-aa94-6dce88054f18
27272024-10-01T02:33:17.931ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 3dfd7033-71d8-4eb9-bb97-49dae3b5cd35
27282024-10-01T02:33:17.931ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = 58cf44de-60f8-4b62-aa94-6dce88054f18
27292024-10-01T02:33:17.936ZDEBGnexus (SagaExecutor): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true roles = RoleSet { roles: {} } saga_id = 58cf44de-60f8-4b62-aa94-6dce88054f18 saga_name = disk-create saga_node = CreateDiskRecord
27302024-10-01T02:33:17.937ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true resource = Database result = Ok(()) saga_id = 58cf44de-60f8-4b62-aa94-6dce88054f18 saga_name = disk-create saga_node = CreateDiskRecord
27312024-10-01T02:33:17.938ZDEBGnexus (SagaExecutor): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true roles = RoleSet { roles: {} } saga_id = 58cf44de-60f8-4b62-aa94-6dce88054f18 saga_name = disk-create saga_node = CreateDiskRecord
27322024-10-01T02:33:17.939ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true resource = Database result = Ok(()) saga_id = 58cf44de-60f8-4b62-aa94-6dce88054f18 saga_name = disk-create saga_node = CreateDiskRecord
27332024-10-01T02:33:17.940ZDEBGnexus (SagaExecutor): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true roles = RoleSet { roles: {} } saga_id = 58cf44de-60f8-4b62-aa94-6dce88054f18 saga_name = disk-create saga_node = CreateDiskRecord
27342024-10-01T02:33:17.940ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true resource = Database result = Ok(()) saga_id = 58cf44de-60f8-4b62-aa94-6dce88054f18 saga_name = disk-create saga_node = CreateDiskRecord
27352024-10-01T02:33:17.943ZDEBGnexus (SagaExecutor): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true roles = RoleSet { roles: {} } saga_id = 58cf44de-60f8-4b62-aa94-6dce88054f18 saga_name = disk-create saga_node = CreateDiskRecord
27362024-10-01T02:33:17.943ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true resource = Database result = Ok(()) saga_id = 58cf44de-60f8-4b62-aa94-6dce88054f18 saga_name = disk-create saga_node = CreateDiskRecord
27372024-10-01T02:33:17.946ZDEBGnexus (SagaExecutor): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true roles = RoleSet { roles: {} } saga_id = 58cf44de-60f8-4b62-aa94-6dce88054f18 saga_name = disk-create saga_node = CreateDiskRecord
27382024-10-01T02:33:17.946ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true resource = Database result = Ok(()) saga_id = 58cf44de-60f8-4b62-aa94-6dce88054f18 saga_name = disk-create saga_node = CreateDiskRecord
27392024-10-01T02:33:17.948ZDEBGnexus (SagaExecutor): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true roles = RoleSet { roles: {} } saga_id = 58cf44de-60f8-4b62-aa94-6dce88054f18 saga_name = disk-create saga_node = CreateDiskRecord
27402024-10-01T02:33:17.949ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true resource = Database result = Ok(()) saga_id = 58cf44de-60f8-4b62-aa94-6dce88054f18 saga_name = disk-create saga_node = CreateDiskRecord
27412024-10-01T02:33:17.950ZDEBGnexus (SagaExecutor): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true roles = RoleSet { roles: {(Silo, 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, "admin")} } saga_id = 58cf44de-60f8-4b62-aa94-6dce88054f18 saga_name = disk-create saga_node = CreateDiskRecord
27422024-10-01T02:33:17.953ZDEBGnexus (SagaExecutor): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true resource = Project { parent: Silo { parent: Fleet, key: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, lookup_type: ById(21983b87-d6d0-47c6-a33c-5fe68fbed0c6) }, key: d6cd5e95-82db-413f-aa24-4fc56edfc65a, lookup_type: ById(d6cd5e95-82db-413f-aa24-4fc56edfc65a) } result = Ok(()) saga_id = 58cf44de-60f8-4b62-aa94-6dce88054f18 saga_name = disk-create saga_node = CreateDiskRecord
27432024-10-01T02:33:17.953ZDEBGnexus (SagaExecutor): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true roles = RoleSet { roles: {} } saga_id = 58cf44de-60f8-4b62-aa94-6dce88054f18 saga_name = disk-create saga_node = CreateDiskRecord
27442024-10-01T02:33:17.953ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true resource = Database result = Ok(()) saga_id = 58cf44de-60f8-4b62-aa94-6dce88054f18 saga_name = disk-create saga_node = CreateDiskRecord
27452024-10-01T02:33:17.955ZDEBGnexus (SagaExecutor): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true roles = RoleSet { roles: {} } saga_id = 58cf44de-60f8-4b62-aa94-6dce88054f18 saga_name = disk-create saga_node = CreateDiskRecord
27462024-10-01T02:33:17.956ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true resource = Database result = Ok(()) saga_id = 58cf44de-60f8-4b62-aa94-6dce88054f18 saga_name = disk-create saga_node = CreateDiskRecord
27472024-10-01T02:33:17.958ZDEBGnexus (SagaExecutor): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true roles = RoleSet { roles: {} } saga_id = 58cf44de-60f8-4b62-aa94-6dce88054f18 saga_name = disk-create saga_node = CreateDiskRecord
27482024-10-01T02:33:17.958ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true resource = Database result = Ok(()) saga_id = 58cf44de-60f8-4b62-aa94-6dce88054f18 saga_name = disk-create saga_node = CreateDiskRecord
27492024-10-01T02:33:17.961ZDEBGnexus (SagaExecutor): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true roles = RoleSet { roles: {} } saga_id = 58cf44de-60f8-4b62-aa94-6dce88054f18 saga_name = disk-create saga_node = CreateDiskRecord
27502024-10-01T02:33:17.961ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true resource = Database result = Ok(()) saga_id = 58cf44de-60f8-4b62-aa94-6dce88054f18 saga_name = disk-create saga_node = CreateDiskRecord
27512024-10-01T02:33:17.963ZDEBGnexus (SagaExecutor): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true roles = RoleSet { roles: {(Silo, 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, "admin")} } saga_id = 58cf44de-60f8-4b62-aa94-6dce88054f18 saga_name = disk-create saga_node = CreateDiskRecord
27522024-10-01T02:33:17.966ZDEBGnexus (SagaExecutor): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true resource = Project { parent: Silo { parent: Fleet, key: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, lookup_type: ById(21983b87-d6d0-47c6-a33c-5fe68fbed0c6) }, key: d6cd5e95-82db-413f-aa24-4fc56edfc65a, lookup_type: ById(d6cd5e95-82db-413f-aa24-4fc56edfc65a) } result = Ok(()) saga_id = 58cf44de-60f8-4b62-aa94-6dce88054f18 saga_name = disk-create saga_node = CreateDiskRecord
27532024-10-01T02:33:17.966ZDEBGnexus (SagaExecutor): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true roles = RoleSet { roles: {} } saga_id = 58cf44de-60f8-4b62-aa94-6dce88054f18 saga_name = disk-create saga_node = CreateDiskRecord
27542024-10-01T02:33:17.966ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true resource = Database result = Ok(()) saga_id = 58cf44de-60f8-4b62-aa94-6dce88054f18 saga_name = disk-create saga_node = CreateDiskRecord
27552024-10-01T02:33:18.005ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 3dfd7033-71d8-4eb9-bb97-49dae3b5cd35
27562024-10-01T02:33:18.005ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"block_size": String("Traditional"), "create_image_id": Null, "create_snapshot_id": Null, "identity": Object {"description": String(""), "id": String("d13374f1-0b40-45c0-a61c-44a143e318c6"), "name": String("disk-c068ffa3994"), "time_created": String("2024-10-01T02:33:17.936914Z"), "time_deleted": Null, "time_modified": String("2024-10-01T02:33:17.936914Z")}, "pantry_address": Null, "project_id": String("d6cd5e95-82db-413f-aa24-4fc56edfc65a"), "rcgen": Number(1), "runtime_state": Object {"attach_instance_id": Null, "disk_state": String("creating"), "gen": Number(1), "time_updated": String("2024-10-01T02:33:17.936914Z")}, "size": Number(1073741824), "slot": Null, "volume_id": String("a226f189-e7bc-4f2c-91d2-964190ce00d5")}) node_id = 2 saga_id = 58cf44de-60f8-4b62-aa94-6dce88054f18
27572024-10-01T02:33:18.016ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 3dfd7033-71d8-4eb9-bb97-49dae3b5cd35
27582024-10-01T02:33:18.016ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = 58cf44de-60f8-4b62-aa94-6dce88054f18
27592024-10-01T02:33:18.022ZDEBGnexus (SagaExecutor): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true roles = RoleSet { roles: {} } saga_id = 58cf44de-60f8-4b62-aa94-6dce88054f18 saga_name = disk-create saga_node = RegionsAlloc
27602024-10-01T02:33:18.023ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true resource = Database result = Ok(()) saga_id = 58cf44de-60f8-4b62-aa94-6dce88054f18 saga_name = disk-create saga_node = RegionsAlloc
27612024-10-01T02:33:18.207ZINFOnexus (datastore): Allocated regions for volume datasets_and_regions = [(Dataset { identity: DatasetIdentity { id: 3ae874d1-bf62-481b-aa5f-911ac7586252, time_created: 2024-10-01T02:33:12.369787Z, time_modified: 2024-10-01T02:33:12.369787Z }, time_deleted: None, rcgen: Generation(Generation(1)), pool_id: 4b58fe92-3fb4-46b4-9ea6-d620062bf2a1, ip: Some(fd00:1122:3344:101::17), port: Some(SqlU16(32345)), kind: Crucible, size_used: Some(1073741824), zone_name: None }, Region { identity: RegionIdentity { id: 28d06100-4e68-474d-b873-deb6fdd61240, time_created: 2024-10-01T02:33:18.042477Z, time_modified: 2024-10-01T02:33:18.042477Z }, dataset_id: 3ae874d1-bf62-481b-aa5f-911ac7586252, volume_id: a226f189-e7bc-4f2c-91d2-964190ce00d5, block_size: ByteCount(ByteCount(512)), blocks_per_extent: 131072, extent_count: 16, port: None, read_only: false }), (Dataset { identity: DatasetIdentity { id: 99df6194-3c68-48e6-a934-d49d19c5c7ee, time_created: 2024-10-01T02:33:12.369788Z, time_modified: 2024-10-01T02:33:12.369788Z }, time_deleted: None, rcgen: Generation(Generation(1)), pool_id: 841bd0ff-a375-452e-9289-601e29937aad, ip: Some(fd00:1122:3344:101::1a), port: Some(SqlU16(32345)), kind: Crucible, size_used: Some(1073741824), zone_name: None }, Region { identity: RegionIdentity { id: d8cee27b-e338-458d-aea5-933a14aa9c1f, time_created: 2024-10-01T02:33:18.042477Z, time_modified: 2024-10-01T02:33:18.042477Z }, dataset_id: 99df6194-3c68-48e6-a934-d49d19c5c7ee, volume_id: a226f189-e7bc-4f2c-91d2-964190ce00d5, block_size: ByteCount(ByteCount(512)), blocks_per_extent: 131072, extent_count: 16, port: None, read_only: false }), (Dataset { identity: DatasetIdentity { id: 9cf5c3af-b82a-4f8e-8aba-3e39ebd2b64a, time_created: 2024-10-01T02:33:12.369787Z, time_modified: 2024-10-01T02:33:12.369787Z }, time_deleted: None, rcgen: Generation(Generation(1)), pool_id: ee22443f-adfe-4fb0-bef1-d9b053b6a9d8, ip: Some(fd00:1122:3344:101::18), port: Some(SqlU16(32345)), kind: Crucible, size_used: Some(1073741824), zone_name: None }, Region { identity: RegionIdentity { id: 02ec91fc-0164-464a-b618-4ccc908bd42e, time_created: 2024-10-01T02:33:18.042477Z, time_modified: 2024-10-01T02:33:18.042477Z }, dataset_id: 9cf5c3af-b82a-4f8e-8aba-3e39ebd2b64a, volume_id: a226f189-e7bc-4f2c-91d2-964190ce00d5, block_size: ByteCount(ByteCount(512)), blocks_per_extent: 131072, extent_count: 16, port: None, read_only: false })] file = nexus/db-queries/src/db/datastore/region.rs:280 maybe_snapshot_id = None volume_id = a226f189-e7bc-4f2c-91d2-964190ce00d5
27622024-10-01T02:33:18.207ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 3dfd7033-71d8-4eb9-bb97-49dae3b5cd35
27632024-10-01T02:33:18.207ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Array [Array [Object {"identity": Object {"id": String("3ae874d1-bf62-481b-aa5f-911ac7586252"), "time_created": String("2024-10-01T02:33:12.369787Z"), "time_modified": String("2024-10-01T02:33:12.369787Z")}, "ip": String("fd00:1122:3344:101::17"), "kind": String("Crucible"), "pool_id": String("4b58fe92-3fb4-46b4-9ea6-d620062bf2a1"), "port": Number(32345), "rcgen": Number(1), "size_used": Number(1073741824), "time_deleted": Null, "zone_name": Null}, Object {"block_size": Number(512), "blocks_per_extent": Number(131072), "dataset_id": String("3ae874d1-bf62-481b-aa5f-911ac7586252"), "extent_count": Number(16), "identity": Object {"id": String("28d06100-4e68-474d-b873-deb6fdd61240"), "time_created": String("2024-10-01T02:33:18.042477Z"), "time_modified": String("2024-10-01T02:33:18.042477Z")}, "port": Null, "read_only": Bool(false), "volume_id": String("a226f189-e7bc-4f2c-91d2-964190ce00d5")}], Array [Object {"identity": Object {"id": String("99df6194-3c68-48e6-a934-d49d19c5c7ee"), "time_created": String("2024-10-01T02:33:12.369788Z"), "time_modified": String("2024-10-01T02:33:12.369788Z")}, "ip": String("fd00:1122:3344:101::1a"), "kind": String("Crucible"), "pool_id": String("841bd0ff-a375-452e-9289-601e29937aad"), "port": Number(32345), "rcgen": Number(1), "size_used": Number(1073741824), "time_deleted": Null, "zone_name": Null}, Object {"block_size": Number(512), "blocks_per_extent": Number(131072), "dataset_id": String("99df6194-3c68-48e6-a934-d49d19c5c7ee"), "extent_count": Number(16), "identity": Object {"id": String("d8cee27b-e338-458d-aea5-933a14aa9c1f"), "time_created": String("2024-10-01T02:33:18.042477Z"), "time_modified": String("2024-10-01T02:33:18.042477Z")}, "port": Null, "read_only": Bool(false), "volume_id": String("a226f189-e7bc-4f2c-91d2-964190ce00d5")}], Array [Object {"identity": Object {"id": String("9cf5c3af-b82a-4f8e-8aba-3e39ebd2b64a"), "time_created": String("2024-10-01T02:33:12.369787Z"), "time_modified": String("2024-10-01T02:33:12.369787Z")}, "ip": String("fd00:1122:3344:101::18"), "kind": String("Crucible"), "pool_id": String("ee22443f-adfe-4fb0-bef1-d9b053b6a9d8"), "port": Number(32345), "rcgen": Number(1), "size_used": Number(1073741824), "time_deleted": Null, "zone_name": Null}, Object {"block_size": Number(512), "blocks_per_extent": Number(131072), "dataset_id": String("9cf5c3af-b82a-4f8e-8aba-3e39ebd2b64a"), "extent_count": Number(16), "identity": Object {"id": String("02ec91fc-0164-464a-b618-4ccc908bd42e"), "time_created": String("2024-10-01T02:33:18.042477Z"), "time_modified": String("2024-10-01T02:33:18.042477Z")}, "port": Null, "read_only": Bool(false), "volume_id": String("a226f189-e7bc-4f2c-91d2-964190ce00d5")}]]) node_id = 3 saga_id = 58cf44de-60f8-4b62-aa94-6dce88054f18
27642024-10-01T02:33:18.214ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 3dfd7033-71d8-4eb9-bb97-49dae3b5cd35
27652024-10-01T02:33:18.214ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = 58cf44de-60f8-4b62-aa94-6dce88054f18
27662024-10-01T02:33:18.219ZDEBGnexus (SagaExecutor): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true roles = RoleSet { roles: {} } saga_id = 58cf44de-60f8-4b62-aa94-6dce88054f18 saga_name = disk-create saga_node = SpaceAccount
27672024-10-01T02:33:18.219ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true resource = Database result = Ok(()) saga_id = 58cf44de-60f8-4b62-aa94-6dce88054f18 saga_name = disk-create saga_node = SpaceAccount
27682024-10-01T02:33:18.267ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 3dfd7033-71d8-4eb9-bb97-49dae3b5cd35
27692024-10-01T02:33:18.267ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = 58cf44de-60f8-4b62-aa94-6dce88054f18
27702024-10-01T02:33:18.274ZDEBGnexus (SEC): saga log event new_state = N005 started sec_id = 3dfd7033-71d8-4eb9-bb97-49dae3b5cd35
27712024-10-01T02:33:18.274ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 5 saga_id = 58cf44de-60f8-4b62-aa94-6dce88054f18
27722024-10-01T02:33:18.280ZDEBGnexus (SEC): saga log event new_state = N005 succeeded sec_id = 3dfd7033-71d8-4eb9-bb97-49dae3b5cd35
27732024-10-01T02:33:18.280ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 5 saga_id = 58cf44de-60f8-4b62-aa94-6dce88054f18
27742024-10-01T02:33:18.289ZDEBGnexus (SEC): saga log event new_state = N006 started sec_id = 3dfd7033-71d8-4eb9-bb97-49dae3b5cd35
27752024-10-01T02:33:18.289ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 6 saga_id = 58cf44de-60f8-4b62-aa94-6dce88054f18
27762024-10-01T02:33:18.344ZWARNnexus (SagaExecutor): Region requested, not yet created. Retrying in 313.502222ms dataset = 3ae874d1-bf62-481b-aa5f-911ac7586252 file = nexus/src/app/crucible.rs:230 region = 28d06100-4e68-474d-b873-deb6fdd61240 saga_id = 58cf44de-60f8-4b62-aa94-6dce88054f18 saga_name = disk-create
27772024-10-01T02:33:18.350ZWARNnexus (SagaExecutor): Region requested, not yet created. Retrying in 167.610935ms dataset = 9cf5c3af-b82a-4f8e-8aba-3e39ebd2b64a file = nexus/src/app/crucible.rs:230 region = 02ec91fc-0164-464a-b618-4ccc908bd42e saga_id = 58cf44de-60f8-4b62-aa94-6dce88054f18 saga_name = disk-create
27782024-10-01T02:33:18.371ZWARNnexus (SagaExecutor): Region requested, not yet created. Retrying in 178.381428ms dataset = 99df6194-3c68-48e6-a934-d49d19c5c7ee file = nexus/src/app/crucible.rs:230 region = d8cee27b-e338-458d-aea5-933a14aa9c1f saga_id = 58cf44de-60f8-4b62-aa94-6dce88054f18 saga_name = disk-create
27792024-10-01T02:33:18.527ZWARNnexus (SagaExecutor): Region requested, not yet created. Retrying in 609.230494ms dataset = 9cf5c3af-b82a-4f8e-8aba-3e39ebd2b64a file = nexus/src/app/crucible.rs:230 region = 02ec91fc-0164-464a-b618-4ccc908bd42e saga_id = 58cf44de-60f8-4b62-aa94-6dce88054f18 saga_name = disk-create
27802024-10-01T02:33:18.555ZWARNnexus (SagaExecutor): Region requested, not yet created. Retrying in 580.009305ms dataset = 99df6194-3c68-48e6-a934-d49d19c5c7ee file = nexus/src/app/crucible.rs:230 region = d8cee27b-e338-458d-aea5-933a14aa9c1f saga_id = 58cf44de-60f8-4b62-aa94-6dce88054f18 saga_name = disk-create
27812024-10-01T02:33:19.162ZDEBGnexus (SEC): saga log event new_state = N006 succeeded sec_id = 3dfd7033-71d8-4eb9-bb97-49dae3b5cd35
27822024-10-01T02:33:19.162ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("{\\"type\\":\\"volume\\",\\"block_size\\":512,\\"id\\":\\"d13374f1-0b40-45c0-a61c-44a143e318c6\\",\\"sub_volumes\\":[{\\"type\\":\\"region\\",\\"block_size\\":512,\\"blocks_per_extent\\":131072,\\"extent_count\\":16,\\"gen\\":1,\\"opts\\":{\\"id\\":\\"d13374f1-0b40-45c0-a61c-44a143e318c6\\",\\"key\\":\\"2YxNXKt9TkYk9xp3tWGuJaEsHrMN+7uHCZfEXlsWj+4=\\",\\"lossy\\":false,\\"read_only\\":false,\\"target\\":[\\"[fd00:1122:3344:101::17]:19000\\",\\"[fd00:1122:3344:101::1a]:19000\\",\\"[fd00:1122:3344:101::18]:19000\\"]}}]}")) node_id = 6 saga_id = 58cf44de-60f8-4b62-aa94-6dce88054f18
27832024-10-01T02:33:19.168ZDEBGnexus (SEC): saga log event new_state = N007 started sec_id = 3dfd7033-71d8-4eb9-bb97-49dae3b5cd35
27842024-10-01T02:33:19.168ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 7 saga_id = 58cf44de-60f8-4b62-aa94-6dce88054f18
27852024-10-01T02:33:19.202ZDEBGnexus (SEC): saga log event new_state = N007 succeeded sec_id = 3dfd7033-71d8-4eb9-bb97-49dae3b5cd35
27862024-10-01T02:33:19.202ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 7 saga_id = 58cf44de-60f8-4b62-aa94-6dce88054f18
27872024-10-01T02:33:19.208ZDEBGnexus (SEC): saga log event new_state = N008 started sec_id = 3dfd7033-71d8-4eb9-bb97-49dae3b5cd35
27882024-10-01T02:33:19.208ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 8 saga_id = 58cf44de-60f8-4b62-aa94-6dce88054f18
27892024-10-01T02:33:19.213ZDEBGnexus (SagaExecutor): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true roles = RoleSet { roles: {} } saga_id = 58cf44de-60f8-4b62-aa94-6dce88054f18 saga_name = disk-create saga_node = FinalizeDiskRecord
27902024-10-01T02:33:19.213ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true resource = Database result = Ok(()) saga_id = 58cf44de-60f8-4b62-aa94-6dce88054f18 saga_name = disk-create saga_node = FinalizeDiskRecord
27912024-10-01T02:33:19.216ZDEBGnexus (SagaExecutor): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true roles = RoleSet { roles: {} } saga_id = 58cf44de-60f8-4b62-aa94-6dce88054f18 saga_name = disk-create saga_node = FinalizeDiskRecord
27922024-10-01T02:33:19.216ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true resource = Database result = Ok(()) saga_id = 58cf44de-60f8-4b62-aa94-6dce88054f18 saga_name = disk-create saga_node = FinalizeDiskRecord
27932024-10-01T02:33:19.217ZDEBGnexus (SagaExecutor): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true roles = RoleSet { roles: {} } saga_id = 58cf44de-60f8-4b62-aa94-6dce88054f18 saga_name = disk-create saga_node = FinalizeDiskRecord
27942024-10-01T02:33:19.218ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true resource = Database result = Ok(()) saga_id = 58cf44de-60f8-4b62-aa94-6dce88054f18 saga_name = disk-create saga_node = FinalizeDiskRecord
27952024-10-01T02:33:19.219ZDEBGnexus (SagaExecutor): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true roles = RoleSet { roles: {} } saga_id = 58cf44de-60f8-4b62-aa94-6dce88054f18 saga_name = disk-create saga_node = FinalizeDiskRecord
27962024-10-01T02:33:19.219ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true resource = Database result = Ok(()) saga_id = 58cf44de-60f8-4b62-aa94-6dce88054f18 saga_name = disk-create saga_node = FinalizeDiskRecord
27972024-10-01T02:33:19.222ZDEBGnexus (SagaExecutor): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true roles = RoleSet { roles: {} } saga_id = 58cf44de-60f8-4b62-aa94-6dce88054f18 saga_name = disk-create saga_node = FinalizeDiskRecord
27982024-10-01T02:33:19.222ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true resource = Database result = Ok(()) saga_id = 58cf44de-60f8-4b62-aa94-6dce88054f18 saga_name = disk-create saga_node = FinalizeDiskRecord
27992024-10-01T02:33:19.225ZDEBGnexus (SagaExecutor): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true roles = RoleSet { roles: {} } saga_id = 58cf44de-60f8-4b62-aa94-6dce88054f18 saga_name = disk-create saga_node = FinalizeDiskRecord
28002024-10-01T02:33:19.225ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true resource = Database result = Ok(()) saga_id = 58cf44de-60f8-4b62-aa94-6dce88054f18 saga_name = disk-create saga_node = FinalizeDiskRecord
28012024-10-01T02:33:19.228ZDEBGnexus (SagaExecutor): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true roles = RoleSet { roles: {} } saga_id = 58cf44de-60f8-4b62-aa94-6dce88054f18 saga_name = disk-create saga_node = FinalizeDiskRecord
28022024-10-01T02:33:19.228ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true resource = Database result = Ok(()) saga_id = 58cf44de-60f8-4b62-aa94-6dce88054f18 saga_name = disk-create saga_node = FinalizeDiskRecord
28032024-10-01T02:33:19.231ZDEBGnexus (SagaExecutor): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true roles = RoleSet { roles: {(Silo, 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, "admin")} } saga_id = 58cf44de-60f8-4b62-aa94-6dce88054f18 saga_name = disk-create saga_node = FinalizeDiskRecord
28042024-10-01T02:33:19.234ZDEBGnexus (SagaExecutor): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true resource = Disk { parent: Project { parent: Silo { parent: Fleet, key: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, lookup_type: ById(21983b87-d6d0-47c6-a33c-5fe68fbed0c6) }, key: d6cd5e95-82db-413f-aa24-4fc56edfc65a, lookup_type: ById(d6cd5e95-82db-413f-aa24-4fc56edfc65a) }, key: d13374f1-0b40-45c0-a61c-44a143e318c6, lookup_type: ById(d13374f1-0b40-45c0-a61c-44a143e318c6) } result = Ok(()) saga_id = 58cf44de-60f8-4b62-aa94-6dce88054f18 saga_name = disk-create saga_node = FinalizeDiskRecord
28052024-10-01T02:33:19.234ZDEBGnexus (SagaExecutor): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true roles = RoleSet { roles: {} } saga_id = 58cf44de-60f8-4b62-aa94-6dce88054f18 saga_name = disk-create saga_node = FinalizeDiskRecord
28062024-10-01T02:33:19.234ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true resource = Database result = Ok(()) saga_id = 58cf44de-60f8-4b62-aa94-6dce88054f18 saga_name = disk-create saga_node = FinalizeDiskRecord
28072024-10-01T02:33:19.237ZDEBGnexus (SagaExecutor): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true roles = RoleSet { roles: {} } saga_id = 58cf44de-60f8-4b62-aa94-6dce88054f18 saga_name = disk-create saga_node = FinalizeDiskRecord
28082024-10-01T02:33:19.238ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true resource = Database result = Ok(()) saga_id = 58cf44de-60f8-4b62-aa94-6dce88054f18 saga_name = disk-create saga_node = FinalizeDiskRecord
28092024-10-01T02:33:19.239ZDEBGnexus (SagaExecutor): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true roles = RoleSet { roles: {} } saga_id = 58cf44de-60f8-4b62-aa94-6dce88054f18 saga_name = disk-create saga_node = FinalizeDiskRecord
28102024-10-01T02:33:19.239ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true resource = Database result = Ok(()) saga_id = 58cf44de-60f8-4b62-aa94-6dce88054f18 saga_name = disk-create saga_node = FinalizeDiskRecord
28112024-10-01T02:33:19.242ZDEBGnexus (SagaExecutor): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true roles = RoleSet { roles: {} } saga_id = 58cf44de-60f8-4b62-aa94-6dce88054f18 saga_name = disk-create saga_node = FinalizeDiskRecord
28122024-10-01T02:33:19.242ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true resource = Database result = Ok(()) saga_id = 58cf44de-60f8-4b62-aa94-6dce88054f18 saga_name = disk-create saga_node = FinalizeDiskRecord
28132024-10-01T02:33:19.244ZDEBGnexus (SagaExecutor): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true roles = RoleSet { roles: {(Silo, 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, "admin")} } saga_id = 58cf44de-60f8-4b62-aa94-6dce88054f18 saga_name = disk-create saga_node = FinalizeDiskRecord
28142024-10-01T02:33:19.247ZDEBGnexus (SagaExecutor): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true resource = Disk { parent: Project { parent: Silo { parent: Fleet, key: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, lookup_type: ById(21983b87-d6d0-47c6-a33c-5fe68fbed0c6) }, key: d6cd5e95-82db-413f-aa24-4fc56edfc65a, lookup_type: ById(d6cd5e95-82db-413f-aa24-4fc56edfc65a) }, key: d13374f1-0b40-45c0-a61c-44a143e318c6, lookup_type: ById(d13374f1-0b40-45c0-a61c-44a143e318c6) } result = Ok(()) saga_id = 58cf44de-60f8-4b62-aa94-6dce88054f18 saga_name = disk-create saga_node = FinalizeDiskRecord
28152024-10-01T02:33:19.247ZDEBGnexus (SagaExecutor): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true roles = RoleSet { roles: {} } saga_id = 58cf44de-60f8-4b62-aa94-6dce88054f18 saga_name = disk-create saga_node = FinalizeDiskRecord
28162024-10-01T02:33:19.247ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true resource = Database result = Ok(()) saga_id = 58cf44de-60f8-4b62-aa94-6dce88054f18 saga_name = disk-create saga_node = FinalizeDiskRecord
28172024-10-01T02:33:19.265ZDEBGnexus (SEC): saga log event new_state = N008 succeeded sec_id = 3dfd7033-71d8-4eb9-bb97-49dae3b5cd35
28182024-10-01T02:33:19.265ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 8 saga_id = 58cf44de-60f8-4b62-aa94-6dce88054f18
28192024-10-01T02:33:19.271ZDEBGnexus (SEC): saga log event new_state = N010 started sec_id = 3dfd7033-71d8-4eb9-bb97-49dae3b5cd35
28202024-10-01T02:33:19.271ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 10 saga_id = 58cf44de-60f8-4b62-aa94-6dce88054f18
28212024-10-01T02:33:19.279ZDEBGnexus (SEC): saga log event new_state = N010 succeeded sec_id = 3dfd7033-71d8-4eb9-bb97-49dae3b5cd35
28222024-10-01T02:33:19.279ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 10 saga_id = 58cf44de-60f8-4b62-aa94-6dce88054f18
28232024-10-01T02:33:19.285ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = 58cf44de-60f8-4b62-aa94-6dce88054f18 sec_id = 3dfd7033-71d8-4eb9-bb97-49dae3b5cd35
28242024-10-01T02:33:19.285ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = 58cf44de-60f8-4b62-aa94-6dce88054f18
28252024-10-01T02:33:19.305ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = 58cf44de-60f8-4b62-aa94-6dce88054f18 saga_name = disk-create sec_id = 3dfd7033-71d8-4eb9-bb97-49dae3b5cd35
28262024-10-01T02:33:19.305ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = 58cf44de-60f8-4b62-aa94-6dce88054f18 saga_name = disk-create saga_result = SagaResult { saga_id: 58cf44de-60f8-4b62-aa94-6dce88054f18, saga_log: SagaLog { saga_id: 58cf44de-60f8-4b62-aa94-6dce88054f18, unwinding: false, events: [N009 started, N009 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N003 started, N003 succeeded, N004 started, N004 succeeded, N005 started, N005 succeeded, N006 started, N006 succeeded, N007 started, N007 succeeded, N008 started, N008 succeeded, N010 started, N010 succeeded], node_status: {0: Succeeded(String("d13374f1-0b40-45c0-a61c-44a143e318c6")), 1: Succeeded(String("a226f189-e7bc-4f2c-91d2-964190ce00d5")), 2: Succeeded(Object {"block_size": String("Traditional"), "create_image_id": Null, "create_snapshot_id": Null, "identity": Object {"description": String(""), "id": String("d13374f1-0b40-45c0-a61c-44a143e318c6"), "name": String("disk-c068ffa3994"), "time_created": String("2024-10-01T02:33:17.936914Z"), "time_deleted": Null, "time_modified": String("2024-10-01T02:33:17.936914Z")}, "pantry_address": Null, "project_id": String("d6cd5e95-82db-413f-aa24-4fc56edfc65a"), "rcgen": Number(1), "runtime_state": Object {"attach_instance_id": Null, "disk_state": String("creating"), "gen": Number(1), "time_updated": String("2024-10-01T02:33:17.936914Z")}, "size": Number(1073741824), "slot": Null, "volume_id": String("a226f189-e7bc-4f2c-91d2-964190ce00d5")}), 3: Succeeded(Array [Array [Object {"identity": Object {"id": String("3ae874d1-bf62-481b-aa5f-911ac7586252"), "time_created": String("2024-10-01T02:33:12.369787Z"), "time_modified": String("2024-10-01T02:33:12.369787Z")}, "ip": String("fd00:1122:3344:101::17"), "kind": String("Crucible"), "pool_id": String("4b58fe92-3fb4-46b4-9ea6-d620062bf2a1"), "port": Number(32345), "rcgen": Number(1), "size_used": Number(1073741824), "time_deleted": Null, "zone_name": Null}, Object {"block_size": Number(512), "blocks_per_extent": Number(131072), "dataset_id": String("3ae874d1-bf62-481b-aa5f-911ac7586252"), "extent_count": Number(16), "identity": Object {"id": String("28d06100-4e68-474d-b873-deb6fdd61240"), "time_created": String("2024-10-01T02:33:18.042477Z"), "time_modified": String("2024-10-01T02:33:18.042477Z")}, "port": Null, "read_only": Bool(false), "volume_id": String("a226f189-e7bc-4f2c-91d2-964190ce00d5")}], Array [Object {"identity": Object {"id": String("99df6194-3c68-48e6-a934-d49d19c5c7ee"), "time_created": String("2024-10-01T02:33:12.369788Z"), "time_modified": String("2024-10-01T02:33:12.369788Z")}, "ip": String("fd00:1122:3344:101::1a"), "kind": String("Crucible"), "pool_id": String("841bd0ff-a375-452e-9289-601e29937aad"), "port": Number(32345), "rcgen": Number(1), "size_used": Number(1073741824), "time_deleted": Null, "zone_name": Null}, Object {"block_size": Number(512), "blocks_per_extent": Number(131072), "dataset_id": String("99df6194-3c68-48e6-a934-d49d19c5c7ee"), "extent_count": Number(16), "identity": Object {"id": String("d8cee27b-e338-458d-aea5-933a14aa9c1f"), "time_created": String("2024-10-01T02:33:18.042477Z"), "time_modified": String("2024-10-01T02:33:18.042477Z")}, "port": Null, "read_only": Bool(false), "volume_id": String("a226f189-e7bc-4f2c-91d2-964190ce00d5")}], Array [Object {"identity": Object {"id": String("9cf5c3af-b82a-4f8e-8aba-3e39ebd2b64a"), "time_created": String("2024-10-01T02:33:12.369787Z"), "time_modified": String("2024-10-01T02:33:12.369787Z")}, "ip": String("fd00:1122:3344:101::18"), "kind": String("Crucible"), "pool_id": String("ee22443f-adfe-4fb0-bef1-d9b053b6a9d8"), "port": Number(32345), "rcgen": Number(1), "size_used": Number(1073741824), "time_deleted": Null, "zone_name": Null}, Object {"block_size": Number(512), "blocks_per_extent": Number(131072), "dataset_id": String("9cf5c3af-b82a-4f8e-8aba-3e39ebd2b64a"), "extent_count": Number(16), "identity": Object {"id": String("02ec91fc-0164-464a-b618-4ccc908bd42e"), "time_created": String("2024-10-01T02:33:18.042477Z"), "time_modified": String("2024-10-01T02:33:18.042477Z")}, "port": Null, "read_only": Bool(false), "volume_id": String("a226f189-e7bc-4f2c-91d2-964190ce00d5")}]]), 4: Succeeded(Null), 5: Succeeded(Null), 6: Succeeded(String("{\\"type\\":\\"volume\\",\\"block_size\\":512,\\"id\\":\\"d13374f1-0b40-45c0-a61c-44a143e318c6\\",\\"sub_volumes\\":[{\\"type\\":\\"region\\",\\"block_size\\":512,\\"blocks_per_extent\\":131072,\\"extent_count\\":16,\\"gen\\":1,\\"opts\\":{\\"id\\":\\"d13374f1-0b40-45c0-a61c-44a143e318c6\\",\\"key\\":\\"2YxNXKt9TkYk9xp3tWGuJaEsHrMN+7uHCZfEXlsWj+4=\\",\\"lossy\\":false,\\"read_only\\":false,\\"target\\":[\\"[fd00:1122:3344:101::17]:19000\\",\\"[fd00:1122:3344:101::1a]:19000\\",\\"[fd00:1122:3344:101::18]:19000\\"]}}]}")), 7: Succeeded(Null), 8: Succeeded(Null), 9: Succeeded(Null), 10: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"created_disk": Object {"block_size": String("Traditional"), "create_image_id": Null, "create_snapshot_id": Null, "identity": Object {"description": String(""), "id": String("d13374f1-0b40-45c0-a61c-44a143e318c6"), "name": String("disk-c068ffa3994"), "time_created": String("2024-10-01T02:33:17.936914Z"), "time_deleted": Null, "time_modified": String("2024-10-01T02:33:17.936914Z")}, "pantry_address": Null, "project_id": String("d6cd5e95-82db-413f-aa24-4fc56edfc65a"), "rcgen": Number(1), "runtime_state": Object {"attach_instance_id": Null, "disk_state": String("creating"), "gen": Number(1), "time_updated": String("2024-10-01T02:33:17.936914Z")}, "size": Number(1073741824), "slot": Null, "volume_id": String("a226f189-e7bc-4f2c-91d2-964190ce00d5")}, "created_volume": Null, "datasets_and_regions": Array [Array [Object {"identity": Object {"id": String("3ae874d1-bf62-481b-aa5f-911ac7586252"), "time_created": String("2024-10-01T02:33:12.369787Z"), "time_modified": String("2024-10-01T02:33:12.369787Z")}, "ip": String("fd00:1122:3344:101::17"), "kind": String("Crucible"), "pool_id": String("4b58fe92-3fb4-46b4-9ea6-d620062bf2a1"), "port": Number(32345), "rcgen": Number(1), "size_used": Number(1073741824), "time_deleted": Null, "zone_name": Null}, Object {"block_size": Number(512), "blocks_per_extent": Number(131072), "dataset_id": String("3ae874d1-bf62-481b-aa5f-911ac7586252"), "extent_count": Number(16), "identity": Object {"id": String("28d06100-4e68-474d-b873-deb6fdd61240"), "time_created": String("2024-10-01T02:33:18.042477Z"), "time_modified": String("2024-10-01T02:33:18.042477Z")}, "port": Null, "read_only": Bool(false), "volume_id": String("a226f189-e7bc-4f2c-91d2-964190ce00d5")}], Array [Object {"identity": Object {"id": String("99df6194-3c68-48e6-a934-d49d19c5c7ee"), "time_created": String("2024-10-01T02:33:12.369788Z"), "time_modified": String("2024-10-01T02:33:12.369788Z")}, "ip": String("fd00:1122:3344:101::1a"), "kind": String("Crucible"), "pool_id": String("841bd0ff-a375-452e-9289-601e29937aad"), "port": Number(32345), "rcgen": Number(1), "size_used": Number(1073741824), "time_deleted": Null, "zone_name": Null}, Object {"block_size": Number(512), "blocks_per_extent": Number(131072), "dataset_id": String("99df6194-3c68-48e6-a934-d49d19c5c7ee"), "extent_count": Number(16), "identity": Object {"id": String("d8cee27b-e338-458d-aea5-933a14aa9c1f"), "time_created": String("2024-10-01T02:33:18.042477Z"), "time_modified": String("2024-10-01T02:33:18.042477Z")}, "port": Null, "read_only": Bool(false), "volume_id": String("a226f189-e7bc-4f2c-91d2-964190ce00d5")}], Array [Object {"identity": Object {"id": String("9cf5c3af-b82a-4f8e-8aba-3e39ebd2b64a"), "time_created": String("2024-10-01T02:33:12.369787Z"), "time_modified": String("2024-10-01T02:33:12.369787Z")}, "ip": String("fd00:1122:3344:101::18"), "kind": String("Crucible"), "pool_id": String("ee22443f-adfe-4fb0-bef1-d9b053b6a9d8"), "port": Number(32345), "rcgen": Number(1), "size_used": Number(1073741824), "time_deleted": Null, "zone_name": Null}, Object {"block_size": Number(512), "blocks_per_extent": Number(131072), "dataset_id": String("9cf5c3af-b82a-4f8e-8aba-3e39ebd2b64a"), "extent_count": Number(16), "identity": Object {"id": String("02ec91fc-0164-464a-b618-4ccc908bd42e"), "time_created": String("2024-10-01T02:33:18.042477Z"), "time_modified": String("2024-10-01T02:33:18.042477Z")}, "port": Null, "read_only": Bool(false), "volume_id": String("a226f189-e7bc-4f2c-91d2-964190ce00d5")}]], "disk_id": String("d13374f1-0b40-45c0-a61c-44a143e318c6"), "disk_runtime": Null, "no_result": Null, "regions_ensure": String("{\\"type\\":\\"volume\\",\\"block_size\\":512,\\"id\\":\\"d13374f1-0b40-45c0-a61c-44a143e318c6\\",\\"sub_volumes\\":[{\\"type\\":\\"region\\",\\"block_size\\":512,\\"blocks_per_extent\\":131072,\\"extent_count\\":16,\\"gen\\":1,\\"opts\\":{\\"id\\":\\"d13374f1-0b40-45c0-a61c-44a143e318c6\\",\\"key\\":\\"2YxNXKt9TkYk9xp3tWGuJaEsHrMN+7uHCZfEXlsWj+4=\\",\\"lossy\\":false,\\"read_only\\":false,\\"target\\":[\\"[fd00:1122:3344:101::17]:19000\\",\\"[fd00:1122:3344:101::1a]:19000\\",\\"[fd00:1122:3344:101::18]:19000\\"]}}]}"), "regions_ensure_undo": Null, "volume_id": String("a226f189-e7bc-4f2c-91d2-964190ce00d5")} }) }
28272024-10-01T02:33:19.305ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1509868 local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:49233 req_id = 00e94326-cd80-4d58-84d4-67c33eb89b5d response_code = 201 uri = /v1/disks?project=proj-815f1091374
28282024-10-01T02:33:19.308ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
28292024-10-01T02:33:19.308ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
28302024-10-01T02:33:19.309ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
28312024-10-01T02:33:19.310ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
28322024-10-01T02:33:19.311ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
28332024-10-01T02:33:19.313ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "b2603776c17391bc0ca280d341de87edae62e8df", lookup_type: ByCompositeId("token = \\"b2603776c17391bc0ca280d341de87edae62e8df\\"") } result = Ok(())
28342024-10-01T02:33:19.313ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
28352024-10-01T02:33:19.313ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
28362024-10-01T02:33:19.314ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
28372024-10-01T02:33:19.314ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
28382024-10-01T02:33:19.316ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
28392024-10-01T02:33:19.316ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
28402024-10-01T02:33:19.318ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
28412024-10-01T02:33:19.318ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
28422024-10-01T02:33:19.320ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
28432024-10-01T02:33:19.321ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, lookup_type: ById(21983b87-d6d0-47c6-a33c-5fe68fbed0c6) }, key: 8fbcb238-2807-4312-9499-49292447c1fc, lookup_type: ById(8fbcb238-2807-4312-9499-49292447c1fc) } result = Ok(())
28442024-10-01T02:33:19.321ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
28452024-10-01T02:33:19.321ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
28462024-10-01T02:33:19.323ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
28472024-10-01T02:33:19.324ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "b2603776c17391bc0ca280d341de87edae62e8df", lookup_type: ByCompositeId("b2603776c17391bc0ca280d341de87edae62e8df") } result = Ok(())
28482024-10-01T02:33:19.324ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
28492024-10-01T02:33:19.324ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
28502024-10-01T02:33:19.330ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
28512024-10-01T02:33:19.331ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
28522024-10-01T02:33:19.332ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
28532024-10-01T02:33:19.332ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
28542024-10-01T02:33:19.333ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
28552024-10-01T02:33:19.334ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
28562024-10-01T02:33:19.335ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
28572024-10-01T02:33:19.335ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
28582024-10-01T02:33:19.337ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
28592024-10-01T02:33:19.338ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, lookup_type: ById(21983b87-d6d0-47c6-a33c-5fe68fbed0c6) }, key: 8fbcb238-2807-4312-9499-49292447c1fc, lookup_type: ById(8fbcb238-2807-4312-9499-49292447c1fc) } result = Ok(())
28602024-10-01T02:33:19.338ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
28612024-10-01T02:33:19.338ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
28622024-10-01T02:33:19.339ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
28632024-10-01T02:33:19.339ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
28642024-10-01T02:33:19.341ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
28652024-10-01T02:33:19.341ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
28662024-10-01T02:33:19.342ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
28672024-10-01T02:33:19.343ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, lookup_type: ById(21983b87-d6d0-47c6-a33c-5fe68fbed0c6) } result = Ok(())
28682024-10-01T02:33:19.344ZDEBGnexus (dropshot_external): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49233 req_id = 7bf111aa-5550-47d0-9122-85e6d1a8f989 roles = RoleSet { roles: {} } uri = /v1/disks/disk-c068ffa3994?project=proj-815f1091374
28692024-10-01T02:33:19.344ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49233 req_id = 7bf111aa-5550-47d0-9122-85e6d1a8f989 resource = Database result = Ok(()) uri = /v1/disks/disk-c068ffa3994?project=proj-815f1091374
28702024-10-01T02:33:19.345ZDEBGnexus (dropshot_external): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49233 req_id = 7bf111aa-5550-47d0-9122-85e6d1a8f989 roles = RoleSet { roles: {} } uri = /v1/disks/disk-c068ffa3994?project=proj-815f1091374
28712024-10-01T02:33:19.345ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49233 req_id = 7bf111aa-5550-47d0-9122-85e6d1a8f989 resource = Database result = Ok(()) uri = /v1/disks/disk-c068ffa3994?project=proj-815f1091374
28722024-10-01T02:33:19.347ZDEBGnexus (dropshot_external): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49233 req_id = 7bf111aa-5550-47d0-9122-85e6d1a8f989 roles = RoleSet { roles: {} } uri = /v1/disks/disk-c068ffa3994?project=proj-815f1091374
28732024-10-01T02:33:19.348ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49233 req_id = 7bf111aa-5550-47d0-9122-85e6d1a8f989 resource = Database result = Ok(()) uri = /v1/disks/disk-c068ffa3994?project=proj-815f1091374
28742024-10-01T02:33:19.350ZDEBGnexus (dropshot_external): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49233 req_id = 7bf111aa-5550-47d0-9122-85e6d1a8f989 roles = RoleSet { roles: {} } uri = /v1/disks/disk-c068ffa3994?project=proj-815f1091374
28752024-10-01T02:33:19.350ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49233 req_id = 7bf111aa-5550-47d0-9122-85e6d1a8f989 resource = Database result = Ok(()) uri = /v1/disks/disk-c068ffa3994?project=proj-815f1091374
28762024-10-01T02:33:19.353ZDEBGnexus (dropshot_external): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49233 req_id = 7bf111aa-5550-47d0-9122-85e6d1a8f989 roles = RoleSet { roles: {} } uri = /v1/disks/disk-c068ffa3994?project=proj-815f1091374
28772024-10-01T02:33:19.353ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49233 req_id = 7bf111aa-5550-47d0-9122-85e6d1a8f989 resource = Database result = Ok(()) uri = /v1/disks/disk-c068ffa3994?project=proj-815f1091374
28782024-10-01T02:33:19.356ZDEBGnexus (dropshot_external): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49233 req_id = 7bf111aa-5550-47d0-9122-85e6d1a8f989 roles = RoleSet { roles: {} } uri = /v1/disks/disk-c068ffa3994?project=proj-815f1091374
28792024-10-01T02:33:19.356ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49233 req_id = 7bf111aa-5550-47d0-9122-85e6d1a8f989 resource = Database result = Ok(()) uri = /v1/disks/disk-c068ffa3994?project=proj-815f1091374
28802024-10-01T02:33:19.358ZDEBGnexus (dropshot_external): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49233 req_id = 7bf111aa-5550-47d0-9122-85e6d1a8f989 roles = RoleSet { roles: {} } uri = /v1/disks/disk-c068ffa3994?project=proj-815f1091374
28812024-10-01T02:33:19.359ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49233 req_id = 7bf111aa-5550-47d0-9122-85e6d1a8f989 resource = Database result = Ok(()) uri = /v1/disks/disk-c068ffa3994?project=proj-815f1091374
28822024-10-01T02:33:19.361ZDEBGnexus (dropshot_external): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49233 req_id = 7bf111aa-5550-47d0-9122-85e6d1a8f989 roles = RoleSet { roles: {(Silo, 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, "admin")} } uri = /v1/disks/disk-c068ffa3994?project=proj-815f1091374
28832024-10-01T02:33:19.364ZDEBGnexus (dropshot_external): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49233 req_id = 7bf111aa-5550-47d0-9122-85e6d1a8f989 resource = Disk { parent: Project { parent: Silo { parent: Fleet, key: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, lookup_type: ById(21983b87-d6d0-47c6-a33c-5fe68fbed0c6) }, key: d6cd5e95-82db-413f-aa24-4fc56edfc65a, lookup_type: ByName("proj-815f1091374") }, key: d13374f1-0b40-45c0-a61c-44a143e318c6, lookup_type: ByName("disk-c068ffa3994") } result = Ok(()) uri = /v1/disks/disk-c068ffa3994?project=proj-815f1091374
28842024-10-01T02:33:19.364ZDEBGnexus (dropshot_external): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49233 req_id = 7bf111aa-5550-47d0-9122-85e6d1a8f989 roles = RoleSet { roles: {} } uri = /v1/disks/disk-c068ffa3994?project=proj-815f1091374
28852024-10-01T02:33:19.364ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49233 req_id = 7bf111aa-5550-47d0-9122-85e6d1a8f989 resource = Database result = Ok(()) uri = /v1/disks/disk-c068ffa3994?project=proj-815f1091374
28862024-10-01T02:33:19.366ZDEBGnexus (dropshot_external): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49233 req_id = 7bf111aa-5550-47d0-9122-85e6d1a8f989 roles = RoleSet { roles: {} } uri = /v1/disks/disk-c068ffa3994?project=proj-815f1091374
28872024-10-01T02:33:19.366ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49233 req_id = 7bf111aa-5550-47d0-9122-85e6d1a8f989 resource = Database result = Ok(()) uri = /v1/disks/disk-c068ffa3994?project=proj-815f1091374
28882024-10-01T02:33:19.367ZDEBGnexus (dropshot_external): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49233 req_id = 7bf111aa-5550-47d0-9122-85e6d1a8f989 roles = RoleSet { roles: {} } uri = /v1/disks/disk-c068ffa3994?project=proj-815f1091374
28892024-10-01T02:33:19.367ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49233 req_id = 7bf111aa-5550-47d0-9122-85e6d1a8f989 resource = Database result = Ok(()) uri = /v1/disks/disk-c068ffa3994?project=proj-815f1091374
28902024-10-01T02:33:19.369ZDEBGnexus (dropshot_external): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49233 req_id = 7bf111aa-5550-47d0-9122-85e6d1a8f989 roles = RoleSet { roles: {} } uri = /v1/disks/disk-c068ffa3994?project=proj-815f1091374
28912024-10-01T02:33:19.369ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49233 req_id = 7bf111aa-5550-47d0-9122-85e6d1a8f989 resource = Database result = Ok(()) uri = /v1/disks/disk-c068ffa3994?project=proj-815f1091374
28922024-10-01T02:33:19.371ZDEBGnexus (dropshot_external): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49233 req_id = 7bf111aa-5550-47d0-9122-85e6d1a8f989 roles = RoleSet { roles: {} } uri = /v1/disks/disk-c068ffa3994?project=proj-815f1091374
28932024-10-01T02:33:19.371ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49233 req_id = 7bf111aa-5550-47d0-9122-85e6d1a8f989 resource = Database result = Ok(()) uri = /v1/disks/disk-c068ffa3994?project=proj-815f1091374
28942024-10-01T02:33:19.376ZDEBGnexus (dropshot_external): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49233 req_id = 7bf111aa-5550-47d0-9122-85e6d1a8f989 roles = RoleSet { roles: {} } uri = /v1/disks/disk-c068ffa3994?project=proj-815f1091374
28952024-10-01T02:33:19.377ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49233 req_id = 7bf111aa-5550-47d0-9122-85e6d1a8f989 resource = Database result = Ok(()) uri = /v1/disks/disk-c068ffa3994?project=proj-815f1091374
28962024-10-01T02:33:19.379ZDEBGnexus (dropshot_external): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49233 req_id = 7bf111aa-5550-47d0-9122-85e6d1a8f989 roles = RoleSet { roles: {} } uri = /v1/disks/disk-c068ffa3994?project=proj-815f1091374
28972024-10-01T02:33:19.379ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49233 req_id = 7bf111aa-5550-47d0-9122-85e6d1a8f989 resource = Database result = Ok(()) uri = /v1/disks/disk-c068ffa3994?project=proj-815f1091374
28982024-10-01T02:33:19.381ZDEBGnexus (dropshot_external): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49233 req_id = 7bf111aa-5550-47d0-9122-85e6d1a8f989 roles = RoleSet { roles: {(Silo, 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, "admin")} } uri = /v1/disks/disk-c068ffa3994?project=proj-815f1091374
28992024-10-01T02:33:19.385ZDEBGnexus (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49233 req_id = 7bf111aa-5550-47d0-9122-85e6d1a8f989 resource = Disk { parent: Project { parent: Silo { parent: Fleet, key: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, lookup_type: ById(21983b87-d6d0-47c6-a33c-5fe68fbed0c6) }, key: d6cd5e95-82db-413f-aa24-4fc56edfc65a, lookup_type: ById(d6cd5e95-82db-413f-aa24-4fc56edfc65a) }, key: d13374f1-0b40-45c0-a61c-44a143e318c6, lookup_type: ById(d13374f1-0b40-45c0-a61c-44a143e318c6) } result = Ok(()) uri = /v1/disks/disk-c068ffa3994?project=proj-815f1091374
29002024-10-01T02:33:19.385ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = bee526b4-9ae5-4b31-b6f5-5cf54d722ccb saga_name = disk-delete
29012024-10-01T02:33:19.385ZINFOnexus (SEC): saga create dag = {"end_node":14,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[2,3,null],[4,5,null],[4,6,null],[6,7,null],[5,7,null],[7,8,null],[8,9,null],[9,10,null],[10,11,null],[3,4,null],[11,12,null],[13,0,null],[12,14,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"disk_delete.delete_disk_record","label":"DeleteDiskRecord","name":"deleted_disk"}},{"Action":{"action_name":"disk_delete.space_account","label":"SpaceAccount","name":"no_result1"}},{"Constant":{"name":"params_for_volume_delete_subsaga","value":{"serialized_authn":{"kind":{"Authenticated":[{"actor":{"SiloUser":{"silo_id":"21983b87-d6d0-47c6-a33c-5fe68fbed0c6","silo_user_id":"8fbcb238-2807-4312-9499-49292447c1fc"}}},{"mapped_fleet_roles":{"admin":["admin"]}}]}},"volume_id":"a226f189-e7bc-4f2c-91d2-964190ce00d5"}}},{"SubsagaStart":{"params_node_name":"params_for_volume_delete_subsaga","saga_name":"volume-delete"}},{"Action":{"action_name":"volume_delete.decrease_crucible_resource_count","label":"DecreaseCrucibleResourceCount","name":"crucible_resources_to_delete"}},{"Action":{"action_name":"volume_delete.delete_crucible_regions","label":"DeleteCrucibleRegions","name":"no_result_1"}},{"Action":{"action_name":"volume_delete.delete_crucible_running_snapshots","label":"DeleteCrucibleRunningSnapshots","name":"no_result_2"}},{"Action":{"action_name":"volume_delete.delete_crucible_snapshots","label":"DeleteCrucibleSnapshots","name":"no_result_3"}},{"Action":{"action_name":"volume_delete.delete_crucible_snapshot_records","label":"DeleteCrucibleSnapshotRecords","name":"no_result_4"}},{"Action":{"action_name":"volume_delete.find_freed_crucible_regions","label":"FindFreedCrucibleRegions","name":"freed_crucible_regions"}},{"Action":{"action_name":"volume_delete.delete_freed_crucible_regions","label":"DeleteFreedCrucibleRegions","name":"no_result_5"}},{"Action":{"action_name":"volume_delete.hard_delete_volume_record","label":"HardDeleteVolumeRecord","name":"volume_hard_deleted"}},{"SubsagaEnd":{"name":"volume_delete_subsaga_no_result"}},{"Start":{"params":{"disk_id":"d13374f1-0b40-45c0-a61c-44a143e318c6","project_id":"d6cd5e95-82db-413f-aa24-4fc56edfc65a","serialized_authn":{"kind":{"Authenticated":[{"actor":{"SiloUser":{"silo_id":"21983b87-d6d0-47c6-a33c-5fe68fbed0c6","silo_user_id":"8fbcb238-2807-4312-9499-49292447c1fc"}}},{"mapped_fleet_roles":{"admin":["admin"]}}]}},"volume_id":"a226f189-e7bc-4f2c-91d2-964190ce00d5"}}},"End"]},"saga_name":"disk-delete","start_node":13} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = bee526b4-9ae5-4b31-b6f5-5cf54d722ccb saga_name = disk-delete sec_id = 3dfd7033-71d8-4eb9-bb97-49dae3b5cd35
29022024-10-01T02:33:19.385ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = bee526b4-9ae5-4b31-b6f5-5cf54d722ccb saga_name = disk-delete
29032024-10-01T02:33:19.394ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = bee526b4-9ae5-4b31-b6f5-5cf54d722ccb saga_name = disk-delete
29042024-10-01T02:33:19.394ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = bee526b4-9ae5-4b31-b6f5-5cf54d722ccb saga_name = disk-delete sec_id = 3dfd7033-71d8-4eb9-bb97-49dae3b5cd35
29052024-10-01T02:33:19.394ZDEBGnexus (SEC): saga log event new_state = N013 started sec_id = 3dfd7033-71d8-4eb9-bb97-49dae3b5cd35
29062024-10-01T02:33:19.394ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 13 saga_id = bee526b4-9ae5-4b31-b6f5-5cf54d722ccb
29072024-10-01T02:33:19.400ZDEBGnexus (SEC): saga log event new_state = N013 succeeded sec_id = 3dfd7033-71d8-4eb9-bb97-49dae3b5cd35
29082024-10-01T02:33:19.400ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 13 saga_id = bee526b4-9ae5-4b31-b6f5-5cf54d722ccb
29092024-10-01T02:33:19.409ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 3dfd7033-71d8-4eb9-bb97-49dae3b5cd35
29102024-10-01T02:33:19.409ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = bee526b4-9ae5-4b31-b6f5-5cf54d722ccb
29112024-10-01T02:33:19.426ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 3dfd7033-71d8-4eb9-bb97-49dae3b5cd35
29122024-10-01T02:33:19.426ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"block_size": String("Traditional"), "create_image_id": Null, "create_snapshot_id": Null, "identity": Object {"description": String(""), "id": String("d13374f1-0b40-45c0-a61c-44a143e318c6"), "name": String("disk-c068ffa3994"), "time_created": String("2024-10-01T02:33:17.936914Z"), "time_deleted": Null, "time_modified": String("2024-10-01T02:33:17.936914Z")}, "pantry_address": Null, "project_id": String("d6cd5e95-82db-413f-aa24-4fc56edfc65a"), "rcgen": Number(1), "runtime_state": Object {"attach_instance_id": Null, "disk_state": String("detached"), "gen": Number(2), "time_updated": String("2024-10-01T02:33:19.234395Z")}, "size": Number(1073741824), "slot": Null, "volume_id": String("a226f189-e7bc-4f2c-91d2-964190ce00d5")}) node_id = 0 saga_id = bee526b4-9ae5-4b31-b6f5-5cf54d722ccb
29132024-10-01T02:33:19.430ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 3dfd7033-71d8-4eb9-bb97-49dae3b5cd35
29142024-10-01T02:33:19.430ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = bee526b4-9ae5-4b31-b6f5-5cf54d722ccb
29152024-10-01T02:33:19.437ZDEBGnexus (SagaExecutor): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true roles = RoleSet { roles: {} } saga_id = bee526b4-9ae5-4b31-b6f5-5cf54d722ccb saga_name = disk-delete saga_node = SpaceAccount
29162024-10-01T02:33:19.437ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true resource = Database result = Ok(()) saga_id = bee526b4-9ae5-4b31-b6f5-5cf54d722ccb saga_name = disk-delete saga_node = SpaceAccount
29172024-10-01T02:33:19.480ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 3dfd7033-71d8-4eb9-bb97-49dae3b5cd35
29182024-10-01T02:33:19.480ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 1 saga_id = bee526b4-9ae5-4b31-b6f5-5cf54d722ccb
29192024-10-01T02:33:19.484ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 3dfd7033-71d8-4eb9-bb97-49dae3b5cd35
29202024-10-01T02:33:19.484ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = bee526b4-9ae5-4b31-b6f5-5cf54d722ccb
29212024-10-01T02:33:19.488ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 3dfd7033-71d8-4eb9-bb97-49dae3b5cd35
29222024-10-01T02:33:19.488ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"SiloUser": Object {"silo_id": String("21983b87-d6d0-47c6-a33c-5fe68fbed0c6"), "silo_user_id": String("8fbcb238-2807-4312-9499-49292447c1fc")}}}, Object {"mapped_fleet_roles": Object {"admin": Array [String("admin")]}}]}}, "volume_id": String("a226f189-e7bc-4f2c-91d2-964190ce00d5")}) node_id = 2 saga_id = bee526b4-9ae5-4b31-b6f5-5cf54d722ccb
29232024-10-01T02:33:19.495ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 3dfd7033-71d8-4eb9-bb97-49dae3b5cd35
29242024-10-01T02:33:19.495ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = bee526b4-9ae5-4b31-b6f5-5cf54d722ccb
29252024-10-01T02:33:19.500ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 3dfd7033-71d8-4eb9-bb97-49dae3b5cd35
29262024-10-01T02:33:19.500ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = bee526b4-9ae5-4b31-b6f5-5cf54d722ccb
29272024-10-01T02:33:19.507ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 3dfd7033-71d8-4eb9-bb97-49dae3b5cd35
29282024-10-01T02:33:19.507ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = bee526b4-9ae5-4b31-b6f5-5cf54d722ccb
29292024-10-01T02:33:19.546ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 3dfd7033-71d8-4eb9-bb97-49dae3b5cd35
29302024-10-01T02:33:19.546ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"V3": Object {"region_snapshots": Array [], "regions": Array [String("02ec91fc-0164-464a-b618-4ccc908bd42e"), String("28d06100-4e68-474d-b873-deb6fdd61240"), String("d8cee27b-e338-458d-aea5-933a14aa9c1f")]}}) node_id = 4 saga_id = bee526b4-9ae5-4b31-b6f5-5cf54d722ccb
29312024-10-01T02:33:19.552ZDEBGnexus (SEC): saga log event new_state = N005 started sec_id = 3dfd7033-71d8-4eb9-bb97-49dae3b5cd35
29322024-10-01T02:33:19.552ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 5 saga_id = bee526b4-9ae5-4b31-b6f5-5cf54d722ccb
29332024-10-01T02:33:19.556ZDEBGnexus (SEC): saga log event new_state = N006 started sec_id = 3dfd7033-71d8-4eb9-bb97-49dae3b5cd35
29342024-10-01T02:33:19.556ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 6 saga_id = bee526b4-9ae5-4b31-b6f5-5cf54d722ccb
29352024-10-01T02:33:19.562ZDEBGnexus (SEC): saga log event new_state = N006 succeeded sec_id = 3dfd7033-71d8-4eb9-bb97-49dae3b5cd35
29362024-10-01T02:33:19.562ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 6 saga_id = bee526b4-9ae5-4b31-b6f5-5cf54d722ccb
29372024-10-01T02:33:19.593ZINFOnexus (SagaExecutor): Transient(region not deleted yet), trying again in 82.088183ms file = nexus/src/app/crucible.rs:827 region_id = 28d06100-4e68-474d-b873-deb6fdd61240 saga_id = bee526b4-9ae5-4b31-b6f5-5cf54d722ccb saga_name = disk-delete
29382024-10-01T02:33:19.596ZINFOnexus (SagaExecutor): Transient(region not deleted yet), trying again in 142.303673ms file = nexus/src/app/crucible.rs:827 region_id = d8cee27b-e338-458d-aea5-933a14aa9c1f saga_id = bee526b4-9ae5-4b31-b6f5-5cf54d722ccb saga_name = disk-delete
29392024-10-01T02:33:19.598ZINFOnexus (SagaExecutor): Transient(region not deleted yet), trying again in 76.933705ms file = nexus/src/app/crucible.rs:827 region_id = 02ec91fc-0164-464a-b618-4ccc908bd42e saga_id = bee526b4-9ae5-4b31-b6f5-5cf54d722ccb saga_name = disk-delete
29402024-10-01T02:33:19.681ZINFOnexus (SagaExecutor): Transient(region not deleted yet), trying again in 139.306947ms file = nexus/src/app/crucible.rs:827 region_id = 28d06100-4e68-474d-b873-deb6fdd61240 saga_id = bee526b4-9ae5-4b31-b6f5-5cf54d722ccb saga_name = disk-delete
29412024-10-01T02:33:19.682ZINFOnexus (SagaExecutor): Transient(region not deleted yet), trying again in 171.368938ms file = nexus/src/app/crucible.rs:827 region_id = 02ec91fc-0164-464a-b618-4ccc908bd42e saga_id = bee526b4-9ae5-4b31-b6f5-5cf54d722ccb saga_name = disk-delete
29422024-10-01T02:33:19.743ZINFOnexus (SagaExecutor): region deleted file = nexus/src/app/crucible.rs:812 region_id = d8cee27b-e338-458d-aea5-933a14aa9c1f saga_id = bee526b4-9ae5-4b31-b6f5-5cf54d722ccb saga_name = disk-delete
29432024-10-01T02:33:19.825ZINFOnexus (SagaExecutor): region deleted file = nexus/src/app/crucible.rs:812 region_id = 28d06100-4e68-474d-b873-deb6fdd61240 saga_id = bee526b4-9ae5-4b31-b6f5-5cf54d722ccb saga_name = disk-delete
29442024-10-01T02:33:19.859ZINFOnexus (SagaExecutor): region deleted file = nexus/src/app/crucible.rs:812 region_id = 02ec91fc-0164-464a-b618-4ccc908bd42e saga_id = bee526b4-9ae5-4b31-b6f5-5cf54d722ccb saga_name = disk-delete
29452024-10-01T02:33:19.884ZDEBGnexus (SEC): saga log event new_state = N005 succeeded sec_id = 3dfd7033-71d8-4eb9-bb97-49dae3b5cd35
29462024-10-01T02:33:19.884ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 5 saga_id = bee526b4-9ae5-4b31-b6f5-5cf54d722ccb
29472024-10-01T02:33:19.890ZDEBGnexus (SEC): saga log event new_state = N007 started sec_id = 3dfd7033-71d8-4eb9-bb97-49dae3b5cd35
29482024-10-01T02:33:19.890ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 7 saga_id = bee526b4-9ae5-4b31-b6f5-5cf54d722ccb
29492024-10-01T02:33:19.894ZDEBGnexus (SEC): saga log event new_state = N007 succeeded sec_id = 3dfd7033-71d8-4eb9-bb97-49dae3b5cd35
29502024-10-01T02:33:19.894ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 7 saga_id = bee526b4-9ae5-4b31-b6f5-5cf54d722ccb
29512024-10-01T02:33:19.899ZDEBGnexus (SEC): saga log event new_state = N008 started sec_id = 3dfd7033-71d8-4eb9-bb97-49dae3b5cd35
29522024-10-01T02:33:19.899ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 8 saga_id = bee526b4-9ae5-4b31-b6f5-5cf54d722ccb
29532024-10-01T02:33:19.905ZDEBGnexus (SEC): saga log event new_state = N008 succeeded sec_id = 3dfd7033-71d8-4eb9-bb97-49dae3b5cd35
29542024-10-01T02:33:19.905ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 8 saga_id = bee526b4-9ae5-4b31-b6f5-5cf54d722ccb
29552024-10-01T02:33:19.912ZDEBGnexus (SEC): saga log event new_state = N009 started sec_id = 3dfd7033-71d8-4eb9-bb97-49dae3b5cd35
29562024-10-01T02:33:19.912ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 9 saga_id = bee526b4-9ae5-4b31-b6f5-5cf54d722ccb
29572024-10-01T02:33:19.921ZDEBGnexus (SEC): saga log event new_state = N009 succeeded sec_id = 3dfd7033-71d8-4eb9-bb97-49dae3b5cd35
29582024-10-01T02:33:19.921ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Array []) node_id = 9 saga_id = bee526b4-9ae5-4b31-b6f5-5cf54d722ccb
29592024-10-01T02:33:19.929ZDEBGnexus (SEC): saga log event new_state = N010 started sec_id = 3dfd7033-71d8-4eb9-bb97-49dae3b5cd35
29602024-10-01T02:33:19.929ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 10 saga_id = bee526b4-9ae5-4b31-b6f5-5cf54d722ccb
29612024-10-01T02:33:19.934ZDEBGnexus (SEC): saga log event new_state = N010 succeeded sec_id = 3dfd7033-71d8-4eb9-bb97-49dae3b5cd35
29622024-10-01T02:33:19.934ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 10 saga_id = bee526b4-9ae5-4b31-b6f5-5cf54d722ccb
29632024-10-01T02:33:19.940ZDEBGnexus (SEC): saga log event new_state = N011 started sec_id = 3dfd7033-71d8-4eb9-bb97-49dae3b5cd35
29642024-10-01T02:33:19.940ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 11 saga_id = bee526b4-9ae5-4b31-b6f5-5cf54d722ccb
29652024-10-01T02:33:19.947ZINFOnexus (SagaExecutor): allocated regions for a226f189-e7bc-4f2c-91d2-964190ce00d5 is empty, calling volume_hard_delete file = nexus/src/app/sagas/volume_delete.rs:546 saga_id = bee526b4-9ae5-4b31-b6f5-5cf54d722ccb saga_name = disk-delete
29662024-10-01T02:33:19.967ZDEBGnexus (SEC): saga log event new_state = N011 succeeded sec_id = 3dfd7033-71d8-4eb9-bb97-49dae3b5cd35
29672024-10-01T02:33:19.967ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Bool(true)) node_id = 11 saga_id = bee526b4-9ae5-4b31-b6f5-5cf54d722ccb
29682024-10-01T02:33:19.974ZDEBGnexus (SEC): saga log event new_state = N012 started sec_id = 3dfd7033-71d8-4eb9-bb97-49dae3b5cd35
29692024-10-01T02:33:19.974ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 12 saga_id = bee526b4-9ae5-4b31-b6f5-5cf54d722ccb
29702024-10-01T02:33:19.977ZDEBGnexus (SEC): saga log event new_state = N012 succeeded sec_id = 3dfd7033-71d8-4eb9-bb97-49dae3b5cd35
29712024-10-01T02:33:19.977ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Bool(true)) node_id = 12 saga_id = bee526b4-9ae5-4b31-b6f5-5cf54d722ccb
29722024-10-01T02:33:19.981ZDEBGnexus (SEC): saga log event new_state = N014 started sec_id = 3dfd7033-71d8-4eb9-bb97-49dae3b5cd35
29732024-10-01T02:33:19.981ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 14 saga_id = bee526b4-9ae5-4b31-b6f5-5cf54d722ccb
29742024-10-01T02:33:19.985ZDEBGnexus (SEC): saga log event new_state = N014 succeeded sec_id = 3dfd7033-71d8-4eb9-bb97-49dae3b5cd35
29752024-10-01T02:33:19.985ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 14 saga_id = bee526b4-9ae5-4b31-b6f5-5cf54d722ccb
29762024-10-01T02:33:19.992ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = bee526b4-9ae5-4b31-b6f5-5cf54d722ccb sec_id = 3dfd7033-71d8-4eb9-bb97-49dae3b5cd35
29772024-10-01T02:33:19.992ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = bee526b4-9ae5-4b31-b6f5-5cf54d722ccb
29782024-10-01T02:33:20.037ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = bee526b4-9ae5-4b31-b6f5-5cf54d722ccb saga_name = disk-delete sec_id = 3dfd7033-71d8-4eb9-bb97-49dae3b5cd35
29792024-10-01T02:33:20.037ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = bee526b4-9ae5-4b31-b6f5-5cf54d722ccb saga_name = disk-delete saga_result = SagaResult { saga_id: bee526b4-9ae5-4b31-b6f5-5cf54d722ccb, saga_log: SagaLog { saga_id: bee526b4-9ae5-4b31-b6f5-5cf54d722ccb, unwinding: false, events: [N013 started, N013 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N003 started, N003 succeeded, N004 started, N004 succeeded, N005 started, N006 started, N006 succeeded, N005 succeeded, N007 started, N007 succeeded, N008 started, N008 succeeded, N009 started, N009 succeeded, N010 started, N010 succeeded, N011 started, N011 succeeded, N012 started, N012 succeeded, N014 started, N014 succeeded], node_status: {0: Succeeded(Object {"block_size": String("Traditional"), "create_image_id": Null, "create_snapshot_id": Null, "identity": Object {"description": String(""), "id": String("d13374f1-0b40-45c0-a61c-44a143e318c6"), "name": String("disk-c068ffa3994"), "time_created": String("2024-10-01T02:33:17.936914Z"), "time_deleted": Null, "time_modified": String("2024-10-01T02:33:17.936914Z")}, "pantry_address": Null, "project_id": String("d6cd5e95-82db-413f-aa24-4fc56edfc65a"), "rcgen": Number(1), "runtime_state": Object {"attach_instance_id": Null, "disk_state": String("detached"), "gen": Number(2), "time_updated": String("2024-10-01T02:33:19.234395Z")}, "size": Number(1073741824), "slot": Null, "volume_id": String("a226f189-e7bc-4f2c-91d2-964190ce00d5")}), 1: Succeeded(Null), 2: Succeeded(Object {"serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"SiloUser": Object {"silo_id": String("21983b87-d6d0-47c6-a33c-5fe68fbed0c6"), "silo_user_id": String("8fbcb238-2807-4312-9499-49292447c1fc")}}}, Object {"mapped_fleet_roles": Object {"admin": Array [String("admin")]}}]}}, "volume_id": String("a226f189-e7bc-4f2c-91d2-964190ce00d5")}), 3: Succeeded(Null), 4: Succeeded(Object {"V3": Object {"region_snapshots": Array [], "regions": Array [String("02ec91fc-0164-464a-b618-4ccc908bd42e"), String("28d06100-4e68-474d-b873-deb6fdd61240"), String("d8cee27b-e338-458d-aea5-933a14aa9c1f")]}}), 5: Succeeded(Null), 6: Succeeded(Null), 7: Succeeded(Null), 8: Succeeded(Null), 9: Succeeded(Array []), 10: Succeeded(Null), 11: Succeeded(Bool(true)), 12: Succeeded(Bool(true)), 13: Succeeded(Null), 14: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Bool(true), node_outputs: {"crucible_resources_to_delete": Object {"V3": Object {"region_snapshots": Array [], "regions": Array [String("02ec91fc-0164-464a-b618-4ccc908bd42e"), String("28d06100-4e68-474d-b873-deb6fdd61240"), String("d8cee27b-e338-458d-aea5-933a14aa9c1f")]}}, "deleted_disk": Object {"block_size": String("Traditional"), "create_image_id": Null, "create_snapshot_id": Null, "identity": Object {"description": String(""), "id": String("d13374f1-0b40-45c0-a61c-44a143e318c6"), "name": String("disk-c068ffa3994"), "time_created": String("2024-10-01T02:33:17.936914Z"), "time_deleted": Null, "time_modified": String("2024-10-01T02:33:17.936914Z")}, "pantry_address": Null, "project_id": String("d6cd5e95-82db-413f-aa24-4fc56edfc65a"), "rcgen": Number(1), "runtime_state": Object {"attach_instance_id": Null, "disk_state": String("detached"), "gen": Number(2), "time_updated": String("2024-10-01T02:33:19.234395Z")}, "size": Number(1073741824), "slot": Null, "volume_id": String("a226f189-e7bc-4f2c-91d2-964190ce00d5")}, "freed_crucible_regions": Array [], "no_result1": Null, "no_result_1": Null, "no_result_2": Null, "no_result_3": Null, "no_result_4": Null, "no_result_5": Null, "params_for_volume_delete_subsaga": Object {"serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"SiloUser": Object {"silo_id": String("21983b87-d6d0-47c6-a33c-5fe68fbed0c6"), "silo_user_id": String("8fbcb238-2807-4312-9499-49292447c1fc")}}}, Object {"mapped_fleet_roles": Object {"admin": Array [String("admin")]}}]}}, "volume_id": String("a226f189-e7bc-4f2c-91d2-964190ce00d5")}, "volume_delete_subsaga_no_result": Bool(true), "volume_hard_deleted": Bool(true)} }) }
29802024-10-01T02:33:20.037ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 729824 local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49233 req_id = 7bf111aa-5550-47d0-9122-85e6d1a8f989 response_code = 204 uri = /v1/disks/disk-c068ffa3994?project=proj-815f1091374
29812024-10-01T02:33:20.039ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
29822024-10-01T02:33:20.039ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
29832024-10-01T02:33:20.041ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
29842024-10-01T02:33:20.043ZDEBGnexus (ExternalAuthn): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = DeviceAuthRequestList result = Ok(())
29852024-10-01T02:33:20.043ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
29862024-10-01T02:33:20.043ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
29872024-10-01T02:33:20.052ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 13027 local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:49233 req_id = b540e098-52c2-4aa7-bec9-111541105639 response_code = 200 uri = /device/auth
29882024-10-01T02:33:20.055ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
29892024-10-01T02:33:20.055ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
29902024-10-01T02:33:20.056ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
29912024-10-01T02:33:20.057ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
29922024-10-01T02:33:20.058ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
29932024-10-01T02:33:20.059ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "b2603776c17391bc0ca280d341de87edae62e8df", lookup_type: ByCompositeId("token = \\"b2603776c17391bc0ca280d341de87edae62e8df\\"") } result = Ok(())
29942024-10-01T02:33:20.059ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
29952024-10-01T02:33:20.059ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
29962024-10-01T02:33:20.061ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
29972024-10-01T02:33:20.061ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
29982024-10-01T02:33:20.063ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
29992024-10-01T02:33:20.063ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
30002024-10-01T02:33:20.064ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
30012024-10-01T02:33:20.065ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
30022024-10-01T02:33:20.066ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
30032024-10-01T02:33:20.067ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, lookup_type: ById(21983b87-d6d0-47c6-a33c-5fe68fbed0c6) }, key: 8fbcb238-2807-4312-9499-49292447c1fc, lookup_type: ById(8fbcb238-2807-4312-9499-49292447c1fc) } result = Ok(())
30042024-10-01T02:33:20.067ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
30052024-10-01T02:33:20.068ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
30062024-10-01T02:33:20.069ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
30072024-10-01T02:33:20.070ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "b2603776c17391bc0ca280d341de87edae62e8df", lookup_type: ByCompositeId("b2603776c17391bc0ca280d341de87edae62e8df") } result = Ok(())
30082024-10-01T02:33:20.070ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
30092024-10-01T02:33:20.071ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
30102024-10-01T02:33:20.077ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
30112024-10-01T02:33:20.077ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
30122024-10-01T02:33:20.078ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
30132024-10-01T02:33:20.078ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
30142024-10-01T02:33:20.080ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
30152024-10-01T02:33:20.080ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
30162024-10-01T02:33:20.081ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
30172024-10-01T02:33:20.082ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
30182024-10-01T02:33:20.083ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
30192024-10-01T02:33:20.084ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, lookup_type: ById(21983b87-d6d0-47c6-a33c-5fe68fbed0c6) }, key: 8fbcb238-2807-4312-9499-49292447c1fc, lookup_type: ById(8fbcb238-2807-4312-9499-49292447c1fc) } result = Ok(())
30202024-10-01T02:33:20.084ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
30212024-10-01T02:33:20.085ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
30222024-10-01T02:33:20.086ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
30232024-10-01T02:33:20.086ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
30242024-10-01T02:33:20.088ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
30252024-10-01T02:33:20.088ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
30262024-10-01T02:33:20.089ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
30272024-10-01T02:33:20.090ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, lookup_type: ById(21983b87-d6d0-47c6-a33c-5fe68fbed0c6) } result = Ok(())
30282024-10-01T02:33:20.090ZDEBGnexus (dropshot_external): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:49233 req_id = bb9d62fc-73d4-4c0c-826b-d8b37ce51570 roles = RoleSet { roles: {} } uri = /device/confirm
30292024-10-01T02:33:20.090ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:49233 req_id = bb9d62fc-73d4-4c0c-826b-d8b37ce51570 resource = Database result = Ok(()) uri = /device/confirm
30302024-10-01T02:33:20.120ZDEBGnexus (dropshot_external): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:49233 req_id = bb9d62fc-73d4-4c0c-826b-d8b37ce51570 roles = RoleSet { roles: {} } uri = /device/confirm
30312024-10-01T02:33:20.121ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:49233 req_id = bb9d62fc-73d4-4c0c-826b-d8b37ce51570 resource = Database result = Ok(()) uri = /device/confirm
30322024-10-01T02:33:20.123ZDEBGnexus (dropshot_external): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:49233 req_id = bb9d62fc-73d4-4c0c-826b-d8b37ce51570 roles = RoleSet { roles: {} } uri = /device/confirm
30332024-10-01T02:33:20.123ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:49233 req_id = bb9d62fc-73d4-4c0c-826b-d8b37ce51570 resource = Database result = Ok(()) uri = /device/confirm
30342024-10-01T02:33:20.126ZDEBGnexus (dropshot_external): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:49233 req_id = bb9d62fc-73d4-4c0c-826b-d8b37ce51570 roles = RoleSet { roles: {(Silo, 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, "admin")} } uri = /device/confirm
30352024-10-01T02:33:20.127ZDEBGnexus (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:49233 req_id = bb9d62fc-73d4-4c0c-826b-d8b37ce51570 resource = DeviceAuthRequest { parent: Fleet, key: "VPZM-XFCR", lookup_type: ByCompositeId("user_code = \\"VPZM-XFCR\\"") } result = Ok(()) uri = /device/confirm
30362024-10-01T02:33:20.127ZDEBGnexus (dropshot_external): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:49233 req_id = bb9d62fc-73d4-4c0c-826b-d8b37ce51570 roles = RoleSet { roles: {} } uri = /device/confirm
30372024-10-01T02:33:20.128ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:49233 req_id = bb9d62fc-73d4-4c0c-826b-d8b37ce51570 resource = Database result = Ok(()) uri = /device/confirm
30382024-10-01T02:33:20.129ZDEBGnexus (dropshot_external): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:49233 req_id = bb9d62fc-73d4-4c0c-826b-d8b37ce51570 roles = RoleSet { roles: {} } uri = /device/confirm
30392024-10-01T02:33:20.129ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:49233 req_id = bb9d62fc-73d4-4c0c-826b-d8b37ce51570 resource = Database result = Ok(()) uri = /device/confirm
30402024-10-01T02:33:20.130ZDEBGnexus (dropshot_external): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:49233 req_id = bb9d62fc-73d4-4c0c-826b-d8b37ce51570 roles = RoleSet { roles: {} } uri = /device/confirm
30412024-10-01T02:33:20.131ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:49233 req_id = bb9d62fc-73d4-4c0c-826b-d8b37ce51570 resource = Database result = Ok(()) uri = /device/confirm
30422024-10-01T02:33:20.133ZDEBGnexus (dropshot_external): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:49233 req_id = bb9d62fc-73d4-4c0c-826b-d8b37ce51570 roles = RoleSet { roles: {} } uri = /device/confirm
30432024-10-01T02:33:20.133ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:49233 req_id = bb9d62fc-73d4-4c0c-826b-d8b37ce51570 resource = Database result = Ok(()) uri = /device/confirm
30442024-10-01T02:33:20.136ZDEBGnexus (dropshot_external): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:49233 req_id = bb9d62fc-73d4-4c0c-826b-d8b37ce51570 roles = RoleSet { roles: {} } uri = /device/confirm
30452024-10-01T02:33:20.136ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:49233 req_id = bb9d62fc-73d4-4c0c-826b-d8b37ce51570 resource = Database result = Ok(()) uri = /device/confirm
30462024-10-01T02:33:20.138ZDEBGnexus (dropshot_external): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:49233 req_id = bb9d62fc-73d4-4c0c-826b-d8b37ce51570 roles = RoleSet { roles: {(Silo, 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, "admin")} } uri = /device/confirm
30472024-10-01T02:33:20.139ZDEBGnexus (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:49233 req_id = bb9d62fc-73d4-4c0c-826b-d8b37ce51570 resource = SiloUser { parent: Silo { parent: Fleet, key: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, lookup_type: ById(21983b87-d6d0-47c6-a33c-5fe68fbed0c6) }, key: 8fbcb238-2807-4312-9499-49292447c1fc, lookup_type: ById(8fbcb238-2807-4312-9499-49292447c1fc) } result = Ok(()) uri = /device/confirm
30482024-10-01T02:33:20.139ZDEBGnexus (dropshot_external): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:49233 req_id = bb9d62fc-73d4-4c0c-826b-d8b37ce51570 roles = RoleSet { roles: {} } uri = /device/confirm
30492024-10-01T02:33:20.140ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:49233 req_id = bb9d62fc-73d4-4c0c-826b-d8b37ce51570 resource = Database result = Ok(()) uri = /device/confirm
30502024-10-01T02:33:20.142ZDEBGnexus (dropshot_external): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:49233 req_id = bb9d62fc-73d4-4c0c-826b-d8b37ce51570 roles = RoleSet { roles: {} } uri = /device/confirm
30512024-10-01T02:33:20.142ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:49233 req_id = bb9d62fc-73d4-4c0c-826b-d8b37ce51570 resource = Database result = Ok(()) uri = /device/confirm
30522024-10-01T02:33:20.144ZDEBGnexus (dropshot_external): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:49233 req_id = bb9d62fc-73d4-4c0c-826b-d8b37ce51570 roles = RoleSet { roles: {(Silo, 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, "admin")} } uri = /device/confirm
30532024-10-01T02:33:20.145ZDEBGnexus (dropshot_external): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:49233 req_id = bb9d62fc-73d4-4c0c-826b-d8b37ce51570 resource = DeviceAuthRequest { parent: Fleet, key: "VPZM-XFCR", lookup_type: ByCompositeId("user_code = \\"VPZM-XFCR\\"") } result = Ok(()) uri = /device/confirm
30542024-10-01T02:33:20.145ZDEBGnexus (dropshot_external): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:49233 req_id = bb9d62fc-73d4-4c0c-826b-d8b37ce51570 roles = RoleSet { roles: {} } uri = /device/confirm
30552024-10-01T02:33:20.145ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:49233 req_id = bb9d62fc-73d4-4c0c-826b-d8b37ce51570 resource = Database result = Ok(()) uri = /device/confirm
30562024-10-01T02:33:20.147ZDEBGnexus (dropshot_external): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:49233 req_id = bb9d62fc-73d4-4c0c-826b-d8b37ce51570 roles = RoleSet { roles: {} } uri = /device/confirm
30572024-10-01T02:33:20.147ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:49233 req_id = bb9d62fc-73d4-4c0c-826b-d8b37ce51570 resource = Database result = Ok(()) uri = /device/confirm
30582024-10-01T02:33:20.150ZDEBGnexus (dropshot_external): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:49233 req_id = bb9d62fc-73d4-4c0c-826b-d8b37ce51570 roles = RoleSet { roles: {} } uri = /device/confirm
30592024-10-01T02:33:20.150ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:49233 req_id = bb9d62fc-73d4-4c0c-826b-d8b37ce51570 resource = Database result = Ok(()) uri = /device/confirm
30602024-10-01T02:33:20.152ZDEBGnexus (dropshot_external): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:49233 req_id = bb9d62fc-73d4-4c0c-826b-d8b37ce51570 roles = RoleSet { roles: {(Silo, 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, "admin")} } uri = /device/confirm
30612024-10-01T02:33:20.153ZDEBGnexus (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:49233 req_id = bb9d62fc-73d4-4c0c-826b-d8b37ce51570 resource = SiloUser { parent: Silo { parent: Fleet, key: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, lookup_type: ById(21983b87-d6d0-47c6-a33c-5fe68fbed0c6) }, key: 8fbcb238-2807-4312-9499-49292447c1fc, lookup_type: ById(8fbcb238-2807-4312-9499-49292447c1fc) } result = Ok(()) uri = /device/confirm
30622024-10-01T02:33:20.153ZDEBGnexus (dropshot_external): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:49233 req_id = bb9d62fc-73d4-4c0c-826b-d8b37ce51570 roles = RoleSet { roles: {} } uri = /device/confirm
30632024-10-01T02:33:20.153ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:49233 req_id = bb9d62fc-73d4-4c0c-826b-d8b37ce51570 resource = Database result = Ok(()) uri = /device/confirm
30642024-10-01T02:33:20.189ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 135539 local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:49233 req_id = bb9d62fc-73d4-4c0c-826b-d8b37ce51570 response_code = 204 uri = /device/confirm
30652024-10-01T02:33:20.192ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
30662024-10-01T02:33:20.192ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
30672024-10-01T02:33:20.201ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 10243 local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:49233 req_id = 3ef331ae-639e-4432-a676-3379ba568b69 response_code = 200 uri = /device/token
30682024-10-01T02:33:20.203ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
30692024-10-01T02:33:20.203ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
30702024-10-01T02:33:20.205ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
30712024-10-01T02:33:20.205ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
30722024-10-01T02:33:20.207ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
30732024-10-01T02:33:20.208ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "b2603776c17391bc0ca280d341de87edae62e8df", lookup_type: ByCompositeId("token = \\"b2603776c17391bc0ca280d341de87edae62e8df\\"") } result = Ok(())
30742024-10-01T02:33:20.208ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
30752024-10-01T02:33:20.208ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
30762024-10-01T02:33:20.211ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
30772024-10-01T02:33:20.211ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
30782024-10-01T02:33:20.213ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
30792024-10-01T02:33:20.213ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
30802024-10-01T02:33:20.214ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
30812024-10-01T02:33:20.214ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
30822024-10-01T02:33:20.216ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
30832024-10-01T02:33:20.217ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, lookup_type: ById(21983b87-d6d0-47c6-a33c-5fe68fbed0c6) }, key: 8fbcb238-2807-4312-9499-49292447c1fc, lookup_type: ById(8fbcb238-2807-4312-9499-49292447c1fc) } result = Ok(())
30842024-10-01T02:33:20.217ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
30852024-10-01T02:33:20.217ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
30862024-10-01T02:33:20.219ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
30872024-10-01T02:33:20.220ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "b2603776c17391bc0ca280d341de87edae62e8df", lookup_type: ByCompositeId("b2603776c17391bc0ca280d341de87edae62e8df") } result = Ok(())
30882024-10-01T02:33:20.220ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
30892024-10-01T02:33:20.220ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
30902024-10-01T02:33:20.226ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
30912024-10-01T02:33:20.226ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
30922024-10-01T02:33:20.228ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
30932024-10-01T02:33:20.228ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
30942024-10-01T02:33:20.229ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
30952024-10-01T02:33:20.229ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
30962024-10-01T02:33:20.231ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
30972024-10-01T02:33:20.231ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
30982024-10-01T02:33:20.232ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
30992024-10-01T02:33:20.234ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, lookup_type: ById(21983b87-d6d0-47c6-a33c-5fe68fbed0c6) }, key: 8fbcb238-2807-4312-9499-49292447c1fc, lookup_type: ById(8fbcb238-2807-4312-9499-49292447c1fc) } result = Ok(())
31002024-10-01T02:33:20.234ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31012024-10-01T02:33:20.234ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31022024-10-01T02:33:20.235ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31032024-10-01T02:33:20.235ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31042024-10-01T02:33:20.237ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31052024-10-01T02:33:20.237ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31062024-10-01T02:33:20.238ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
31072024-10-01T02:33:20.239ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, lookup_type: ById(21983b87-d6d0-47c6-a33c-5fe68fbed0c6) } result = Ok(())
31082024-10-01T02:33:20.239ZDEBGnexus (dropshot_external): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49233 req_id = fd7d7ed1-62cf-4284-9165-7baaf5060e9d roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-815f1091374&vpc=default
31092024-10-01T02:33:20.239ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49233 req_id = fd7d7ed1-62cf-4284-9165-7baaf5060e9d resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-815f1091374&vpc=default
31102024-10-01T02:33:20.241ZDEBGnexus (dropshot_external): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49233 req_id = fd7d7ed1-62cf-4284-9165-7baaf5060e9d roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-815f1091374&vpc=default
31112024-10-01T02:33:20.241ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49233 req_id = fd7d7ed1-62cf-4284-9165-7baaf5060e9d resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-815f1091374&vpc=default
31122024-10-01T02:33:20.243ZDEBGnexus (dropshot_external): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49233 req_id = fd7d7ed1-62cf-4284-9165-7baaf5060e9d roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-815f1091374&vpc=default
31132024-10-01T02:33:20.244ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49233 req_id = fd7d7ed1-62cf-4284-9165-7baaf5060e9d resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-815f1091374&vpc=default
31142024-10-01T02:33:20.245ZDEBGnexus (dropshot_external): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49233 req_id = fd7d7ed1-62cf-4284-9165-7baaf5060e9d roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-815f1091374&vpc=default
31152024-10-01T02:33:20.245ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49233 req_id = fd7d7ed1-62cf-4284-9165-7baaf5060e9d resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-815f1091374&vpc=default
31162024-10-01T02:33:20.247ZDEBGnexus (dropshot_external): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49233 req_id = fd7d7ed1-62cf-4284-9165-7baaf5060e9d roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-815f1091374&vpc=default
31172024-10-01T02:33:20.247ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49233 req_id = fd7d7ed1-62cf-4284-9165-7baaf5060e9d resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-815f1091374&vpc=default
31182024-10-01T02:33:20.249ZDEBGnexus (dropshot_external): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49233 req_id = fd7d7ed1-62cf-4284-9165-7baaf5060e9d roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-815f1091374&vpc=default
31192024-10-01T02:33:20.249ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49233 req_id = fd7d7ed1-62cf-4284-9165-7baaf5060e9d resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-815f1091374&vpc=default
31202024-10-01T02:33:20.252ZDEBGnexus (dropshot_external): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49233 req_id = fd7d7ed1-62cf-4284-9165-7baaf5060e9d roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-815f1091374&vpc=default
31212024-10-01T02:33:20.252ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49233 req_id = fd7d7ed1-62cf-4284-9165-7baaf5060e9d resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-815f1091374&vpc=default
31222024-10-01T02:33:20.254ZDEBGnexus (dropshot_external): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49233 req_id = fd7d7ed1-62cf-4284-9165-7baaf5060e9d roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-815f1091374&vpc=default
31232024-10-01T02:33:20.255ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49233 req_id = fd7d7ed1-62cf-4284-9165-7baaf5060e9d resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-815f1091374&vpc=default
31242024-10-01T02:33:20.257ZDEBGnexus (dropshot_external): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49233 req_id = fd7d7ed1-62cf-4284-9165-7baaf5060e9d roles = RoleSet { roles: {(Silo, 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, "admin")} } uri = /v1/vpc-subnets/default?project=proj-815f1091374&vpc=default
31252024-10-01T02:33:20.260ZDEBGnexus (dropshot_external): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49233 req_id = fd7d7ed1-62cf-4284-9165-7baaf5060e9d resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, lookup_type: ById(21983b87-d6d0-47c6-a33c-5fe68fbed0c6) }, key: d6cd5e95-82db-413f-aa24-4fc56edfc65a, lookup_type: ByName("proj-815f1091374") }, key: d0c53fd8-2027-48ed-90fd-8a4e218435fa, lookup_type: ByName("default") }, key: 050ff4b6-0012-4a9f-a32d-f71a94895be6, lookup_type: ByName("default") } result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-815f1091374&vpc=default
31262024-10-01T02:33:20.260ZDEBGnexus (dropshot_external): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49233 req_id = fd7d7ed1-62cf-4284-9165-7baaf5060e9d roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-815f1091374&vpc=default
31272024-10-01T02:33:20.260ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49233 req_id = fd7d7ed1-62cf-4284-9165-7baaf5060e9d resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-815f1091374&vpc=default
31282024-10-01T02:33:20.263ZDEBGnexus (dropshot_external): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49233 req_id = fd7d7ed1-62cf-4284-9165-7baaf5060e9d roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-815f1091374&vpc=default
31292024-10-01T02:33:20.263ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49233 req_id = fd7d7ed1-62cf-4284-9165-7baaf5060e9d resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-815f1091374&vpc=default
31302024-10-01T02:33:20.265ZDEBGnexus (dropshot_external): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49233 req_id = fd7d7ed1-62cf-4284-9165-7baaf5060e9d roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-815f1091374&vpc=default
31312024-10-01T02:33:20.265ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49233 req_id = fd7d7ed1-62cf-4284-9165-7baaf5060e9d resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-815f1091374&vpc=default
31322024-10-01T02:33:20.267ZDEBGnexus (dropshot_external): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49233 req_id = fd7d7ed1-62cf-4284-9165-7baaf5060e9d roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-815f1091374&vpc=default
31332024-10-01T02:33:20.268ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49233 req_id = fd7d7ed1-62cf-4284-9165-7baaf5060e9d resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-815f1091374&vpc=default
31342024-10-01T02:33:20.270ZDEBGnexus (dropshot_external): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49233 req_id = fd7d7ed1-62cf-4284-9165-7baaf5060e9d roles = RoleSet { roles: {(Silo, 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, "admin")} } uri = /v1/vpc-subnets/default?project=proj-815f1091374&vpc=default
31352024-10-01T02:33:20.273ZDEBGnexus (dropshot_external): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49233 req_id = fd7d7ed1-62cf-4284-9165-7baaf5060e9d resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, lookup_type: ById(21983b87-d6d0-47c6-a33c-5fe68fbed0c6) }, key: d6cd5e95-82db-413f-aa24-4fc56edfc65a, lookup_type: ByName("proj-815f1091374") }, key: d0c53fd8-2027-48ed-90fd-8a4e218435fa, lookup_type: ByName("default") }, key: 050ff4b6-0012-4a9f-a32d-f71a94895be6, lookup_type: ByName("default") } result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-815f1091374&vpc=default
31362024-10-01T02:33:20.273ZDEBGnexus (dropshot_external): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49233 req_id = fd7d7ed1-62cf-4284-9165-7baaf5060e9d roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-815f1091374&vpc=default
31372024-10-01T02:33:20.273ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49233 req_id = fd7d7ed1-62cf-4284-9165-7baaf5060e9d resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-815f1091374&vpc=default
31382024-10-01T02:33:20.275ZDEBGnexus (dropshot_external): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49233 req_id = fd7d7ed1-62cf-4284-9165-7baaf5060e9d roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-815f1091374&vpc=default
31392024-10-01T02:33:20.275ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49233 req_id = fd7d7ed1-62cf-4284-9165-7baaf5060e9d resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-815f1091374&vpc=default
31402024-10-01T02:33:20.280ZDEBGnexus (dropshot_external): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49233 req_id = fd7d7ed1-62cf-4284-9165-7baaf5060e9d roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-815f1091374&vpc=default
31412024-10-01T02:33:20.281ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49233 req_id = fd7d7ed1-62cf-4284-9165-7baaf5060e9d resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-815f1091374&vpc=default
31422024-10-01T02:33:20.298ZDEBGnexus (dropshot_external): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49233 req_id = fd7d7ed1-62cf-4284-9165-7baaf5060e9d roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-815f1091374&vpc=default
31432024-10-01T02:33:20.299ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49233 req_id = fd7d7ed1-62cf-4284-9165-7baaf5060e9d resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-815f1091374&vpc=default
31442024-10-01T02:33:20.306ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 102707 local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49233 req_id = fd7d7ed1-62cf-4284-9165-7baaf5060e9d response_code = 204 uri = /v1/vpc-subnets/default?project=proj-815f1091374&vpc=default
31452024-10-01T02:33:20.306ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 2 reason = Signaled
31462024-10-01T02:33:20.306ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
31472024-10-01T02:33:20.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
31482024-10-01T02:33:20.307ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31492024-10-01T02:33:20.307ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31502024-10-01T02:33:20.307ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31512024-10-01T02:33:20.308ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31522024-10-01T02:33:20.308ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31532024-10-01T02:33:20.309ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
31542024-10-01T02:33:20.309ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
31552024-10-01T02:33:20.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
31562024-10-01T02:33:20.310ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
31572024-10-01T02:33:20.310ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31582024-10-01T02:33:20.311ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "b2603776c17391bc0ca280d341de87edae62e8df", lookup_type: ByCompositeId("token = \\"b2603776c17391bc0ca280d341de87edae62e8df\\"") } result = Ok(())
31592024-10-01T02:33:20.311ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31602024-10-01T02:33:20.312ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31612024-10-01T02:33:20.312ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
31622024-10-01T02:33:20.312ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
31632024-10-01T02:33:20.312ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
31642024-10-01T02:33:20.313ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31652024-10-01T02:33:20.313ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31662024-10-01T02:33:20.314ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31672024-10-01T02:33:20.315ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31682024-10-01T02:33:20.316ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31692024-10-01T02:33:20.316ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31702024-10-01T02:33:20.317ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
31712024-10-01T02:33:20.318ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, lookup_type: ById(21983b87-d6d0-47c6-a33c-5fe68fbed0c6) }, key: 8fbcb238-2807-4312-9499-49292447c1fc, lookup_type: ById(8fbcb238-2807-4312-9499-49292447c1fc) } result = Ok(())
31722024-10-01T02:33:20.318ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31732024-10-01T02:33:20.319ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31742024-10-01T02:33:20.320ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
31752024-10-01T02:33:20.321ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "b2603776c17391bc0ca280d341de87edae62e8df", lookup_type: ByCompositeId("b2603776c17391bc0ca280d341de87edae62e8df") } result = Ok(())
31762024-10-01T02:33:20.321ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31772024-10-01T02:33:20.321ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31782024-10-01T02:33:20.326ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31792024-10-01T02:33:20.326ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31802024-10-01T02:33:20.327ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31812024-10-01T02:33:20.327ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31822024-10-01T02:33:20.329ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31832024-10-01T02:33:20.329ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31842024-10-01T02:33:20.330ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31852024-10-01T02:33:20.330ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31862024-10-01T02:33:20.331ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
31872024-10-01T02:33:20.333ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, lookup_type: ById(21983b87-d6d0-47c6-a33c-5fe68fbed0c6) }, key: 8fbcb238-2807-4312-9499-49292447c1fc, lookup_type: ById(8fbcb238-2807-4312-9499-49292447c1fc) } result = Ok(())
31882024-10-01T02:33:20.333ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31892024-10-01T02:33:20.333ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31902024-10-01T02:33:20.335ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31912024-10-01T02:33:20.335ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31922024-10-01T02:33:20.336ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31932024-10-01T02:33:20.337ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31942024-10-01T02:33:20.338ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
31952024-10-01T02:33:20.339ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, lookup_type: ById(21983b87-d6d0-47c6-a33c-5fe68fbed0c6) } result = Ok(())
31962024-10-01T02:33:20.339ZDEBGnexus (dropshot_external): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49233 req_id = a501ce3f-be36-4c2d-947d-e0ee101a0134 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-815f1091374
31972024-10-01T02:33:20.339ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49233 req_id = a501ce3f-be36-4c2d-947d-e0ee101a0134 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-815f1091374
31982024-10-01T02:33:20.341ZDEBGnexus (dropshot_external): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49233 req_id = a501ce3f-be36-4c2d-947d-e0ee101a0134 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-815f1091374
31992024-10-01T02:33:20.341ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49233 req_id = a501ce3f-be36-4c2d-947d-e0ee101a0134 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-815f1091374
32002024-10-01T02:33:20.343ZDEBGnexus (dropshot_external): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49233 req_id = a501ce3f-be36-4c2d-947d-e0ee101a0134 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-815f1091374
32012024-10-01T02:33:20.343ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49233 req_id = a501ce3f-be36-4c2d-947d-e0ee101a0134 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-815f1091374
32022024-10-01T02:33:20.350ZDEBGnexus (dropshot_external): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49233 req_id = a501ce3f-be36-4c2d-947d-e0ee101a0134 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-815f1091374
32032024-10-01T02:33:20.350ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49233 req_id = a501ce3f-be36-4c2d-947d-e0ee101a0134 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-815f1091374
32042024-10-01T02:33:20.353ZDEBGnexus (dropshot_external): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49233 req_id = a501ce3f-be36-4c2d-947d-e0ee101a0134 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-815f1091374
32052024-10-01T02:33:20.353ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49233 req_id = a501ce3f-be36-4c2d-947d-e0ee101a0134 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-815f1091374
32062024-10-01T02:33:20.356ZDEBGnexus (dropshot_external): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49233 req_id = a501ce3f-be36-4c2d-947d-e0ee101a0134 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-815f1091374
32072024-10-01T02:33:20.356ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49233 req_id = a501ce3f-be36-4c2d-947d-e0ee101a0134 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-815f1091374
32082024-10-01T02:33:20.358ZDEBGnexus (dropshot_external): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49233 req_id = a501ce3f-be36-4c2d-947d-e0ee101a0134 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-815f1091374
32092024-10-01T02:33:20.359ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49233 req_id = a501ce3f-be36-4c2d-947d-e0ee101a0134 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-815f1091374
32102024-10-01T02:33:20.361ZDEBGnexus (dropshot_external): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49233 req_id = a501ce3f-be36-4c2d-947d-e0ee101a0134 roles = RoleSet { roles: {(Silo, 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, "admin")} } uri = /v1/vpcs/default?project=proj-815f1091374
32112024-10-01T02:33:20.364ZDEBGnexus (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49233 req_id = a501ce3f-be36-4c2d-947d-e0ee101a0134 resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, lookup_type: ById(21983b87-d6d0-47c6-a33c-5fe68fbed0c6) }, key: d6cd5e95-82db-413f-aa24-4fc56edfc65a, lookup_type: ByName("proj-815f1091374") }, key: d0c53fd8-2027-48ed-90fd-8a4e218435fa, lookup_type: ByName("default") } result = Ok(()) uri = /v1/vpcs/default?project=proj-815f1091374
32122024-10-01T02:33:20.364ZDEBGnexus (dropshot_external): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49233 req_id = a501ce3f-be36-4c2d-947d-e0ee101a0134 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-815f1091374
32132024-10-01T02:33:20.365ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49233 req_id = a501ce3f-be36-4c2d-947d-e0ee101a0134 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-815f1091374
32142024-10-01T02:33:20.368ZDEBGnexus (dropshot_external): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49233 req_id = a501ce3f-be36-4c2d-947d-e0ee101a0134 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-815f1091374
32152024-10-01T02:33:20.368ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49233 req_id = a501ce3f-be36-4c2d-947d-e0ee101a0134 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-815f1091374
32162024-10-01T02:33:20.370ZDEBGnexus (dropshot_external): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49233 req_id = a501ce3f-be36-4c2d-947d-e0ee101a0134 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-815f1091374
32172024-10-01T02:33:20.371ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49233 req_id = a501ce3f-be36-4c2d-947d-e0ee101a0134 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-815f1091374
32182024-10-01T02:33:20.373ZDEBGnexus (dropshot_external): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49233 req_id = a501ce3f-be36-4c2d-947d-e0ee101a0134 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-815f1091374
32192024-10-01T02:33:20.373ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49233 req_id = a501ce3f-be36-4c2d-947d-e0ee101a0134 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-815f1091374
32202024-10-01T02:33:20.375ZDEBGnexus (dropshot_external): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49233 req_id = a501ce3f-be36-4c2d-947d-e0ee101a0134 roles = RoleSet { roles: {(Silo, 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, "admin")} } uri = /v1/vpcs/default?project=proj-815f1091374
32212024-10-01T02:33:20.378ZDEBGnexus (dropshot_external): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49233 req_id = a501ce3f-be36-4c2d-947d-e0ee101a0134 resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, lookup_type: ById(21983b87-d6d0-47c6-a33c-5fe68fbed0c6) }, key: d6cd5e95-82db-413f-aa24-4fc56edfc65a, lookup_type: ByName("proj-815f1091374") }, key: d0c53fd8-2027-48ed-90fd-8a4e218435fa, lookup_type: ByName("default") } result = Ok(()) uri = /v1/vpcs/default?project=proj-815f1091374
32222024-10-01T02:33:20.378ZDEBGnexus (dropshot_external): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49233 req_id = a501ce3f-be36-4c2d-947d-e0ee101a0134 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-815f1091374
32232024-10-01T02:33:20.378ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49233 req_id = a501ce3f-be36-4c2d-947d-e0ee101a0134 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-815f1091374
32242024-10-01T02:33:20.380ZDEBGnexus (dropshot_external): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49233 req_id = a501ce3f-be36-4c2d-947d-e0ee101a0134 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-815f1091374
32252024-10-01T02:33:20.380ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49233 req_id = a501ce3f-be36-4c2d-947d-e0ee101a0134 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-815f1091374
32262024-10-01T02:33:20.404ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
32272024-10-01T02:33:20.405ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "dfdf73be-5411-42ba-932f-79c3f37d61e9", "content-length": "372", "date": "Tue, 01 Oct 2024 02:33:20 GMT"} })
32282024-10-01T02:33:20.405ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32292024-10-01T02:33:20.405ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32302024-10-01T02:33:20.407ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32312024-10-01T02:33:20.408ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32322024-10-01T02:33:20.411ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32332024-10-01T02:33:20.412ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32342024-10-01T02:33:20.412ZDEBGnexus (dropshot_external): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49233 req_id = a501ce3f-be36-4c2d-947d-e0ee101a0134 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-815f1091374
32352024-10-01T02:33:20.413ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49233 req_id = a501ce3f-be36-4c2d-947d-e0ee101a0134 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-815f1091374
32362024-10-01T02:33:20.414ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
32372024-10-01T02:33:20.415ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "7d6ef6cb-9eff-495f-8798-77d258fe10c0", "date": "Tue, 01 Oct 2024 02:33:20 GMT"} })
32382024-10-01T02:33:20.415ZDEBGnexus (dropshot_external): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49233 req_id = a501ce3f-be36-4c2d-947d-e0ee101a0134 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-815f1091374
32392024-10-01T02:33:20.415ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49233 req_id = a501ce3f-be36-4c2d-947d-e0ee101a0134 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-815f1091374
32402024-10-01T02:33:20.416ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 110.934649ms iteration = 2 status = {}
32412024-10-01T02:33:20.418ZDEBGnexus (dropshot_external): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49233 req_id = a501ce3f-be36-4c2d-947d-e0ee101a0134 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-815f1091374
32422024-10-01T02:33:20.418ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49233 req_id = a501ce3f-be36-4c2d-947d-e0ee101a0134 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-815f1091374
32432024-10-01T02:33:20.420ZDEBGnexus (dropshot_external): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49233 req_id = a501ce3f-be36-4c2d-947d-e0ee101a0134 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-815f1091374
32442024-10-01T02:33:20.421ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49233 req_id = a501ce3f-be36-4c2d-947d-e0ee101a0134 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-815f1091374
32452024-10-01T02:33:20.423ZDEBGnexus (dropshot_external): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49233 req_id = a501ce3f-be36-4c2d-947d-e0ee101a0134 roles = RoleSet { roles: {(Silo, 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, "admin")} } uri = /v1/vpcs/default?project=proj-815f1091374
32462024-10-01T02:33:20.426ZDEBGnexus (dropshot_external): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49233 req_id = a501ce3f-be36-4c2d-947d-e0ee101a0134 resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, lookup_type: ById(21983b87-d6d0-47c6-a33c-5fe68fbed0c6) }, key: d6cd5e95-82db-413f-aa24-4fc56edfc65a, lookup_type: ByName("proj-815f1091374") }, key: d0c53fd8-2027-48ed-90fd-8a4e218435fa, lookup_type: ByName("default") }, key: 3ee099b5-5648-4743-8f10-a56b8719e19d, lookup_type: ById(3ee099b5-5648-4743-8f10-a56b8719e19d) } result = Ok(()) uri = /v1/vpcs/default?project=proj-815f1091374
32472024-10-01T02:33:20.426ZDEBGnexus (dropshot_external): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49233 req_id = a501ce3f-be36-4c2d-947d-e0ee101a0134 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-815f1091374
32482024-10-01T02:33:20.426ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49233 req_id = a501ce3f-be36-4c2d-947d-e0ee101a0134 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-815f1091374
32492024-10-01T02:33:20.432ZDEBGnexus (dropshot_external): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49233 req_id = a501ce3f-be36-4c2d-947d-e0ee101a0134 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-815f1091374
32502024-10-01T02:33:20.432ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49233 req_id = a501ce3f-be36-4c2d-947d-e0ee101a0134 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-815f1091374
32512024-10-01T02:33:20.439ZDEBGnexus (dropshot_external): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49233 req_id = a501ce3f-be36-4c2d-947d-e0ee101a0134 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-815f1091374
32522024-10-01T02:33:20.439ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49233 req_id = a501ce3f-be36-4c2d-947d-e0ee101a0134 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-815f1091374
32532024-10-01T02:33:20.442ZDEBGnexus (dropshot_external): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49233 req_id = a501ce3f-be36-4c2d-947d-e0ee101a0134 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-815f1091374
32542024-10-01T02:33:20.442ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49233 req_id = a501ce3f-be36-4c2d-947d-e0ee101a0134 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-815f1091374
32552024-10-01T02:33:20.444ZDEBGnexus (dropshot_external): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49233 req_id = a501ce3f-be36-4c2d-947d-e0ee101a0134 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-815f1091374
32562024-10-01T02:33:20.444ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49233 req_id = a501ce3f-be36-4c2d-947d-e0ee101a0134 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-815f1091374
32572024-10-01T02:33:20.447ZDEBGnexus (dropshot_external): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49233 req_id = a501ce3f-be36-4c2d-947d-e0ee101a0134 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-815f1091374
32582024-10-01T02:33:20.447ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49233 req_id = a501ce3f-be36-4c2d-947d-e0ee101a0134 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-815f1091374
32592024-10-01T02:33:20.448ZDEBGnexus (dropshot_external): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49233 req_id = a501ce3f-be36-4c2d-947d-e0ee101a0134 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-815f1091374
32602024-10-01T02:33:20.449ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49233 req_id = a501ce3f-be36-4c2d-947d-e0ee101a0134 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-815f1091374
32612024-10-01T02:33:20.451ZDEBGnexus (dropshot_external): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49233 req_id = a501ce3f-be36-4c2d-947d-e0ee101a0134 roles = RoleSet { roles: {(Silo, 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, "admin")} } uri = /v1/vpcs/default?project=proj-815f1091374
32622024-10-01T02:33:20.454ZDEBGnexus (dropshot_external): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49233 req_id = a501ce3f-be36-4c2d-947d-e0ee101a0134 resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, lookup_type: ById(21983b87-d6d0-47c6-a33c-5fe68fbed0c6) }, key: d6cd5e95-82db-413f-aa24-4fc56edfc65a, lookup_type: ByName("proj-815f1091374") }, key: d0c53fd8-2027-48ed-90fd-8a4e218435fa, lookup_type: ByName("default") } result = Ok(()) uri = /v1/vpcs/default?project=proj-815f1091374
32632024-10-01T02:33:20.454ZDEBGnexus (dropshot_external): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49233 req_id = a501ce3f-be36-4c2d-947d-e0ee101a0134 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-815f1091374
32642024-10-01T02:33:20.454ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49233 req_id = a501ce3f-be36-4c2d-947d-e0ee101a0134 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-815f1091374
32652024-10-01T02:33:20.466ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 158918 local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49233 req_id = a501ce3f-be36-4c2d-947d-e0ee101a0134 response_code = 204 uri = /v1/vpcs/default?project=proj-815f1091374
32662024-10-01T02:33:20.468ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32672024-10-01T02:33:20.468ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32682024-10-01T02:33:20.469ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32692024-10-01T02:33:20.469ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32702024-10-01T02:33:20.471ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
32712024-10-01T02:33:20.472ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "b2603776c17391bc0ca280d341de87edae62e8df", lookup_type: ByCompositeId("token = \\"b2603776c17391bc0ca280d341de87edae62e8df\\"") } result = Ok(())
32722024-10-01T02:33:20.472ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32732024-10-01T02:33:20.472ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32742024-10-01T02:33:20.473ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32752024-10-01T02:33:20.473ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32762024-10-01T02:33:20.475ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32772024-10-01T02:33:20.475ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32782024-10-01T02:33:20.476ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32792024-10-01T02:33:20.477ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32802024-10-01T02:33:20.478ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
32812024-10-01T02:33:20.479ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, lookup_type: ById(21983b87-d6d0-47c6-a33c-5fe68fbed0c6) }, key: 8fbcb238-2807-4312-9499-49292447c1fc, lookup_type: ById(8fbcb238-2807-4312-9499-49292447c1fc) } result = Ok(())
32822024-10-01T02:33:20.479ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32832024-10-01T02:33:20.479ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32842024-10-01T02:33:20.481ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
32852024-10-01T02:33:20.482ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "b2603776c17391bc0ca280d341de87edae62e8df", lookup_type: ByCompositeId("b2603776c17391bc0ca280d341de87edae62e8df") } result = Ok(())
32862024-10-01T02:33:20.482ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32872024-10-01T02:33:20.482ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32882024-10-01T02:33:20.488ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32892024-10-01T02:33:20.488ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32902024-10-01T02:33:20.489ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32912024-10-01T02:33:20.489ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32922024-10-01T02:33:20.491ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32932024-10-01T02:33:20.491ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32942024-10-01T02:33:20.492ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32952024-10-01T02:33:20.493ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32962024-10-01T02:33:20.494ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
32972024-10-01T02:33:20.495ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, lookup_type: ById(21983b87-d6d0-47c6-a33c-5fe68fbed0c6) }, key: 8fbcb238-2807-4312-9499-49292447c1fc, lookup_type: ById(8fbcb238-2807-4312-9499-49292447c1fc) } result = Ok(())
32982024-10-01T02:33:20.495ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32992024-10-01T02:33:20.495ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
33002024-10-01T02:33:20.496ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
33012024-10-01T02:33:20.497ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
33022024-10-01T02:33:20.498ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
33032024-10-01T02:33:20.498ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
33042024-10-01T02:33:20.499ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
33052024-10-01T02:33:20.501ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, lookup_type: ById(21983b87-d6d0-47c6-a33c-5fe68fbed0c6) } result = Ok(())
33062024-10-01T02:33:20.501ZDEBGnexus (dropshot_external): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49233 req_id = fedcebcb-ab26-4f26-ad64-d63639f1bd91 roles = RoleSet { roles: {} } uri = /v1/projects/proj-815f1091374
33072024-10-01T02:33:20.501ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49233 req_id = fedcebcb-ab26-4f26-ad64-d63639f1bd91 resource = Database result = Ok(()) uri = /v1/projects/proj-815f1091374
33082024-10-01T02:33:20.502ZDEBGnexus (dropshot_external): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49233 req_id = fedcebcb-ab26-4f26-ad64-d63639f1bd91 roles = RoleSet { roles: {} } uri = /v1/projects/proj-815f1091374
33092024-10-01T02:33:20.502ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49233 req_id = fedcebcb-ab26-4f26-ad64-d63639f1bd91 resource = Database result = Ok(()) uri = /v1/projects/proj-815f1091374
33102024-10-01T02:33:20.504ZDEBGnexus (dropshot_external): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49233 req_id = fedcebcb-ab26-4f26-ad64-d63639f1bd91 roles = RoleSet { roles: {} } uri = /v1/projects/proj-815f1091374
33112024-10-01T02:33:20.504ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49233 req_id = fedcebcb-ab26-4f26-ad64-d63639f1bd91 resource = Database result = Ok(()) uri = /v1/projects/proj-815f1091374
33122024-10-01T02:33:20.506ZDEBGnexus (dropshot_external): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49233 req_id = fedcebcb-ab26-4f26-ad64-d63639f1bd91 roles = RoleSet { roles: {} } uri = /v1/projects/proj-815f1091374
33132024-10-01T02:33:20.506ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49233 req_id = fedcebcb-ab26-4f26-ad64-d63639f1bd91 resource = Database result = Ok(()) uri = /v1/projects/proj-815f1091374
33142024-10-01T02:33:20.508ZDEBGnexus (dropshot_external): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49233 req_id = fedcebcb-ab26-4f26-ad64-d63639f1bd91 roles = RoleSet { roles: {} } uri = /v1/projects/proj-815f1091374
33152024-10-01T02:33:20.509ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49233 req_id = fedcebcb-ab26-4f26-ad64-d63639f1bd91 resource = Database result = Ok(()) uri = /v1/projects/proj-815f1091374
33162024-10-01T02:33:20.511ZDEBGnexus (dropshot_external): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49233 req_id = fedcebcb-ab26-4f26-ad64-d63639f1bd91 roles = RoleSet { roles: {} } uri = /v1/projects/proj-815f1091374
33172024-10-01T02:33:20.511ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49233 req_id = fedcebcb-ab26-4f26-ad64-d63639f1bd91 resource = Database result = Ok(()) uri = /v1/projects/proj-815f1091374
33182024-10-01T02:33:20.513ZDEBGnexus (dropshot_external): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49233 req_id = fedcebcb-ab26-4f26-ad64-d63639f1bd91 roles = RoleSet { roles: {(Silo, 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, "admin")} } uri = /v1/projects/proj-815f1091374
33192024-10-01T02:33:20.515ZDEBGnexus (dropshot_external): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49233 req_id = fedcebcb-ab26-4f26-ad64-d63639f1bd91 resource = Project { parent: Silo { parent: Fleet, key: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, lookup_type: ById(21983b87-d6d0-47c6-a33c-5fe68fbed0c6) }, key: d6cd5e95-82db-413f-aa24-4fc56edfc65a, lookup_type: ByName("proj-815f1091374") } result = Ok(()) uri = /v1/projects/proj-815f1091374
33202024-10-01T02:33:20.515ZDEBGnexus (dropshot_external): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49233 req_id = fedcebcb-ab26-4f26-ad64-d63639f1bd91 roles = RoleSet { roles: {} } uri = /v1/projects/proj-815f1091374
33212024-10-01T02:33:20.515ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49233 req_id = fedcebcb-ab26-4f26-ad64-d63639f1bd91 resource = Database result = Ok(()) uri = /v1/projects/proj-815f1091374
33222024-10-01T02:33:20.517ZDEBGnexus (dropshot_external): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49233 req_id = fedcebcb-ab26-4f26-ad64-d63639f1bd91 roles = RoleSet { roles: {} } uri = /v1/projects/proj-815f1091374
33232024-10-01T02:33:20.517ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49233 req_id = fedcebcb-ab26-4f26-ad64-d63639f1bd91 resource = Database result = Ok(()) uri = /v1/projects/proj-815f1091374
33242024-10-01T02:33:20.519ZDEBGnexus (dropshot_external): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49233 req_id = fedcebcb-ab26-4f26-ad64-d63639f1bd91 roles = RoleSet { roles: {} } uri = /v1/projects/proj-815f1091374
33252024-10-01T02:33:20.519ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49233 req_id = fedcebcb-ab26-4f26-ad64-d63639f1bd91 resource = Database result = Ok(()) uri = /v1/projects/proj-815f1091374
33262024-10-01T02:33:20.522ZDEBGnexus (dropshot_external): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49233 req_id = fedcebcb-ab26-4f26-ad64-d63639f1bd91 roles = RoleSet { roles: {} } uri = /v1/projects/proj-815f1091374
33272024-10-01T02:33:20.522ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49233 req_id = fedcebcb-ab26-4f26-ad64-d63639f1bd91 resource = Database result = Ok(()) uri = /v1/projects/proj-815f1091374
33282024-10-01T02:33:20.524ZDEBGnexus (dropshot_external): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49233 req_id = fedcebcb-ab26-4f26-ad64-d63639f1bd91 roles = RoleSet { roles: {(Silo, 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, "admin")} } uri = /v1/projects/proj-815f1091374
33292024-10-01T02:33:20.526ZDEBGnexus (dropshot_external): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49233 req_id = fedcebcb-ab26-4f26-ad64-d63639f1bd91 resource = Project { parent: Silo { parent: Fleet, key: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, lookup_type: ById(21983b87-d6d0-47c6-a33c-5fe68fbed0c6) }, key: d6cd5e95-82db-413f-aa24-4fc56edfc65a, lookup_type: ByName("proj-815f1091374") } result = Ok(()) uri = /v1/projects/proj-815f1091374
33302024-10-01T02:33:20.526ZDEBGnexus (dropshot_external): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49233 req_id = fedcebcb-ab26-4f26-ad64-d63639f1bd91 roles = RoleSet { roles: {} } uri = /v1/projects/proj-815f1091374
33312024-10-01T02:33:20.526ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49233 req_id = fedcebcb-ab26-4f26-ad64-d63639f1bd91 resource = Database result = Ok(()) uri = /v1/projects/proj-815f1091374
33322024-10-01T02:33:20.529ZDEBGnexus (dropshot_external): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49233 req_id = fedcebcb-ab26-4f26-ad64-d63639f1bd91 roles = RoleSet { roles: {} } uri = /v1/projects/proj-815f1091374
33332024-10-01T02:33:20.529ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49233 req_id = fedcebcb-ab26-4f26-ad64-d63639f1bd91 resource = Database result = Ok(()) uri = /v1/projects/proj-815f1091374
33342024-10-01T02:33:20.541ZDEBGnexus (dropshot_external): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49233 req_id = fedcebcb-ab26-4f26-ad64-d63639f1bd91 roles = RoleSet { roles: {} } uri = /v1/projects/proj-815f1091374
33352024-10-01T02:33:20.541ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49233 req_id = fedcebcb-ab26-4f26-ad64-d63639f1bd91 resource = Database result = Ok(()) uri = /v1/projects/proj-815f1091374
33362024-10-01T02:33:20.553ZDEBGnexus (dropshot_external): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49233 req_id = fedcebcb-ab26-4f26-ad64-d63639f1bd91 roles = RoleSet { roles: {} } uri = /v1/projects/proj-815f1091374
33372024-10-01T02:33:20.553ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49233 req_id = fedcebcb-ab26-4f26-ad64-d63639f1bd91 resource = Database result = Ok(()) uri = /v1/projects/proj-815f1091374
33382024-10-01T02:33:20.582ZDEBGnexus (dropshot_external): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49233 req_id = fedcebcb-ab26-4f26-ad64-d63639f1bd91 roles = RoleSet { roles: {} } uri = /v1/projects/proj-815f1091374
33392024-10-01T02:33:20.583ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49233 req_id = fedcebcb-ab26-4f26-ad64-d63639f1bd91 resource = Database result = Ok(()) uri = /v1/projects/proj-815f1091374
33402024-10-01T02:33:20.596ZDEBGnexus (dropshot_external): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49233 req_id = fedcebcb-ab26-4f26-ad64-d63639f1bd91 roles = RoleSet { roles: {} } uri = /v1/projects/proj-815f1091374
33412024-10-01T02:33:20.597ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49233 req_id = fedcebcb-ab26-4f26-ad64-d63639f1bd91 resource = Database result = Ok(()) uri = /v1/projects/proj-815f1091374
33422024-10-01T02:33:20.599ZDEBGnexus (dropshot_external): roles actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49233 req_id = fedcebcb-ab26-4f26-ad64-d63639f1bd91 roles = RoleSet { roles: {} } uri = /v1/projects/proj-815f1091374
33432024-10-01T02:33:20.599ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 8fbcb238-2807-4312-9499-49292447c1fc, silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, .. }) actor_id = 8fbcb238-2807-4312-9499-49292447c1fc authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49233 req_id = fedcebcb-ab26-4f26-ad64-d63639f1bd91 resource = Database result = Ok(()) uri = /v1/projects/proj-815f1091374
33442024-10-01T02:33:20.612ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 145533 local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49233 req_id = fedcebcb-ab26-4f26-ad64-d63639f1bd91 response_code = 204 uri = /v1/projects/proj-815f1091374
33452024-10-01T02:33:21.489ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 2 reason = Timeout
33462024-10-01T02:33:21.489ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33472024-10-01T02:33:21.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33482024-10-01T02:33:21.489ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 2 reason = Timeout
33492024-10-01T02:33:21.489ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
33502024-10-01T02:33:21.490ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
33512024-10-01T02:33:21.491ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33522024-10-01T02:33:21.493ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
33532024-10-01T02:33:21.494ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33542024-10-01T02:33:21.494ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33552024-10-01T02:33:21.496ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33562024-10-01T02:33:21.496ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33572024-10-01T02:33:21.498ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33582024-10-01T02:33:21.501ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8f598f5c-ad31-4712-b43f-7ac75a933d07, lookup_type: ById(8f598f5c-ad31-4712-b43f-7ac75a933d07) } result = Ok(())
33592024-10-01T02:33:21.501ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33602024-10-01T02:33:21.501ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33612024-10-01T02:33:21.520ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
33622024-10-01T02:33:21.520ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
33632024-10-01T02:33:21.522ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 32.2058ms iteration = 2 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
33642024-10-01T02:33:21.732ZINFOnexus (BackgroundTasks): found new target blueprint (first find) background_task = blueprint_loader file = nexus/src/app/background/tasks/blueprint_load.rs:88 target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 time_created = 2024-10-01 02:32:51.153042 UTC
33652024-10-01T02:33:21.732ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 243.129664ms iteration = 2 status = {"enabled":false,"status":"first target blueprint","target_id":"8f598f5c-ad31-4712-b43f-7ac75a933d07","time_created":"2024-10-01T02:32:51.153042Z","time_found":"2024-10-01T02:33:21.732748835Z"}
33662024-10-01T02:33:21.732ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 2 reason = Dependency
33672024-10-01T02:33:21.732ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07
33682024-10-01T02:33:21.732ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 6.93\u{b5}s iteration = 2 status = {"enabled":false,"target_id":"8f598f5c-ad31-4712-b43f-7ac75a933d07"}
33692024-10-01T02:33:21.732ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 2 reason = Dependency
33702024-10-01T02:33:21.732ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
33712024-10-01T02:33:21.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
33722024-10-01T02:33:21.733ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
33732024-10-01T02:33:21.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
33742024-10-01T02:33:21.733ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
33752024-10-01T02:33:21.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
33762024-10-01T02:33:21.733ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
33772024-10-01T02:33:21.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
33782024-10-01T02:33:21.733ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
33792024-10-01T02:33:21.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
33802024-10-01T02:33:21.735ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33812024-10-01T02:33:21.737ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
33822024-10-01T02:33:21.737ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
33832024-10-01T02:33:21.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
33842024-10-01T02:33:21.737ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33852024-10-01T02:33:21.739ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
33862024-10-01T02:33:21.739ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
33872024-10-01T02:33:21.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
33882024-10-01T02:33:21.739ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33892024-10-01T02:33:21.741ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
33902024-10-01T02:33:21.741ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
33912024-10-01T02:33:21.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
33922024-10-01T02:33:21.741ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33932024-10-01T02:33:21.743ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
33942024-10-01T02:33:21.743ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
33952024-10-01T02:33:21.743ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
33962024-10-01T02:33:21.743ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33972024-10-01T02:33:21.745ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
33982024-10-01T02:33:21.745ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
33992024-10-01T02:33:21.745ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
34002024-10-01T02:33:21.779ZDEBGnexus (BackgroundTasks): client request background_task = crdb_node_id_collector body = None method = GET uri = http://[fd00:1122:3344:101::4]:32222/node/id
34012024-10-01T02:33:21.813ZDEBGnexus (BackgroundTasks): client request background_task = crdb_node_id_collector body = None method = GET uri = http://[fd00:1122:3344:101::5]:32222/node/id
34022024-10-01T02:33:21.847ZDEBGnexus (BackgroundTasks): client request background_task = crdb_node_id_collector body = None method = GET uri = http://[fd00:1122:3344:101::3]:32222/node/id
34032024-10-01T02:33:21.881ZDEBGnexus (BackgroundTasks): client request background_task = crdb_node_id_collector body = None method = GET uri = http://[fd00:1122:3344:101::6]:32222/node/id
34042024-10-01T02:33:21.916ZDEBGnexus (BackgroundTasks): client request background_task = crdb_node_id_collector body = None method = GET uri = http://[fd00:1122:3344:101::7]:32222/node/id
34052024-10-01T02:33:22.263ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:61510
34062024-10-01T02:33:22.264ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:61510 req_id = b840aa32-72e8-4101-9e98-dd6d262aa313 roles = RoleSet { roles: {} } uri = /metrics/producers
34072024-10-01T02:33:22.265ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:61510 req_id = b840aa32-72e8-4101-9e98-dd6d262aa313 resource = Database result = Ok(()) uri = /metrics/producers
34082024-10-01T02:33:22.310ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 41f2943e-6041-44c9-a47a-3cf5fb012644
34092024-10-01T02:33:22.310ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:61510 req_id = b840aa32-72e8-4101-9e98-dd6d262aa313 roles = RoleSet { roles: {} } uri = /metrics/producers
34102024-10-01T02:33:22.310ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:61510 req_id = b840aa32-72e8-4101-9e98-dd6d262aa313 resource = Database result = Ok(()) uri = /metrics/producers
34112024-10-01T02:33:22.319ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 41f2943e-6041-44c9-a47a-3cf5fb012644 uri = http://[fd00:1122:3344:101::d]:12223/producers
34122024-10-01T02:33:22.319ZDEBGnexus: client response oximeter-collector = 41f2943e-6041-44c9-a47a-3cf5fb012644 result = Ok(Response { url: "http://[fd00:1122:3344:101::d]:12223/producers", status: 204, headers: {"x-request-id": "50fce029-3588-4f62-997c-fe173f3ba226", "date": "Tue, 01 Oct 2024 02:33:22 GMT"} })
34132024-10-01T02:33:22.319ZINFOnexus: assigned collector to new producer collector_id = 41f2943e-6041-44c9-a47a-3cf5fb012644 file = nexus/src/app/oximeter.rs:125 producer_id = 2a571ec0-85a3-450e-88fc-680c13ffa211
34142024-10-01T02:33:22.320ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 56380 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:61510 req_id = b840aa32-72e8-4101-9e98-dd6d262aa313 response_code = 201 uri = /metrics/producers
34152024-10-01T02:33:22.464ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:53383
34162024-10-01T02:33:22.468ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:53383 req_id = 61cc0a9d-86d8-443d-a432-ba6660dea4a9 roles = RoleSet { roles: {} } uri = /metrics/producers
34172024-10-01T02:33:22.469ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:53383 req_id = 61cc0a9d-86d8-443d-a432-ba6660dea4a9 resource = Database result = Ok(()) uri = /metrics/producers
34182024-10-01T02:33:22.506ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 41f2943e-6041-44c9-a47a-3cf5fb012644
34192024-10-01T02:33:22.506ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:53383 req_id = 61cc0a9d-86d8-443d-a432-ba6660dea4a9 roles = RoleSet { roles: {} } uri = /metrics/producers
34202024-10-01T02:33:22.506ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:53383 req_id = 61cc0a9d-86d8-443d-a432-ba6660dea4a9 resource = Database result = Ok(()) uri = /metrics/producers
34212024-10-01T02:33:22.513ZDEBGnexus (BackgroundTasks): client response background_task = crdb_node_id_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::5]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "02cc5fd8-7f5e-4b0c-970f-280d4f206c7f", "content-length": "64", "date": "Tue, 01 Oct 2024 02:33:22 GMT"} })
34222024-10-01T02:33:22.513ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
34232024-10-01T02:33:22.513ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
34242024-10-01T02:33:22.515ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34252024-10-01T02:33:22.516ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
34262024-10-01T02:33:22.516ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
34272024-10-01T02:33:22.516ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
34282024-10-01T02:33:22.527ZDEBGnexus (BackgroundTasks): client response background_task = crdb_node_id_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::7]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "3b7798be-45a5-48c8-9971-009e3517df12", "content-length": "64", "date": "Tue, 01 Oct 2024 02:33:21 GMT"} })
34292024-10-01T02:33:22.527ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
34302024-10-01T02:33:22.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
34312024-10-01T02:33:22.530ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34322024-10-01T02:33:22.531ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
34332024-10-01T02:33:22.531ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
34342024-10-01T02:33:22.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
34352024-10-01T02:33:22.539ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 41f2943e-6041-44c9-a47a-3cf5fb012644 uri = http://[fd00:1122:3344:101::d]:12223/producers
34362024-10-01T02:33:22.539ZDEBGnexus: client response oximeter-collector = 41f2943e-6041-44c9-a47a-3cf5fb012644 result = Ok(Response { url: "http://[fd00:1122:3344:101::d]:12223/producers", status: 204, headers: {"x-request-id": "efa291e4-71fb-4ecd-a251-66c7466d1322", "date": "Tue, 01 Oct 2024 02:33:22 GMT"} })
34372024-10-01T02:33:22.539ZINFOnexus: assigned collector to new producer collector_id = 41f2943e-6041-44c9-a47a-3cf5fb012644 file = nexus/src/app/oximeter.rs:125 producer_id = 4fd91d04-882e-49df-98b0-1430a0f50382
34382024-10-01T02:33:22.543ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 74927 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:53383 req_id = 61cc0a9d-86d8-443d-a432-ba6660dea4a9 response_code = 201 uri = /metrics/producers
34392024-10-01T02:33:22.563ZDEBGnexus (BackgroundTasks): client response background_task = crdb_node_id_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::4]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "3b57ecdf-7ecf-435d-befa-548611559b89", "content-length": "64", "date": "Tue, 01 Oct 2024 02:33:22 GMT"} })
34402024-10-01T02:33:22.563ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
34412024-10-01T02:33:22.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
34422024-10-01T02:33:22.565ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34432024-10-01T02:33:22.566ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
34442024-10-01T02:33:22.566ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
34452024-10-01T02:33:22.566ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
34462024-10-01T02:33:22.572ZDEBGnexus (BackgroundTasks): client response background_task = crdb_node_id_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::6]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "5d25f61e-f6d9-45b1-b4c6-d24acd2247f7", "content-length": "64", "date": "Tue, 01 Oct 2024 02:33:22 GMT"} })
34472024-10-01T02:33:22.572ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
34482024-10-01T02:33:22.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
34492024-10-01T02:33:22.574ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34502024-10-01T02:33:22.575ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
34512024-10-01T02:33:22.575ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
34522024-10-01T02:33:22.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
34532024-10-01T02:33:22.592ZDEBGnexus (BackgroundTasks): client response background_task = crdb_node_id_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::3]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "0b99b663-f9c7-4452-909c-7d06411d25b0", "content-length": "64", "date": "Tue, 01 Oct 2024 02:33:22 GMT"} })
34542024-10-01T02:33:22.592ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
34552024-10-01T02:33:22.592ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
34562024-10-01T02:33:22.594ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34572024-10-01T02:33:22.595ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
34582024-10-01T02:33:22.595ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
34592024-10-01T02:33:22.595ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
34602024-10-01T02:33:22.607ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 874.443163ms iteration = 2 status = {"nsuccess":5}
34612024-10-01T02:33:24.825ZINFOnexus (dropshot): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:53319 remote_addr = [fd00:1122:3344:101::d]:65459
34622024-10-01T02:33:24.832ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 7406 local_addr = [fd00:1122:3344:101::c]:53319 method = GET remote_addr = [fd00:1122:3344:101::d]:65459 req_id = d2275058-4b2d-4290-bc07-d4b870c2a3ae response_code = 200 uri = /3dfd7033-71d8-4eb9-bb97-49dae3b5cd35
34632024-10-01T02:33:24.918ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:56815
34642024-10-01T02:33:24.919ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:56815 req_id = db9bb9f6-6b70-48e4-9701-ee3ae9c29fba roles = RoleSet { roles: {} } uri = /metrics/producers
34652024-10-01T02:33:24.919ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:56815 req_id = db9bb9f6-6b70-48e4-9701-ee3ae9c29fba resource = Database result = Ok(()) uri = /metrics/producers
34662024-10-01T02:33:24.951ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 41f2943e-6041-44c9-a47a-3cf5fb012644
34672024-10-01T02:33:24.951ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:56815 req_id = db9bb9f6-6b70-48e4-9701-ee3ae9c29fba roles = RoleSet { roles: {} } uri = /metrics/producers
34682024-10-01T02:33:24.951ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:56815 req_id = db9bb9f6-6b70-48e4-9701-ee3ae9c29fba resource = Database result = Ok(()) uri = /metrics/producers
34692024-10-01T02:33:25.002ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 41f2943e-6041-44c9-a47a-3cf5fb012644 uri = http://[fd00:1122:3344:101::d]:12223/producers
34702024-10-01T02:33:25.003ZDEBGnexus: client response oximeter-collector = 41f2943e-6041-44c9-a47a-3cf5fb012644 result = Ok(Response { url: "http://[fd00:1122:3344:101::d]:12223/producers", status: 204, headers: {"x-request-id": "3d915324-0d07-4aca-93fb-dbb84ab0e244", "date": "Tue, 01 Oct 2024 02:33:25 GMT"} })
34712024-10-01T02:33:25.003ZINFOnexus: assigned collector to new producer collector_id = 41f2943e-6041-44c9-a47a-3cf5fb012644 file = nexus/src/app/oximeter.rs:125 producer_id = 4de8ea2f-2b9b-467c-9e71-58559e244afd
34722024-10-01T02:33:25.004ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 85964 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:56815 req_id = db9bb9f6-6b70-48e4-9701-ee3ae9c29fba response_code = 201 uri = /metrics/producers
34732024-10-01T02:33:29.072ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:49622
34742024-10-01T02:33:29.077ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:49622 req_id = c2f9ba18-91ed-4f55-8864-c2a2bf6e563d roles = RoleSet { roles: {} } uri = /metrics/producers
34752024-10-01T02:33:29.077ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:49622 req_id = c2f9ba18-91ed-4f55-8864-c2a2bf6e563d resource = Database result = Ok(()) uri = /metrics/producers
34762024-10-01T02:33:29.110ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 41f2943e-6041-44c9-a47a-3cf5fb012644
34772024-10-01T02:33:29.110ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:49622 req_id = c2f9ba18-91ed-4f55-8864-c2a2bf6e563d roles = RoleSet { roles: {} } uri = /metrics/producers
34782024-10-01T02:33:29.110ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:49622 req_id = c2f9ba18-91ed-4f55-8864-c2a2bf6e563d resource = Database result = Ok(()) uri = /metrics/producers
34792024-10-01T02:33:29.137ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 41f2943e-6041-44c9-a47a-3cf5fb012644 uri = http://[fd00:1122:3344:101::d]:12223/producers
34802024-10-01T02:33:29.137ZDEBGnexus: client response oximeter-collector = 41f2943e-6041-44c9-a47a-3cf5fb012644 result = Ok(Response { url: "http://[fd00:1122:3344:101::d]:12223/producers", status: 204, headers: {"x-request-id": "92982a39-6aea-49d9-b989-da455f33087c", "date": "Tue, 01 Oct 2024 02:33:29 GMT"} })
34812024-10-01T02:33:29.137ZINFOnexus: assigned collector to new producer collector_id = 41f2943e-6041-44c9-a47a-3cf5fb012644 file = nexus/src/app/oximeter.rs:125 producer_id = be900b2d-36c9-44e6-addb-3422c3cbaaec
34822024-10-01T02:33:29.139ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 63631 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:49622 req_id = c2f9ba18-91ed-4f55-8864-c2a2bf6e563d response_code = 201 uri = /metrics/producers
34832024-10-01T02:33:31.488ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 3 reason = Timeout
34842024-10-01T02:33:31.489ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34852024-10-01T02:33:31.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34862024-10-01T02:33:31.489ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 3 reason = Timeout
34872024-10-01T02:33:31.489ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
34882024-10-01T02:33:31.490ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
34892024-10-01T02:33:31.491ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34902024-10-01T02:33:31.492ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
34912024-10-01T02:33:31.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
34922024-10-01T02:33:31.493ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
34932024-10-01T02:33:31.493ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34942024-10-01T02:33:31.494ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34952024-10-01T02:33:31.494ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.608047ms iteration = 3 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
34962024-10-01T02:33:31.496ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34972024-10-01T02:33:31.496ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34982024-10-01T02:33:31.497ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34992024-10-01T02:33:31.500ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8f598f5c-ad31-4712-b43f-7ac75a933d07, lookup_type: ById(8f598f5c-ad31-4712-b43f-7ac75a933d07) } result = Ok(())
35002024-10-01T02:33:31.500ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35012024-10-01T02:33:31.500ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35022024-10-01T02:33:31.506ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 original_time_created = 2024-10-01 02:32:51.153042 UTC target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 time_created = 2024-10-01 02:32:51.153042 UTC
35032024-10-01T02:33:31.506ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.027552ms iteration = 3 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8f598f5c-ad31-4712-b43f-7ac75a933d07","time_created":"2024-10-01T02:32:51.153042Z"}
35042024-10-01T02:33:33.040ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:60878
35052024-10-01T02:33:33.041ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:60878 req_id = 5426308e-4760-42fc-b993-8ea8859113be roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/0?limit=100
35062024-10-01T02:33:33.041ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:60878 req_id = 5426308e-4760-42fc-b993-8ea8859113be resource = Database result = Ok(()) uri = /nat/ipv4/changeset/0?limit=100
35072024-10-01T02:33:33.066ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 25397 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:60878 req_id = 5426308e-4760-42fc-b993-8ea8859113be response_code = 200 uri = /nat/ipv4/changeset/0?limit=100
35082024-10-01T02:33:34.826ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1299 local_addr = [fd00:1122:3344:101::c]:53319 method = GET remote_addr = [fd00:1122:3344:101::d]:65459 req_id = 1fc0d1e1-f591-4433-a8f6-959c4ff7669e response_code = 200 uri = /3dfd7033-71d8-4eb9-bb97-49dae3b5cd35
35092024-10-01T02:33:41.489ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 4 reason = Timeout
35102024-10-01T02:33:41.489ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 2 reason = Timeout
35112024-10-01T02:33:41.489ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35122024-10-01T02:33:41.489ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 2 reason = Timeout
35132024-10-01T02:33:41.489ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
35142024-10-01T02:33:41.489ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 4 reason = Timeout
35152024-10-01T02:33:41.489ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
35162024-10-01T02:33:41.489ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
35172024-10-01T02:33:41.489ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 2 reason = Timeout
35182024-10-01T02:33:41.489ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 2 reason = Timeout
35192024-10-01T02:33:41.489ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
35202024-10-01T02:33:41.489ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 2 reason = Timeout
35212024-10-01T02:33:41.489ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 2 reason = Timeout
35222024-10-01T02:33:41.489ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
35232024-10-01T02:33:41.489ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
35242024-10-01T02:33:41.489ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 2 reason = Timeout
35252024-10-01T02:33:41.489ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35262024-10-01T02:33:41.490ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
35272024-10-01T02:33:41.490ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35282024-10-01T02:33:41.490ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
35292024-10-01T02:33:41.490ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
35302024-10-01T02:33:41.490ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
35312024-10-01T02:33:41.490ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
35322024-10-01T02:33:41.490ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
35332024-10-01T02:33:41.490ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35342024-10-01T02:33:41.490ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 4 reason = Timeout
35352024-10-01T02:33:41.490ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 2 reason = Timeout
35362024-10-01T02:33:41.490ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
35372024-10-01T02:33:41.490ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 2 reason = Timeout
35382024-10-01T02:33:41.490ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
35392024-10-01T02:33:41.490ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
35402024-10-01T02:33:41.490ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 2 reason = Timeout
35412024-10-01T02:33:41.490ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
35422024-10-01T02:33:41.490ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 2 reason = Timeout
35432024-10-01T02:33:41.490ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
35442024-10-01T02:33:41.490ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 2 reason = Timeout
35452024-10-01T02:33:41.490ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
35462024-10-01T02:33:41.490ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 2 reason = Timeout
35472024-10-01T02:33:41.490ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
35482024-10-01T02:33:41.491ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
35492024-10-01T02:33:41.491ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 3 reason = Timeout
35502024-10-01T02:33:41.491ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
35512024-10-01T02:33:41.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
35522024-10-01T02:33:41.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
35532024-10-01T02:33:41.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
35542024-10-01T02:33:41.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
35552024-10-01T02:33:41.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
35562024-10-01T02:33:41.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
35572024-10-01T02:33:41.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
35582024-10-01T02:33:41.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
35592024-10-01T02:33:41.492ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35602024-10-01T02:33:41.492ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35612024-10-01T02:33:41.492ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.236944ms iteration = 2 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
35622024-10-01T02:33:41.493ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35632024-10-01T02:33:41.494ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
35642024-10-01T02:33:41.494ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
35652024-10-01T02:33:41.494ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
35662024-10-01T02:33:41.495ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
35672024-10-01T02:33:41.495ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35682024-10-01T02:33:41.496ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35692024-10-01T02:33:41.496ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1274, tv_nsec: 939552600 } })
35702024-10-01T02:33:41.496ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1051
35712024-10-01T02:33:41.496ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
35722024-10-01T02:33:41.496ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
35732024-10-01T02:33:41.496ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
35742024-10-01T02:33:41.498ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35752024-10-01T02:33:41.498ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 8.012834ms iteration = 2 status = {"errors":[],"records_set_to_done":[]}
35762024-10-01T02:33:41.499ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
35772024-10-01T02:33:41.499ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
35782024-10-01T02:33:41.499ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35792024-10-01T02:33:41.499ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35802024-10-01T02:33:41.500ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
35812024-10-01T02:33:41.500ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35822024-10-01T02:33:41.501ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35832024-10-01T02:33:41.501ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
35842024-10-01T02:33:41.501ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
35852024-10-01T02:33:41.502ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
35862024-10-01T02:33:41.502ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
35872024-10-01T02:33:41.502ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
35882024-10-01T02:33:41.502ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
35892024-10-01T02:33:41.502ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
35902024-10-01T02:33:41.502ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
35912024-10-01T02:33:41.502ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
35922024-10-01T02:33:41.503ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
35932024-10-01T02:33:41.504ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
35942024-10-01T02:33:41.504ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
35952024-10-01T02:33:41.504ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35962024-10-01T02:33:41.505ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35972024-10-01T02:33:41.505ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
35982024-10-01T02:33:41.505ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
35992024-10-01T02:33:41.507ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36002024-10-01T02:33:41.508ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1274, tv_nsec: 951878657 } })
36012024-10-01T02:33:41.508ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1051 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd
36022024-10-01T02:33:41.510ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
36032024-10-01T02:33:41.510ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36042024-10-01T02:33:41.510ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36052024-10-01T02:33:41.512ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
36062024-10-01T02:33:41.512ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 21.633443ms iteration = 2 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
36072024-10-01T02:33:41.531ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 40.58954ms iteration = 2 status = {"errors":[],"garbage_collect_requested":[]}
36082024-10-01T02:33:41.536ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
36092024-10-01T02:33:41.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
36102024-10-01T02:33:41.537ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 48.111266ms iteration = 2 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
36112024-10-01T02:33:41.539ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36122024-10-01T02:33:41.541ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
36132024-10-01T02:33:41.541ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
36142024-10-01T02:33:41.541ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
36152024-10-01T02:33:41.541ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
36162024-10-01T02:33:41.541ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
36172024-10-01T02:33:41.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
36182024-10-01T02:33:41.541ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
36192024-10-01T02:33:41.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
36202024-10-01T02:33:41.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
36212024-10-01T02:33:41.544ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36222024-10-01T02:33:41.544ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
36232024-10-01T02:33:41.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
36242024-10-01T02:33:41.546ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8f598f5c-ad31-4712-b43f-7ac75a933d07, lookup_type: ById(8f598f5c-ad31-4712-b43f-7ac75a933d07) } result = Ok(())
36252024-10-01T02:33:41.546ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36262024-10-01T02:33:41.546ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36272024-10-01T02:33:41.579ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 88.604425ms iteration = 4 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
36282024-10-01T02:33:41.579ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
36292024-10-01T02:33:41.579ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
36302024-10-01T02:33:41.579ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
36312024-10-01T02:33:41.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
36322024-10-01T02:33:41.582ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 91.656586ms iteration = 2 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
36332024-10-01T02:33:41.585ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1059 zone_address = fd00:1122:3344:101::2
36342024-10-01T02:33:41.585ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
36352024-10-01T02:33:41.585ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "9c5572cd-169a-479d-9240-9d62b066cd99", "content-length": "26", "date": "Tue, 01 Oct 2024 02:33:41 GMT"} })
36362024-10-01T02:33:41.585ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1064 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
36372024-10-01T02:33:41.587ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
36382024-10-01T02:33:41.607ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
36392024-10-01T02:33:41.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
36402024-10-01T02:33:41.627ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 137.700047ms iteration = 4 status = {"physical_disks_added":0}
36412024-10-01T02:33:41.633ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1275, tv_nsec: 76830411 } })
36422024-10-01T02:33:41.633ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1051
36432024-10-01T02:33:41.709ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 219.661411ms iteration = 2 status = {}
36442024-10-01T02:33:41.727ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
36452024-10-01T02:33:41.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
36462024-10-01T02:33:41.731ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
36472024-10-01T02:33:41.731ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1059 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd zone_address = fd00:1122:3344:101::2
36482024-10-01T02:33:41.731ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
36492024-10-01T02:33:41.732ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "dae1d1f8-b97f-42a1-a626-cf1d810fa598", "content-length": "26", "date": "Tue, 01 Oct 2024 02:33:41 GMT"} })
36502024-10-01T02:33:41.732ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1064 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
36512024-10-01T02:33:41.733ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd
36522024-10-01T02:33:41.734ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36532024-10-01T02:33:41.736ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
36542024-10-01T02:33:41.736ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
36552024-10-01T02:33:41.736ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
36562024-10-01T02:33:41.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
36572024-10-01T02:33:41.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
36582024-10-01T02:33:41.738ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36592024-10-01T02:33:41.739ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1059 zone_address = fd00:1122:3344:101::2
36602024-10-01T02:33:41.739ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
36612024-10-01T02:33:41.740ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "86bc6f74-ee83-4ef9-ace9-2cbcc6c2f400", "content-length": "26", "date": "Tue, 01 Oct 2024 02:33:41 GMT"} })
36622024-10-01T02:33:41.740ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1064 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
36632024-10-01T02:33:41.740ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 2a571ec0-85a3-450e-88fc-680c13ffa211, lookup_type: ById(2a571ec0-85a3-450e-88fc-680c13ffa211) } result = Ok(())
36642024-10-01T02:33:41.740ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
36652024-10-01T02:33:41.740ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 original_time_created = 2024-10-01 02:32:51.153042 UTC target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 time_created = 2024-10-01 02:32:51.153042 UTC
36662024-10-01T02:33:41.740ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 251.036747ms iteration = 4 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8f598f5c-ad31-4712-b43f-7ac75a933d07","time_created":"2024-10-01T02:32:51.153042Z"}
36672024-10-01T02:33:41.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
36682024-10-01T02:33:41.741ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
36692024-10-01T02:33:41.742ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
36702024-10-01T02:33:41.742ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
36712024-10-01T02:33:41.760ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 270.002845ms iteration = 2 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
36722024-10-01T02:33:41.772ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
36732024-10-01T02:33:41.772ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
36742024-10-01T02:33:41.772ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 281.143262ms iteration = 2 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
36752024-10-01T02:33:41.773ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36762024-10-01T02:33:41.775ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
36772024-10-01T02:33:41.775ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
36782024-10-01T02:33:41.775ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
36792024-10-01T02:33:41.801ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
36802024-10-01T02:33:41.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
36812024-10-01T02:33:41.804ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
36822024-10-01T02:33:41.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
36832024-10-01T02:33:41.805ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
36842024-10-01T02:33:41.806ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "bc84e9f5-b22c-4910-b1b5-34cc94b97599", "content-length": "1", "date": "Tue, 01 Oct 2024 02:33:41 GMT"} })
36852024-10-01T02:33:41.807ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
36862024-10-01T02:33:41.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
36872024-10-01T02:33:41.809ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 319.23623ms iteration = 2 status = null
36882024-10-01T02:33:41.871ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
36892024-10-01T02:33:41.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
36902024-10-01T02:33:41.874ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
36912024-10-01T02:33:41.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
36922024-10-01T02:33:41.887ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36932024-10-01T02:33:41.888ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36942024-10-01T02:33:41.890ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 58c2bb06-eaf4-47b5-aefe-83ea06db2406, rack_id: 52547763-7759-42e1-81a9-8b833f59f5dd, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(57ef3335-befd-4872-b57f-5c2571dcca50) } rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd switch_location = Switch0
36952024-10-01T02:33:41.890ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36962024-10-01T02:33:41.890ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36972024-10-01T02:33:41.892ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
36982024-10-01T02:33:41.904ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
36992024-10-01T02:33:41.905ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "748fdb82-1d66-4201-bb79-e8de623138c1", "content-length": "121", "date": "Tue, 01 Oct 2024 02:33:41 GMT"} })
37002024-10-01T02:33:41.905ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
37012024-10-01T02:33:41.905ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 57ef3335-befd-4872-b57f-5c2571dcca50
37022024-10-01T02:33:41.905ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
37032024-10-01T02:33:41.905ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
37042024-10-01T02:33:41.905ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd routes = {}
37052024-10-01T02:33:41.905ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd routes = {}
37062024-10-01T02:33:41.905ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd
37072024-10-01T02:33:41.905ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37082024-10-01T02:33:41.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37092024-10-01T02:33:41.908ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
37102024-10-01T02:33:41.912ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "4b206bb5-c6bb-4b2c-aaa4-023a77a46bed", "content-length": "2", "date": "Tue, 01 Oct 2024 02:33:41 GMT"} })
37112024-10-01T02:33:41.912ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
37122024-10-01T02:33:41.913ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "7132c270-052a-4984-b9d1-714c1ee7bb86", "content-length": "52", "date": "Tue, 01 Oct 2024 02:33:41 GMT"} })
37132024-10-01T02:33:41.913ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd switch_location = Switch0
37142024-10-01T02:33:41.913ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
37152024-10-01T02:33:41.917ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
37162024-10-01T02:33:41.917ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
37172024-10-01T02:33:41.920ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1275, tv_nsec: 363873531 } })
37182024-10-01T02:33:41.920ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = service_zone_nat_tracker file = nexus/src/app/mod.rs:1051
37192024-10-01T02:33:41.951ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = service_zone_nat_tracker file = nexus/src/app/mod.rs:1059 zone_address = fd00:1122:3344:101::2
37202024-10-01T02:33:41.951ZDEBGnexus (MgsClient): client request background_task = service_zone_nat_tracker body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
37212024-10-01T02:33:41.951ZDEBGnexus (MgsClient): client response background_task = service_zone_nat_tracker result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "86b42cac-f01c-44a9-ac32-181ad2dfa45e", "content-length": "26", "date": "Tue, 01 Oct 2024 02:33:41 GMT"} })
37222024-10-01T02:33:41.951ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = service_zone_nat_tracker file = nexus/src/app/mod.rs:1064 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
37232024-10-01T02:33:41.952ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = service_zone_nat_tracker file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
37242024-10-01T02:33:41.981ZDEBGnexus (DpdClient): client request background_task = service_zone_nat_tracker body = None method = POST uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger
37252024-10-01T02:33:41.981ZDEBGnexus (DpdClient): client response background_task = service_zone_nat_tracker result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger", status: 200, headers: {"content-type": "application/json", "x-request-id": "0b7d17fd-ad39-4680-bcc3-5299268de867", "content-length": "4", "date": "Tue, 01 Oct 2024 02:33:41 GMT"} })
37262024-10-01T02:33:41.982ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 492.707657ms iteration = 2 status = 3
37272024-10-01T02:33:42.021ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "e907d4f2-4a4c-419b-a194-35066cf4b18c", "content-length": "372", "date": "Tue, 01 Oct 2024 02:33:42 GMT"} })
37282024-10-01T02:33:42.021ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37292024-10-01T02:33:42.022ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37302024-10-01T02:33:42.024ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37312024-10-01T02:33:42.025ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37322024-10-01T02:33:42.025ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "c5fb6364-1ade-4143-bc21-13424ed7cf6a", "content-length": "691", "date": "Tue, 01 Oct 2024 02:33:42 GMT"} })
37332024-10-01T02:33:42.025ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
37342024-10-01T02:33:42.025ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
37352024-10-01T02:33:42.025ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
37362024-10-01T02:33:42.027ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 537.375825ms iteration = 2 status = {}
37372024-10-01T02:33:42.028ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37382024-10-01T02:33:42.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37392024-10-01T02:33:42.032ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
37402024-10-01T02:33:42.034ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "7174f880-1e71-4def-b412-14e207002a51", "date": "Tue, 01 Oct 2024 02:33:42 GMT"} })
37412024-10-01T02:33:42.036ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 545.742385ms iteration = 3 status = {}
37422024-10-01T02:33:42.076ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:60878 req_id = 52e814f2-4895-412d-99a9-50a6812c26f5 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/0?limit=100
37432024-10-01T02:33:42.076ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:60878 req_id = 52e814f2-4895-412d-99a9-50a6812c26f5 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/0?limit=100
37442024-10-01T02:33:42.097ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 21916 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:60878 req_id = 52e814f2-4895-412d-99a9-50a6812c26f5 response_code = 200 uri = /nat/ipv4/changeset/0?limit=100
37452024-10-01T02:33:42.099ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:60878 req_id = fdbfc1d8-2d20-43ca-8857-37c75f28682b roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
37462024-10-01T02:33:42.099ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:60878 req_id = fdbfc1d8-2d20-43ca-8857-37c75f28682b resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
37472024-10-01T02:33:42.121ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 22138 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:60878 req_id = fdbfc1d8-2d20-43ca-8857-37c75f28682b response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
37482024-10-01T02:33:42.152ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "5b8f3348-b83a-4875-93c2-ed1674a7f0f4", "date": "Tue, 01 Oct 2024 02:33:42 GMT"} })
37492024-10-01T02:33:42.152ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd switch = Switch0
37502024-10-01T02:33:42.152ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
37512024-10-01T02:33:42.153ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "d74a4216-4cb3-44e6-9721-314a574f9a32", "content-length": "524", "date": "Tue, 01 Oct 2024 02:33:42 GMT"} })
37522024-10-01T02:33:42.153ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37532024-10-01T02:33:42.154ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37542024-10-01T02:33:42.274ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37552024-10-01T02:33:42.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37562024-10-01T02:33:42.278ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37572024-10-01T02:33:42.278ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37582024-10-01T02:33:42.280ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37592024-10-01T02:33:42.280ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37602024-10-01T02:33:42.304ZWARNnexus (BackgroundTasks): no bootstore config found in db background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1212 key = network_key rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd
37612024-10-01T02:33:42.304ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37622024-10-01T02:33:42.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37632024-10-01T02:33:42.372ZINFOnexus (BackgroundTasks): updating bootstore config background_task = switch_port_config_manager config = EarlyNetworkConfig { body: EarlyNetworkConfigBody { ntp_servers: ["0.pool.ntp.org"], rack_network_config: Some(RackNetworkConfigV2 { bfd: [], bgp: [], infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [PortConfigV2 { addresses: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], autoneg: false, bgp_peers: [], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", routes: [RouteConfig { destination: V4(Ipv4Net { addr: 0.0.0.0, width: 0 }), local_pref: None, nexthop: 10.151.1.100, vlan_id: None }], switch: Switch0, uplink_port_fec: None, uplink_port_speed: Speed40G }], rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56 } }) }, generation: 3, schema_version: 2 } file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1269 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd
37642024-10-01T02:33:42.374ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = PUT rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
37652024-10-01T02:33:42.375ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 204, headers: {"x-request-id": "cefe2b50-7284-44d5-ba10-981f56d47f48", "date": "Tue, 01 Oct 2024 02:33:42 GMT"} })
37662024-10-01T02:33:42.375ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37672024-10-01T02:33:42.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37682024-10-01T02:33:42.410ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 921.049914ms iteration = 2 status = {}
37692024-10-01T02:33:44.826ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1268 local_addr = [fd00:1122:3344:101::c]:53319 method = GET remote_addr = [fd00:1122:3344:101::d]:65459 req_id = db98d69d-8ccd-443c-a6f8-f95a5f89668d response_code = 200 uri = /3dfd7033-71d8-4eb9-bb97-49dae3b5cd35
37702024-10-01T02:33:51.489ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 5 reason = Timeout
37712024-10-01T02:33:51.490ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37722024-10-01T02:33:51.490ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37732024-10-01T02:33:51.490ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 5 reason = Timeout
37742024-10-01T02:33:51.490ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
37752024-10-01T02:33:51.490ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
37762024-10-01T02:33:51.492ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37772024-10-01T02:33:51.494ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
37782024-10-01T02:33:51.494ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37792024-10-01T02:33:51.494ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37802024-10-01T02:33:51.496ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37812024-10-01T02:33:51.496ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37822024-10-01T02:33:51.498ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37832024-10-01T02:33:51.500ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8f598f5c-ad31-4712-b43f-7ac75a933d07, lookup_type: ById(8f598f5c-ad31-4712-b43f-7ac75a933d07) } result = Ok(())
37842024-10-01T02:33:51.500ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37852024-10-01T02:33:51.500ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37862024-10-01T02:33:51.512ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 original_time_created = 2024-10-01 02:32:51.153042 UTC target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 time_created = 2024-10-01 02:32:51.153042 UTC
37872024-10-01T02:33:51.512ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.806922ms iteration = 5 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8f598f5c-ad31-4712-b43f-7ac75a933d07","time_created":"2024-10-01T02:32:51.153042Z"}
37882024-10-01T02:33:51.525ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
37892024-10-01T02:33:51.525ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
37902024-10-01T02:33:51.527ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 36.548042ms iteration = 5 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
37912024-10-01T02:33:54.827ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1585 local_addr = [fd00:1122:3344:101::c]:53319 method = GET remote_addr = [fd00:1122:3344:101::d]:65459 req_id = 96a79bda-d7fe-4e92-9cb7-599ddcd7dad6 response_code = 200 uri = /3dfd7033-71d8-4eb9-bb97-49dae3b5cd35
37922024-10-01T02:34:01.489ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 6 reason = Timeout
37932024-10-01T02:34:01.489ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37942024-10-01T02:34:01.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37952024-10-01T02:34:01.490ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 6 reason = Timeout
37962024-10-01T02:34:01.490ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
37972024-10-01T02:34:01.491ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37982024-10-01T02:34:01.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
37992024-10-01T02:34:01.493ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
38002024-10-01T02:34:01.493ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38012024-10-01T02:34:01.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38022024-10-01T02:34:01.495ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38032024-10-01T02:34:01.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38042024-10-01T02:34:01.497ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38052024-10-01T02:34:01.499ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8f598f5c-ad31-4712-b43f-7ac75a933d07, lookup_type: ById(8f598f5c-ad31-4712-b43f-7ac75a933d07) } result = Ok(())
38062024-10-01T02:34:01.499ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38072024-10-01T02:34:01.499ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38082024-10-01T02:34:01.507ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 original_time_created = 2024-10-01 02:32:51.153042 UTC target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 time_created = 2024-10-01 02:32:51.153042 UTC
38092024-10-01T02:34:01.507ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.769365ms iteration = 6 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8f598f5c-ad31-4712-b43f-7ac75a933d07","time_created":"2024-10-01T02:32:51.153042Z"}
38102024-10-01T02:34:01.519ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
38112024-10-01T02:34:01.519ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
38122024-10-01T02:34:01.521ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.294737ms iteration = 6 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
38132024-10-01T02:34:04.827ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1752 local_addr = [fd00:1122:3344:101::c]:53319 method = GET remote_addr = [fd00:1122:3344:101::d]:65459 req_id = 71e07a5f-e438-46d7-bfff-5b77896a698a response_code = 200 uri = /3dfd7033-71d8-4eb9-bb97-49dae3b5cd35
38142024-10-01T02:34:11.490ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 2 reason = Timeout
38152024-10-01T02:34:11.490ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 3 reason = Timeout
38162024-10-01T02:34:11.490ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-10-01 02:24:11.490031129 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
38172024-10-01T02:34:11.490ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
38182024-10-01T02:34:11.490ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 3 reason = Timeout
38192024-10-01T02:34:11.490ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 5 reason = Timeout
38202024-10-01T02:34:11.490ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
38212024-10-01T02:34:11.490ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
38222024-10-01T02:34:11.490ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 3 reason = Timeout
38232024-10-01T02:34:11.490ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 3 reason = Timeout
38242024-10-01T02:34:11.490ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
38252024-10-01T02:34:11.490ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 3 reason = Timeout
38262024-10-01T02:34:11.490ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
38272024-10-01T02:34:11.490ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 3 reason = Timeout
38282024-10-01T02:34:11.490ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 3 reason = Timeout
38292024-10-01T02:34:11.490ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38302024-10-01T02:34:11.490ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
38312024-10-01T02:34:11.490ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 3 reason = Timeout
38322024-10-01T02:34:11.490ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 3 reason = Timeout
38332024-10-01T02:34:11.490ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 2 reason = Timeout
38342024-10-01T02:34:11.490ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
38352024-10-01T02:34:11.490ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07
38362024-10-01T02:34:11.490ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
38372024-10-01T02:34:11.490ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
38382024-10-01T02:34:11.490ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 3 reason = Timeout
38392024-10-01T02:34:11.490ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 11.751\u{b5}s iteration = 3 status = {"enabled":false,"target_id":"8f598f5c-ad31-4712-b43f-7ac75a933d07"}
38402024-10-01T02:34:11.490ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 7 reason = Timeout
38412024-10-01T02:34:11.490ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38422024-10-01T02:34:11.490ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 4 reason = Timeout
38432024-10-01T02:34:11.490ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 4 reason = Timeout
38442024-10-01T02:34:11.490ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 3 reason = Timeout
38452024-10-01T02:34:11.490ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 3 reason = Timeout
38462024-10-01T02:34:11.490ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
38472024-10-01T02:34:11.490ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
38482024-10-01T02:34:11.490ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
38492024-10-01T02:34:11.490ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 3 reason = Timeout
38502024-10-01T02:34:11.490ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
38512024-10-01T02:34:11.490ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
38522024-10-01T02:34:11.490ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 7 reason = Timeout
38532024-10-01T02:34:11.490ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
38542024-10-01T02:34:11.490ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 3 reason = Timeout
38552024-10-01T02:34:11.490ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
38562024-10-01T02:34:11.490ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 2 reason = Timeout
38572024-10-01T02:34:11.490ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
38582024-10-01T02:34:11.490ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 3 reason = Timeout
38592024-10-01T02:34:11.490ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
38602024-10-01T02:34:11.490ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 3 reason = Timeout
38612024-10-01T02:34:11.490ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
38622024-10-01T02:34:11.490ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 3 reason = Timeout
38632024-10-01T02:34:11.490ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
38642024-10-01T02:34:11.490ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 3 reason = Timeout
38652024-10-01T02:34:11.490ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
38662024-10-01T02:34:11.490ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 3 reason = Timeout
38672024-10-01T02:34:11.490ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
38682024-10-01T02:34:11.490ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
38692024-10-01T02:34:11.490ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 4 reason = Timeout
38702024-10-01T02:34:11.490ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
38712024-10-01T02:34:11.490ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 2 reason = Timeout
38722024-10-01T02:34:11.490ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
38732024-10-01T02:34:11.490ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 2 reason = Timeout
38742024-10-01T02:34:11.490ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
38752024-10-01T02:34:11.490ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
38762024-10-01T02:34:11.490ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
38772024-10-01T02:34:11.490ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
38782024-10-01T02:34:11.490ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38792024-10-01T02:34:11.490ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
38802024-10-01T02:34:11.490ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
38812024-10-01T02:34:11.490ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
38822024-10-01T02:34:11.490ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
38832024-10-01T02:34:11.490ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
38842024-10-01T02:34:11.490ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38852024-10-01T02:34:11.490ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
38862024-10-01T02:34:11.490ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
38872024-10-01T02:34:11.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
38882024-10-01T02:34:11.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
38892024-10-01T02:34:11.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
38902024-10-01T02:34:11.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
38912024-10-01T02:34:11.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
38922024-10-01T02:34:11.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
38932024-10-01T02:34:11.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
38942024-10-01T02:34:11.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
38952024-10-01T02:34:11.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
38962024-10-01T02:34:11.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
38972024-10-01T02:34:11.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
38982024-10-01T02:34:11.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
38992024-10-01T02:34:11.491ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("0a1ed896-5078-4267-b636-10151376f015.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("eb937866-c779-4a9e-aec4-cc18302d4ce1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("eb937866-c779-4a9e-aec4-cc18302d4ce1.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1304, tv_nsec: 935016774 } })
39002024-10-01T02:34:11.492ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
39012024-10-01T02:34:11.492ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 2.707756ms iteration = 3 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
39022024-10-01T02:34:11.492ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("1af5fb25-d768-4bc6-915c-0b4c59e1f0ef.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("293e78c2-b712-4c13-b502-e2be11a76306.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("71ea2e4f-4772-4ce7-8093-48597fd7fd92.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("71ea2e4f-4772-4ce7-8093-48597fd7fd92.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1304, tv_nsec: 936019431 } })
39032024-10-01T02:34:11.493ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39042024-10-01T02:34:11.495ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-10-01 02:24:11.490031129 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
39052024-10-01T02:34:11.495ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 5.317999ms iteration = 2 status = {"expiration":"2024-10-01T02:24:11.490031129Z","pruned":[]}
39062024-10-01T02:34:11.495ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39072024-10-01T02:34:11.495ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
39082024-10-01T02:34:11.495ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 5.436702ms iteration = 3 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
39092024-10-01T02:34:11.495ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
39102024-10-01T02:34:11.495ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
39112024-10-01T02:34:11.496ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
39122024-10-01T02:34:11.496ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 6.252874ms iteration = 3 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
39132024-10-01T02:34:11.498ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
39142024-10-01T02:34:11.498ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39152024-10-01T02:34:11.498ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39162024-10-01T02:34:11.499ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39172024-10-01T02:34:11.499ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39182024-10-01T02:34:11.500ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39192024-10-01T02:34:11.501ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
39202024-10-01T02:34:11.501ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
39212024-10-01T02:34:11.502ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
39222024-10-01T02:34:11.503ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
39232024-10-01T02:34:11.503ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
39242024-10-01T02:34:11.503ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
39252024-10-01T02:34:11.504ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
39262024-10-01T02:34:11.504ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
39272024-10-01T02:34:11.504ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39282024-10-01T02:34:11.504ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
39292024-10-01T02:34:11.504ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39302024-10-01T02:34:11.505ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39312024-10-01T02:34:11.506ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1304, tv_nsec: 949775162 } })
39322024-10-01T02:34:11.507ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1051
39332024-10-01T02:34:11.507ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
39342024-10-01T02:34:11.507ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
39352024-10-01T02:34:11.508ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
39362024-10-01T02:34:11.508ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
39372024-10-01T02:34:11.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
39382024-10-01T02:34:11.508ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
39392024-10-01T02:34:11.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
39402024-10-01T02:34:11.511ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1304, tv_nsec: 954673824 } })
39412024-10-01T02:34:11.511ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1051
39422024-10-01T02:34:11.514ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 23.616166ms iteration = 2 status = {"errors":[],"found_port_ok":[]}
39432024-10-01T02:34:11.516ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
39442024-10-01T02:34:11.516ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
39452024-10-01T02:34:11.516ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
39462024-10-01T02:34:11.516ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
39472024-10-01T02:34:11.517ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
39482024-10-01T02:34:11.517ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
39492024-10-01T02:34:11.518ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39502024-10-01T02:34:11.518ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39512024-10-01T02:34:11.521ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1304, tv_nsec: 964916235 } })
39522024-10-01T02:34:11.522ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1051 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd
39532024-10-01T02:34:11.550ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39542024-10-01T02:34:11.550ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
39552024-10-01T02:34:11.551ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
39562024-10-01T02:34:11.553ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
39572024-10-01T02:34:11.553ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
39582024-10-01T02:34:11.553ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
39592024-10-01T02:34:11.554ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
39602024-10-01T02:34:11.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
39612024-10-01T02:34:11.555ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39622024-10-01T02:34:11.560ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
39632024-10-01T02:34:11.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
39642024-10-01T02:34:11.560ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39652024-10-01T02:34:11.560ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
39662024-10-01T02:34:11.560ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
39672024-10-01T02:34:11.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
39682024-10-01T02:34:11.562ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
39692024-10-01T02:34:11.562ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
39702024-10-01T02:34:11.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
39712024-10-01T02:34:11.562ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39722024-10-01T02:34:11.564ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 74.01344ms iteration = 3 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
39732024-10-01T02:34:11.565ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8f598f5c-ad31-4712-b43f-7ac75a933d07, lookup_type: ById(8f598f5c-ad31-4712-b43f-7ac75a933d07) } result = Ok(())
39742024-10-01T02:34:11.565ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39752024-10-01T02:34:11.565ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39762024-10-01T02:34:11.565ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 75.306092ms iteration = 3 status = {"errors":[],"garbage_collect_requested":[]}
39772024-10-01T02:34:11.566ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 76.033384ms iteration = 3 status = {"errors":[],"records_set_to_done":[]}
39782024-10-01T02:34:11.568ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
39792024-10-01T02:34:11.568ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
39802024-10-01T02:34:11.569ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
39812024-10-01T02:34:11.569ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
39822024-10-01T02:34:11.569ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 79.398221ms iteration = 2 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
39832024-10-01T02:34:11.570ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39842024-10-01T02:34:11.571ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
39852024-10-01T02:34:11.571ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 80.729173ms iteration = 3 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
39862024-10-01T02:34:11.572ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
39872024-10-01T02:34:11.573ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
39882024-10-01T02:34:11.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
39892024-10-01T02:34:11.575ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39902024-10-01T02:34:11.576ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
39912024-10-01T02:34:11.576ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
39922024-10-01T02:34:11.576ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
39932024-10-01T02:34:11.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
39942024-10-01T02:34:11.577ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
39952024-10-01T02:34:11.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
39962024-10-01T02:34:11.578ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39972024-10-01T02:34:11.578ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
39982024-10-01T02:34:11.578ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
39992024-10-01T02:34:11.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
40002024-10-01T02:34:11.580ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 original_time_created = 2024-10-01 02:32:51.153042 UTC target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 time_created = 2024-10-01 02:32:51.153042 UTC
40012024-10-01T02:34:11.580ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 90.74289ms iteration = 7 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8f598f5c-ad31-4712-b43f-7ac75a933d07","time_created":"2024-10-01T02:32:51.153042Z"}
40022024-10-01T02:34:11.582ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
40032024-10-01T02:34:11.583ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40042024-10-01T02:34:11.583ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40052024-10-01T02:34:11.584ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
40062024-10-01T02:34:11.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
40072024-10-01T02:34:11.587ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
40082024-10-01T02:34:11.587ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
40092024-10-01T02:34:11.587ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
40102024-10-01T02:34:11.587ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
40112024-10-01T02:34:11.591ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
40122024-10-01T02:34:11.591ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
40132024-10-01T02:34:11.593ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40142024-10-01T02:34:11.597ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 2a571ec0-85a3-450e-88fc-680c13ffa211, lookup_type: ById(2a571ec0-85a3-450e-88fc-680c13ffa211) } result = Ok(())
40152024-10-01T02:34:11.597ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
40162024-10-01T02:34:11.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
40172024-10-01T02:34:11.603ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 113.034584ms iteration = 7 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
40182024-10-01T02:34:11.604ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 114.115122ms iteration = 3 status = 0
40192024-10-01T02:34:11.606ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
40202024-10-01T02:34:11.606ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
40212024-10-01T02:34:11.606ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 116.041125ms iteration = 2 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
40222024-10-01T02:34:11.614ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
40232024-10-01T02:34:11.615ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
40242024-10-01T02:34:11.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
40252024-10-01T02:34:11.617ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
40262024-10-01T02:34:11.617ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
40272024-10-01T02:34:11.625ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
40282024-10-01T02:34:11.625ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
40292024-10-01T02:34:11.625ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
40302024-10-01T02:34:11.625ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
40312024-10-01T02:34:11.625ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
40322024-10-01T02:34:11.627ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40332024-10-01T02:34:11.628ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
40342024-10-01T02:34:11.628ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
40352024-10-01T02:34:11.628ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
40362024-10-01T02:34:11.629ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
40372024-10-01T02:34:11.630ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
40382024-10-01T02:34:11.630ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
40392024-10-01T02:34:11.630ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 140.157869ms iteration = 3 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
40402024-10-01T02:34:11.630ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
40412024-10-01T02:34:11.633ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
40422024-10-01T02:34:11.633ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 3d6d7965-c160-4184-b04f-32fa0fb7b928 dns_zone_name = oxide.test found_so_far = 0 version = 2
40432024-10-01T02:34:11.633ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
40442024-10-01T02:34:11.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
40452024-10-01T02:34:11.635ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40462024-10-01T02:34:11.640ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
40472024-10-01T02:34:11.640ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
40482024-10-01T02:34:11.640ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
40492024-10-01T02:34:11.644ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 3d6d7965-c160-4184-b04f-32fa0fb7b928 dns_zone_name = oxide.test found_so_far = 1 version = 2
40502024-10-01T02:34:11.644ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
40512024-10-01T02:34:11.644ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-10-01 02:33:13.765844 UTC dns_group = external generation = 2
40522024-10-01T02:34:11.644ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 154.250425ms iteration = 3 status = {"generation":2}
40532024-10-01T02:34:11.645ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
40542024-10-01T02:34:11.645ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
40552024-10-01T02:34:11.645ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
40562024-10-01T02:34:11.645ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
40572024-10-01T02:34:11.646ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
40582024-10-01T02:34:11.648ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40592024-10-01T02:34:11.651ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (changed) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-10-01T02:33:09.142901Z, time_modified: 2024-10-01T02:33:09.142901Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, db_silo: Silo { identity: SiloIdentity { id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-10-01T02:33:13.712784Z, time_modified: 2024-10-01T02:33:13.712784Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(2)) }, tls_certs: [TlsCertificate { digest: "ca547a59343cd98ceb775f10ce9428d8003a71a149b5b7d33f10c1e7a9820bb1" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, db_silo: Silo { identity: SiloIdentity { id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-10-01T02:33:13.712784Z, time_modified: 2024-10-01T02:33:13.712784Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(2)) }, tls_certs: [TlsCertificate { digest: "ca547a59343cd98ceb775f10ce9428d8003a71a149b5b7d33f10c1e7a9820bb1" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:94
40602024-10-01T02:34:11.651ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 161.305724ms iteration = 3 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"21983b87-d6d0-47c6-a33c-5fe68fbed0c6","tls_certs":["ca547a59343cd98ceb775f10ce9428d8003a71a149b5b7d33f10c1e7a9820bb1"]}},"default_endpoint":{"silo_id":"21983b87-d6d0-47c6-a33c-5fe68fbed0c6","tls_certs":["ca547a59343cd98ceb775f10ce9428d8003a71a149b5b7d33f10c1e7a9820bb1"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
40612024-10-01T02:34:11.651ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
40622024-10-01T02:34:11.651ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
40632024-10-01T02:34:11.651ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
40642024-10-01T02:34:11.654ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
40652024-10-01T02:34:11.654ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 164.380945ms iteration = 2 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
40662024-10-01T02:34:11.656ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1059 zone_address = fd00:1122:3344:101::2
40672024-10-01T02:34:11.656ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
40682024-10-01T02:34:11.657ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "854b535b-f804-420a-b403-871958fa9e90", "content-length": "26", "date": "Tue, 01 Oct 2024 02:34:11 GMT"} })
40692024-10-01T02:34:11.657ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1064 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
40702024-10-01T02:34:11.658ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
40712024-10-01T02:34:11.663ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 172.981279ms iteration = 3 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
40722024-10-01T02:34:11.667ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
40732024-10-01T02:34:11.667ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
40742024-10-01T02:34:11.667ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 177.028316ms iteration = 3 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
40752024-10-01T02:34:11.668ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
40762024-10-01T02:34:11.671ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
40772024-10-01T02:34:11.671ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
40782024-10-01T02:34:11.687ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1059 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd zone_address = fd00:1122:3344:101::2
40792024-10-01T02:34:11.688ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
40802024-10-01T02:34:11.688ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b31fa55e-8c56-4b8c-bac8-f8bb2cbb433c", "content-length": "26", "date": "Tue, 01 Oct 2024 02:34:11 GMT"} })
40812024-10-01T02:34:11.688ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1064 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
40822024-10-01T02:34:11.689ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd
40832024-10-01T02:34:11.690ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
40842024-10-01T02:34:11.690ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = bc7b49a6-c38c-499f-983e-184e2c58fa04 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
40852024-10-01T02:34:11.690ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
40862024-10-01T02:34:11.690ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
40872024-10-01T02:34:11.710ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 220.80075ms iteration = 5 status = {"physical_disks_added":0}
40882024-10-01T02:34:11.771ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1059 zone_address = fd00:1122:3344:101::2
40892024-10-01T02:34:11.771ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
40902024-10-01T02:34:11.772ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1a1ba9e1-003f-4d16-ba9a-aaf8527ec8a7", "content-length": "26", "date": "Tue, 01 Oct 2024 02:34:11 GMT"} })
40912024-10-01T02:34:11.772ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1064 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
40922024-10-01T02:34:11.773ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
40932024-10-01T02:34:11.934ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
40942024-10-01T02:34:11.936ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
40952024-10-01T02:34:11.937ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "a04bd680-be9b-4273-8a4a-ea391f310bd8", "content-length": "2", "date": "Tue, 01 Oct 2024 02:34:11 GMT"} })
40962024-10-01T02:34:11.938ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
40972024-10-01T02:34:11.938ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
40982024-10-01T02:34:11.942ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 451.847682ms iteration = 3 status = {}
40992024-10-01T02:34:11.950ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
41002024-10-01T02:34:11.951ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "9df44b44-13be-46e3-8c2e-1ba600c07e80", "date": "Tue, 01 Oct 2024 02:34:11 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
41012024-10-01T02:34:11.951ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
41022024-10-01T02:34:11.952ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "86c5ce25-ae8d-4257-9a21-00f28b941ffa", "date": "Tue, 01 Oct 2024 02:34:11 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
41032024-10-01T02:34:11.952ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
41042024-10-01T02:34:11.954ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
41052024-10-01T02:34:11.954ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 463.978315ms iteration = 4 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
41062024-10-01T02:34:11.960ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
41072024-10-01T02:34:11.961ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "daf35440-4db1-4940-8222-b0141c2017e7", "content-length": "372", "date": "Tue, 01 Oct 2024 02:34:11 GMT"} })
41082024-10-01T02:34:11.961ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
41092024-10-01T02:34:11.961ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
41102024-10-01T02:34:11.962ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41112024-10-01T02:34:11.962ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41122024-10-01T02:34:11.963ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 472.974416ms iteration = 3 status = null
41132024-10-01T02:34:11.964ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
41142024-10-01T02:34:11.964ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
41152024-10-01T02:34:11.964ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
41162024-10-01T02:34:11.964ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
41172024-10-01T02:34:11.964ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
41182024-10-01T02:34:11.965ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
41192024-10-01T02:34:11.965ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
41202024-10-01T02:34:11.965ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
41212024-10-01T02:34:11.965ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41222024-10-01T02:34:11.967ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = bc7b49a6-c38c-499f-983e-184e2c58fa04 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
41232024-10-01T02:34:11.967ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
41242024-10-01T02:34:11.967ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-10-01 02:33:12.369795 UTC dns_group = internal generation = 1
41252024-10-01T02:34:11.967ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 476.891042ms iteration = 3 status = {"generation":1}
41262024-10-01T02:34:11.967ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
41272024-10-01T02:34:11.967ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
41282024-10-01T02:34:11.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
41292024-10-01T02:34:11.967ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
41302024-10-01T02:34:11.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
41312024-10-01T02:34:11.970ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
41322024-10-01T02:34:11.970ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "0e049b3b-85ed-447d-8fc2-e6647ec29ad2", "date": "Tue, 01 Oct 2024 02:34:11 GMT"} })
41332024-10-01T02:34:11.973ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 482.572057ms iteration = 4 status = {}
41342024-10-01T02:34:11.992ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
41352024-10-01T02:34:11.993ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "cfecd2cb-74ba-4c8d-ba06-6039d2d1ece1", "date": "Tue, 01 Oct 2024 02:34:11 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
41362024-10-01T02:34:11.993ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
41372024-10-01T02:34:11.995ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "72bd4bfa-3870-44e2-b78f-d89b6830c220", "date": "Tue, 01 Oct 2024 02:34:11 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
41382024-10-01T02:34:11.995ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
41392024-10-01T02:34:11.997ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "26901b1c-8298-49a2-8624-2d85a5308ee4", "date": "Tue, 01 Oct 2024 02:34:11 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
41402024-10-01T02:34:11.997ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
41412024-10-01T02:34:11.999ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
41422024-10-01T02:34:11.999ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 509.172513ms iteration = 4 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
41432024-10-01T02:34:12.012ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
41442024-10-01T02:34:12.012ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "0da334e1-9e4d-4f3b-b80b-6dd8bb77c0f7", "content-length": "691", "date": "Tue, 01 Oct 2024 02:34:11 GMT"} })
41452024-10-01T02:34:12.012ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
41462024-10-01T02:34:12.012ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
41472024-10-01T02:34:12.012ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
41482024-10-01T02:34:12.014ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 524.325116ms iteration = 3 status = {}
41492024-10-01T02:34:12.041ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41502024-10-01T02:34:12.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41512024-10-01T02:34:12.053ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 58c2bb06-eaf4-47b5-aefe-83ea06db2406, rack_id: 52547763-7759-42e1-81a9-8b833f59f5dd, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(57ef3335-befd-4872-b57f-5c2571dcca50) } rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd switch_location = Switch0
41522024-10-01T02:34:12.053ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41532024-10-01T02:34:12.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41542024-10-01T02:34:12.145ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
41552024-10-01T02:34:12.146ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "30c10f73-8c30-4f7c-bbea-3b2f61c34ed5", "content-length": "121", "date": "Tue, 01 Oct 2024 02:34:11 GMT"} })
41562024-10-01T02:34:12.146ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
41572024-10-01T02:34:12.146ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 57ef3335-befd-4872-b57f-5c2571dcca50
41582024-10-01T02:34:12.146ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
41592024-10-01T02:34:12.146ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
41602024-10-01T02:34:12.146ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd routes = {}
41612024-10-01T02:34:12.146ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd routes = {}
41622024-10-01T02:34:12.146ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd
41632024-10-01T02:34:12.146ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41642024-10-01T02:34:12.146ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41652024-10-01T02:34:12.148ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
41662024-10-01T02:34:12.149ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "93eda970-7db1-4750-bc8a-d7becd7eb397", "content-length": "2", "date": "Tue, 01 Oct 2024 02:34:11 GMT"} })
41672024-10-01T02:34:12.149ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
41682024-10-01T02:34:12.149ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "2283f9e9-4e39-4674-9160-72d563748a63", "content-length": "52", "date": "Tue, 01 Oct 2024 02:34:11 GMT"} })
41692024-10-01T02:34:12.149ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd switch_location = Switch0
41702024-10-01T02:34:12.149ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
41712024-10-01T02:34:12.154ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:60878 req_id = 42cab6fb-feaf-4de5-bb59-226e8ce98485 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
41722024-10-01T02:34:12.154ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:60878 req_id = 42cab6fb-feaf-4de5-bb59-226e8ce98485 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
41732024-10-01T02:34:12.169ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 14673 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:60878 req_id = 42cab6fb-feaf-4de5-bb59-226e8ce98485 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
41742024-10-01T02:34:12.247ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "1816a497-703c-4658-b1ae-319d5145d7af", "date": "Tue, 01 Oct 2024 02:34:11 GMT"} })
41752024-10-01T02:34:12.247ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd switch = Switch0
41762024-10-01T02:34:12.247ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
41772024-10-01T02:34:12.247ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "445f56da-679a-4474-b1ce-8c3ea9dbbbfe", "content-length": "667", "date": "Tue, 01 Oct 2024 02:34:11 GMT"} })
41782024-10-01T02:34:12.248ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41792024-10-01T02:34:12.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41802024-10-01T02:34:12.251ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41812024-10-01T02:34:12.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41822024-10-01T02:34:12.255ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41832024-10-01T02:34:12.255ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41842024-10-01T02:34:12.257ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41852024-10-01T02:34:12.257ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41862024-10-01T02:34:12.264ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 774.298516ms iteration = 3 status = {}
41872024-10-01T02:34:14.827ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1151 local_addr = [fd00:1122:3344:101::c]:53319 method = GET remote_addr = [fd00:1122:3344:101::d]:65459 req_id = 9ed1f454-2f46-4298-8a57-e18c3b7a7441 response_code = 200 uri = /3dfd7033-71d8-4eb9-bb97-49dae3b5cd35
41882024-10-01T02:34:21.489ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 8 reason = Timeout
41892024-10-01T02:34:21.489ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41902024-10-01T02:34:21.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41912024-10-01T02:34:21.490ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 8 reason = Timeout
41922024-10-01T02:34:21.490ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
41932024-10-01T02:34:21.490ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
41942024-10-01T02:34:21.491ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41952024-10-01T02:34:21.492ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
41962024-10-01T02:34:21.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
41972024-10-01T02:34:21.494ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
41982024-10-01T02:34:21.494ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41992024-10-01T02:34:21.494ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42002024-10-01T02:34:21.496ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42012024-10-01T02:34:21.496ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42022024-10-01T02:34:21.497ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42032024-10-01T02:34:21.500ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8f598f5c-ad31-4712-b43f-7ac75a933d07, lookup_type: ById(8f598f5c-ad31-4712-b43f-7ac75a933d07) } result = Ok(())
42042024-10-01T02:34:21.500ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42052024-10-01T02:34:21.500ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42062024-10-01T02:34:21.509ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 original_time_created = 2024-10-01 02:32:51.153042 UTC target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 time_created = 2024-10-01 02:32:51.153042 UTC
42072024-10-01T02:34:21.509ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.063797ms iteration = 8 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8f598f5c-ad31-4712-b43f-7ac75a933d07","time_created":"2024-10-01T02:32:51.153042Z"}
42082024-10-01T02:34:21.519ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 29.378182ms iteration = 8 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
42092024-10-01T02:34:24.826ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1197 local_addr = [fd00:1122:3344:101::c]:53319 method = GET remote_addr = [fd00:1122:3344:101::d]:65459 req_id = 7059b081-6578-49e6-a26d-b7f493c5a8fd response_code = 200 uri = /3dfd7033-71d8-4eb9-bb97-49dae3b5cd35
42102024-10-01T02:34:31.490ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 9 reason = Timeout
42112024-10-01T02:34:31.490ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42122024-10-01T02:34:31.490ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42132024-10-01T02:34:31.490ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 9 reason = Timeout
42142024-10-01T02:34:31.490ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
42152024-10-01T02:34:31.490ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
42162024-10-01T02:34:31.492ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42172024-10-01T02:34:31.492ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
42182024-10-01T02:34:31.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
42192024-10-01T02:34:31.494ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.820094ms iteration = 9 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
42202024-10-01T02:34:31.494ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
42212024-10-01T02:34:31.494ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42222024-10-01T02:34:31.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42232024-10-01T02:34:31.496ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42242024-10-01T02:34:31.496ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42252024-10-01T02:34:31.498ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42262024-10-01T02:34:31.500ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8f598f5c-ad31-4712-b43f-7ac75a933d07, lookup_type: ById(8f598f5c-ad31-4712-b43f-7ac75a933d07) } result = Ok(())
42272024-10-01T02:34:31.500ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42282024-10-01T02:34:31.501ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42292024-10-01T02:34:31.510ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 original_time_created = 2024-10-01 02:32:51.153042 UTC target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 time_created = 2024-10-01 02:32:51.153042 UTC
42302024-10-01T02:34:31.510ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.786402ms iteration = 9 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8f598f5c-ad31-4712-b43f-7ac75a933d07","time_created":"2024-10-01T02:32:51.153042Z"}
42312024-10-01T02:34:34.828ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1781 local_addr = [fd00:1122:3344:101::c]:53319 method = GET remote_addr = [fd00:1122:3344:101::d]:65459 req_id = b4ebbf84-87b4-4844-8607-dc0638e605b9 response_code = 200 uri = /3dfd7033-71d8-4eb9-bb97-49dae3b5cd35
42322024-10-01T02:34:41.490ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 10 reason = Timeout
42332024-10-01T02:34:41.490ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 4 reason = Timeout
42342024-10-01T02:34:41.490ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42352024-10-01T02:34:41.490ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42362024-10-01T02:34:41.490ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 4 reason = Timeout
42372024-10-01T02:34:41.490ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 4 reason = Timeout
42382024-10-01T02:34:41.490ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
42392024-10-01T02:34:41.490ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
42402024-10-01T02:34:41.490ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 4 reason = Timeout
42412024-10-01T02:34:41.490ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
42422024-10-01T02:34:41.490ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 4 reason = Timeout
42432024-10-01T02:34:41.490ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
42442024-10-01T02:34:41.490ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 4 reason = Timeout
42452024-10-01T02:34:41.490ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 4 reason = Timeout
42462024-10-01T02:34:41.490ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
42472024-10-01T02:34:41.490ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 6 reason = Timeout
42482024-10-01T02:34:41.490ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
42492024-10-01T02:34:41.490ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 10 reason = Timeout
42502024-10-01T02:34:41.490ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 4 reason = Timeout
42512024-10-01T02:34:41.490ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
42522024-10-01T02:34:41.490ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
42532024-10-01T02:34:41.490ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 4 reason = Timeout
42542024-10-01T02:34:41.490ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
42552024-10-01T02:34:41.490ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 4 reason = Timeout
42562024-10-01T02:34:41.490ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
42572024-10-01T02:34:41.490ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 4 reason = Timeout
42582024-10-01T02:34:41.490ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
42592024-10-01T02:34:41.490ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 4 reason = Timeout
42602024-10-01T02:34:41.490ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
42612024-10-01T02:34:41.490ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
42622024-10-01T02:34:41.490ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 4 reason = Timeout
42632024-10-01T02:34:41.490ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
42642024-10-01T02:34:41.490ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 5 reason = Timeout
42652024-10-01T02:34:41.490ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
42662024-10-01T02:34:41.490ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
42672024-10-01T02:34:41.490ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42682024-10-01T02:34:41.490ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
42692024-10-01T02:34:41.490ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
42702024-10-01T02:34:41.490ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
42712024-10-01T02:34:41.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
42722024-10-01T02:34:41.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
42732024-10-01T02:34:41.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
42742024-10-01T02:34:41.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
42752024-10-01T02:34:41.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
42762024-10-01T02:34:41.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
42772024-10-01T02:34:41.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
42782024-10-01T02:34:41.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
42792024-10-01T02:34:41.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
42802024-10-01T02:34:41.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
42812024-10-01T02:34:41.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
42822024-10-01T02:34:41.493ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42832024-10-01T02:34:41.494ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1334, tv_nsec: 937098059 } })
42842024-10-01T02:34:41.494ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42852024-10-01T02:34:41.494ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.227531ms iteration = 4 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
42862024-10-01T02:34:41.495ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1051
42872024-10-01T02:34:41.495ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1334, tv_nsec: 938559474 } })
42882024-10-01T02:34:41.496ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1051
42892024-10-01T02:34:41.496ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
42902024-10-01T02:34:41.496ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42912024-10-01T02:34:41.496ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42922024-10-01T02:34:41.498ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
42932024-10-01T02:34:41.498ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
42942024-10-01T02:34:41.498ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
42952024-10-01T02:34:41.498ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42962024-10-01T02:34:41.499ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
42972024-10-01T02:34:41.499ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
42982024-10-01T02:34:41.500ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 9.888616ms iteration = 4 status = {"errors":[],"garbage_collect_requested":[]}
42992024-10-01T02:34:41.501ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
43002024-10-01T02:34:41.501ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
43012024-10-01T02:34:41.502ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43022024-10-01T02:34:41.509ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43032024-10-01T02:34:41.511ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43042024-10-01T02:34:41.512ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
43052024-10-01T02:34:41.512ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
43062024-10-01T02:34:41.512ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
43072024-10-01T02:34:41.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
43082024-10-01T02:34:41.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
43092024-10-01T02:34:41.513ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
43102024-10-01T02:34:41.513ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
43112024-10-01T02:34:41.513ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
43122024-10-01T02:34:41.514ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
43132024-10-01T02:34:41.515ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43142024-10-01T02:34:41.515ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
43152024-10-01T02:34:41.515ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43162024-10-01T02:34:41.515ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
43172024-10-01T02:34:41.515ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1334, tv_nsec: 958520108 } })
43182024-10-01T02:34:41.516ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
43192024-10-01T02:34:41.516ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1051 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd
43202024-10-01T02:34:41.517ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 26.727908ms iteration = 4 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
43212024-10-01T02:34:41.517ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43222024-10-01T02:34:41.521ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8f598f5c-ad31-4712-b43f-7ac75a933d07, lookup_type: ById(8f598f5c-ad31-4712-b43f-7ac75a933d07) } result = Ok(())
43232024-10-01T02:34:41.521ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43242024-10-01T02:34:41.521ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43252024-10-01T02:34:41.523ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
43262024-10-01T02:34:41.523ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 32.377322ms iteration = 4 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
43272024-10-01T02:34:41.529ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 original_time_created = 2024-10-01 02:32:51.153042 UTC target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 time_created = 2024-10-01 02:32:51.153042 UTC
43282024-10-01T02:34:41.529ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 38.840321ms iteration = 10 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8f598f5c-ad31-4712-b43f-7ac75a933d07","time_created":"2024-10-01T02:32:51.153042Z"}
43292024-10-01T02:34:41.535ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
43302024-10-01T02:34:41.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
43312024-10-01T02:34:41.538ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
43322024-10-01T02:34:41.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
43332024-10-01T02:34:41.539ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
43342024-10-01T02:34:41.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
43352024-10-01T02:34:41.540ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 49.891246ms iteration = 4 status = {"errors":[],"records_set_to_done":[]}
43362024-10-01T02:34:41.540ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43372024-10-01T02:34:41.541ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
43382024-10-01T02:34:41.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
43392024-10-01T02:34:41.544ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 2a571ec0-85a3-450e-88fc-680c13ffa211, lookup_type: ById(2a571ec0-85a3-450e-88fc-680c13ffa211) } result = Ok(())
43402024-10-01T02:34:41.544ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
43412024-10-01T02:34:41.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
43422024-10-01T02:34:41.544ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
43432024-10-01T02:34:41.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
43442024-10-01T02:34:41.545ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43452024-10-01T02:34:41.546ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 55.740534ms iteration = 4 status = 0
43462024-10-01T02:34:41.547ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 56.473766ms iteration = 10 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
43472024-10-01T02:34:41.547ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
43482024-10-01T02:34:41.547ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
43492024-10-01T02:34:41.547ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43502024-10-01T02:34:41.548ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
43512024-10-01T02:34:41.548ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
43522024-10-01T02:34:41.548ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
43532024-10-01T02:34:41.548ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
43542024-10-01T02:34:41.550ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
43552024-10-01T02:34:41.550ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
43562024-10-01T02:34:41.550ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
43572024-10-01T02:34:41.550ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
43582024-10-01T02:34:41.550ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
43592024-10-01T02:34:41.551ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
43602024-10-01T02:34:41.551ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43612024-10-01T02:34:41.553ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
43622024-10-01T02:34:41.553ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
43632024-10-01T02:34:41.554ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43642024-10-01T02:34:41.560ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43652024-10-01T02:34:41.562ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
43662024-10-01T02:34:41.562ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
43672024-10-01T02:34:41.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
43682024-10-01T02:34:41.571ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 80.917727ms iteration = 4 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
43692024-10-01T02:34:41.571ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1059 zone_address = fd00:1122:3344:101::2
43702024-10-01T02:34:41.571ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
43712024-10-01T02:34:41.571ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "5c0c11d9-48bd-405a-ac3c-0b0c42ed0c80", "content-length": "26", "date": "Tue, 01 Oct 2024 02:34:41 GMT"} })
43722024-10-01T02:34:41.571ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1064 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
43732024-10-01T02:34:41.573ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
43742024-10-01T02:34:41.576ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 86.163334ms iteration = 4 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
43752024-10-01T02:34:41.582ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
43762024-10-01T02:34:41.582ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
43772024-10-01T02:34:41.582ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 91.903321ms iteration = 4 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
43782024-10-01T02:34:41.605ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 115.266972ms iteration = 6 status = {"physical_disks_added":0}
43792024-10-01T02:34:41.635ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1059 zone_address = fd00:1122:3344:101::2
43802024-10-01T02:34:41.635ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
43812024-10-01T02:34:41.635ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "afccb12f-0746-45dd-a1c6-9b752eb387dc", "content-length": "26", "date": "Tue, 01 Oct 2024 02:34:41 GMT"} })
43822024-10-01T02:34:41.635ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1064 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
43832024-10-01T02:34:41.636ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
43842024-10-01T02:34:41.638ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
43852024-10-01T02:34:41.639ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
43862024-10-01T02:34:41.688ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
43872024-10-01T02:34:41.689ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "c1f9d915-8aa4-4cc2-ab11-8d094ad1e25a", "content-length": "2", "date": "Tue, 01 Oct 2024 02:34:41 GMT"} })
43882024-10-01T02:34:41.690ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
43892024-10-01T02:34:41.690ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
43902024-10-01T02:34:41.691ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1059 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd zone_address = fd00:1122:3344:101::2
43912024-10-01T02:34:41.691ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
43922024-10-01T02:34:41.691ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "23e2deca-4ffe-4f9a-ae00-5a4cdceee6a1", "content-length": "26", "date": "Tue, 01 Oct 2024 02:34:41 GMT"} })
43932024-10-01T02:34:41.691ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1064 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
43942024-10-01T02:34:41.693ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd
43952024-10-01T02:34:41.722ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
43962024-10-01T02:34:41.722ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "d973ec47-7861-41e3-bcce-d83950028c99", "content-length": "372", "date": "Tue, 01 Oct 2024 02:34:41 GMT"} })
43972024-10-01T02:34:41.722ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
43982024-10-01T02:34:41.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43992024-10-01T02:34:41.724ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44002024-10-01T02:34:41.724ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 234.339037ms iteration = 4 status = null
44012024-10-01T02:34:41.725ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
44022024-10-01T02:34:41.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
44032024-10-01T02:34:41.726ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
44042024-10-01T02:34:41.726ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
44052024-10-01T02:34:41.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
44062024-10-01T02:34:41.727ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44072024-10-01T02:34:41.729ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
44082024-10-01T02:34:41.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
44092024-10-01T02:34:41.729ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
44102024-10-01T02:34:41.729ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
44112024-10-01T02:34:41.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
44122024-10-01T02:34:41.732ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
44132024-10-01T02:34:41.732ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "3a70600c-c5cd-484d-8dd3-9ec3889d2efd", "date": "Tue, 01 Oct 2024 02:34:41 GMT"} })
44142024-10-01T02:34:41.734ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 243.922507ms iteration = 5 status = {}
44152024-10-01T02:34:41.737ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 246.880467ms iteration = 4 status = {}
44162024-10-01T02:34:41.848ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44172024-10-01T02:34:41.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44182024-10-01T02:34:41.849ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
44192024-10-01T02:34:41.849ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "815e083d-2d50-4c45-9347-b4fcaaadefe2", "content-length": "691", "date": "Tue, 01 Oct 2024 02:34:41 GMT"} })
44202024-10-01T02:34:41.849ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
44212024-10-01T02:34:41.849ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
44222024-10-01T02:34:41.849ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
44232024-10-01T02:34:41.850ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 359.940742ms iteration = 4 status = {}
44242024-10-01T02:34:41.850ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 58c2bb06-eaf4-47b5-aefe-83ea06db2406, rack_id: 52547763-7759-42e1-81a9-8b833f59f5dd, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(57ef3335-befd-4872-b57f-5c2571dcca50) } rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd switch_location = Switch0
44252024-10-01T02:34:41.850ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44262024-10-01T02:34:41.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44272024-10-01T02:34:41.859ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
44282024-10-01T02:34:41.859ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "a7b77643-6747-488c-b118-210486729dbe", "content-length": "121", "date": "Tue, 01 Oct 2024 02:34:41 GMT"} })
44292024-10-01T02:34:41.859ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
44302024-10-01T02:34:41.859ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 57ef3335-befd-4872-b57f-5c2571dcca50
44312024-10-01T02:34:41.859ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
44322024-10-01T02:34:41.859ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
44332024-10-01T02:34:41.859ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd routes = {}
44342024-10-01T02:34:41.859ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd routes = {}
44352024-10-01T02:34:41.859ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd
44362024-10-01T02:34:41.859ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44372024-10-01T02:34:41.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44382024-10-01T02:34:41.861ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
44392024-10-01T02:34:41.862ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "b1b5e7cf-3e99-4c0b-98ec-3bb5fe90ffce", "content-length": "2", "date": "Tue, 01 Oct 2024 02:34:41 GMT"} })
44402024-10-01T02:34:41.862ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
44412024-10-01T02:34:41.862ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "02b65434-3504-4779-b4a1-6281454f13aa", "content-length": "52", "date": "Tue, 01 Oct 2024 02:34:41 GMT"} })
44422024-10-01T02:34:41.862ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd switch_location = Switch0
44432024-10-01T02:34:41.862ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
44442024-10-01T02:34:41.951ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "93147ea8-675b-43b7-9c8b-94cacfca6953", "date": "Tue, 01 Oct 2024 02:34:41 GMT"} })
44452024-10-01T02:34:41.951ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd switch = Switch0
44462024-10-01T02:34:41.951ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
44472024-10-01T02:34:41.951ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "48db6a09-ae54-46ec-bae8-67fe9f13ed5d", "content-length": "667", "date": "Tue, 01 Oct 2024 02:34:41 GMT"} })
44482024-10-01T02:34:41.951ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44492024-10-01T02:34:41.951ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44502024-10-01T02:34:41.955ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44512024-10-01T02:34:41.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44522024-10-01T02:34:41.959ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44532024-10-01T02:34:41.959ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44542024-10-01T02:34:41.961ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44552024-10-01T02:34:41.961ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44562024-10-01T02:34:41.968ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 477.644744ms iteration = 4 status = {}
44572024-10-01T02:34:42.200ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:60878 req_id = e592ab7c-b8d4-4669-8aa5-36c25c2e2fff roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
44582024-10-01T02:34:42.200ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:60878 req_id = e592ab7c-b8d4-4669-8aa5-36c25c2e2fff resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
44592024-10-01T02:34:42.203ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3643 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:60878 req_id = e592ab7c-b8d4-4669-8aa5-36c25c2e2fff response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
44602024-10-01T02:34:44.827ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1338 local_addr = [fd00:1122:3344:101::c]:53319 method = GET remote_addr = [fd00:1122:3344:101::d]:65459 req_id = 26d10a60-e1e8-4a02-b558-ea222b391976 response_code = 200 uri = /3dfd7033-71d8-4eb9-bb97-49dae3b5cd35
44612024-10-01T02:34:51.490ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 11 reason = Timeout
44622024-10-01T02:34:51.490ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44632024-10-01T02:34:51.490ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44642024-10-01T02:34:51.490ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 11 reason = Timeout
44652024-10-01T02:34:51.490ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
44662024-10-01T02:34:51.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
44672024-10-01T02:34:51.492ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44682024-10-01T02:34:51.493ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
44692024-10-01T02:34:51.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
44702024-10-01T02:34:51.495ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
44712024-10-01T02:34:51.495ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44722024-10-01T02:34:51.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44732024-10-01T02:34:51.497ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44742024-10-01T02:34:51.497ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44752024-10-01T02:34:51.498ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44762024-10-01T02:34:51.501ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8f598f5c-ad31-4712-b43f-7ac75a933d07, lookup_type: ById(8f598f5c-ad31-4712-b43f-7ac75a933d07) } result = Ok(())
44772024-10-01T02:34:51.501ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44782024-10-01T02:34:51.501ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44792024-10-01T02:34:51.510ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 original_time_created = 2024-10-01 02:32:51.153042 UTC target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 time_created = 2024-10-01 02:32:51.153042 UTC
44802024-10-01T02:34:51.510ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.835592ms iteration = 11 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8f598f5c-ad31-4712-b43f-7ac75a933d07","time_created":"2024-10-01T02:32:51.153042Z"}
44812024-10-01T02:34:51.523ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 32.737329ms iteration = 11 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
44822024-10-01T02:34:54.827ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1125 local_addr = [fd00:1122:3344:101::c]:53319 method = GET remote_addr = [fd00:1122:3344:101::d]:65459 req_id = 81c399fc-4f45-4d5b-8643-896e5cd92a9a response_code = 200 uri = /3dfd7033-71d8-4eb9-bb97-49dae3b5cd35
44832024-10-01T02:35:01.490ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 12 reason = Timeout
44842024-10-01T02:35:01.490ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44852024-10-01T02:35:01.490ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44862024-10-01T02:35:01.491ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 12 reason = Timeout
44872024-10-01T02:35:01.491ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
44882024-10-01T02:35:01.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
44892024-10-01T02:35:01.492ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44902024-10-01T02:35:01.493ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
44912024-10-01T02:35:01.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
44922024-10-01T02:35:01.495ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.994227ms iteration = 12 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
44932024-10-01T02:35:01.495ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
44942024-10-01T02:35:01.495ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44952024-10-01T02:35:01.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44962024-10-01T02:35:01.497ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44972024-10-01T02:35:01.497ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44982024-10-01T02:35:01.499ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44992024-10-01T02:35:01.501ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8f598f5c-ad31-4712-b43f-7ac75a933d07, lookup_type: ById(8f598f5c-ad31-4712-b43f-7ac75a933d07) } result = Ok(())
45002024-10-01T02:35:01.501ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45012024-10-01T02:35:01.501ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45022024-10-01T02:35:01.508ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 original_time_created = 2024-10-01 02:32:51.153042 UTC target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 time_created = 2024-10-01 02:32:51.153042 UTC
45032024-10-01T02:35:01.508ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.296517ms iteration = 12 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8f598f5c-ad31-4712-b43f-7ac75a933d07","time_created":"2024-10-01T02:32:51.153042Z"}
45042024-10-01T02:35:04.828ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1874 local_addr = [fd00:1122:3344:101::c]:53319 method = GET remote_addr = [fd00:1122:3344:101::d]:65459 req_id = 51228184-81b0-4230-a52a-aa10903d6c40 response_code = 200 uri = /3dfd7033-71d8-4eb9-bb97-49dae3b5cd35
45052024-10-01T02:35:11.490ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 5 reason = Timeout
45062024-10-01T02:35:11.490ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 4 reason = Timeout
45072024-10-01T02:35:11.490ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
45082024-10-01T02:35:11.490ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 4 reason = Timeout
45092024-10-01T02:35:11.490ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
45102024-10-01T02:35:11.490ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
45112024-10-01T02:35:11.490ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 5 reason = Timeout
45122024-10-01T02:35:11.490ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 5 reason = Timeout
45132024-10-01T02:35:11.490ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 5 reason = Timeout
45142024-10-01T02:35:11.490ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
45152024-10-01T02:35:11.490ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 3 reason = Timeout
45162024-10-01T02:35:11.490ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
45172024-10-01T02:35:11.490ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 7 reason = Timeout
45182024-10-01T02:35:11.490ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
45192024-10-01T02:35:11.490ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
45202024-10-01T02:35:11.490ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 4 reason = Timeout
45212024-10-01T02:35:11.490ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
45222024-10-01T02:35:11.490ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
45232024-10-01T02:35:11.490ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
45242024-10-01T02:35:11.490ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 5 reason = Timeout
45252024-10-01T02:35:11.490ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
45262024-10-01T02:35:11.490ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 4 reason = Timeout
45272024-10-01T02:35:11.490ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
45282024-10-01T02:35:11.490ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 5 reason = Timeout
45292024-10-01T02:35:11.490ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
45302024-10-01T02:35:11.490ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 5 reason = Timeout
45312024-10-01T02:35:11.490ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 5 reason = Timeout
45322024-10-01T02:35:11.490ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
45332024-10-01T02:35:11.490ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 5 reason = Timeout
45342024-10-01T02:35:11.490ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 13 reason = Timeout
45352024-10-01T02:35:11.490ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 3 reason = Timeout
45362024-10-01T02:35:11.490ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45372024-10-01T02:35:11.490ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-10-01 02:25:11.490521226 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
45382024-10-01T02:35:11.490ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
45392024-10-01T02:35:11.490ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 4 reason = Timeout
45402024-10-01T02:35:11.490ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 4 reason = Timeout
45412024-10-01T02:35:11.490ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07
45422024-10-01T02:35:11.490ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 20.031\u{b5}s iteration = 4 status = {"enabled":false,"target_id":"8f598f5c-ad31-4712-b43f-7ac75a933d07"}
45432024-10-01T02:35:11.490ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
45442024-10-01T02:35:11.490ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
45452024-10-01T02:35:11.490ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
45462024-10-01T02:35:11.490ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
45472024-10-01T02:35:11.490ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
45482024-10-01T02:35:11.490ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
45492024-10-01T02:35:11.490ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
45502024-10-01T02:35:11.490ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
45512024-10-01T02:35:11.490ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
45522024-10-01T02:35:11.490ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45532024-10-01T02:35:11.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
45542024-10-01T02:35:11.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
45552024-10-01T02:35:11.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
45562024-10-01T02:35:11.491ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 13 reason = Timeout
45572024-10-01T02:35:11.491ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 5 reason = Timeout
45582024-10-01T02:35:11.491ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
45592024-10-01T02:35:11.491ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
45602024-10-01T02:35:11.491ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 3 reason = Timeout
45612024-10-01T02:35:11.491ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
45622024-10-01T02:35:11.491ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 3 reason = Timeout
45632024-10-01T02:35:11.491ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
45642024-10-01T02:35:11.491ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 5 reason = Timeout
45652024-10-01T02:35:11.491ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
45662024-10-01T02:35:11.491ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 5 reason = Timeout
45672024-10-01T02:35:11.491ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
45682024-10-01T02:35:11.491ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 5 reason = Timeout
45692024-10-01T02:35:11.491ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
45702024-10-01T02:35:11.491ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 5 reason = Timeout
45712024-10-01T02:35:11.491ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
45722024-10-01T02:35:11.491ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
45732024-10-01T02:35:11.491ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 6 reason = Timeout
45742024-10-01T02:35:11.491ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45752024-10-01T02:35:11.491ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 5 reason = Timeout
45762024-10-01T02:35:11.491ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
45772024-10-01T02:35:11.491ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 3 reason = Timeout
45782024-10-01T02:35:11.491ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
45792024-10-01T02:35:11.492ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
45802024-10-01T02:35:11.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
45812024-10-01T02:35:11.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
45822024-10-01T02:35:11.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
45832024-10-01T02:35:11.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
45842024-10-01T02:35:11.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
45852024-10-01T02:35:11.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
45862024-10-01T02:35:11.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45872024-10-01T02:35:11.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
45882024-10-01T02:35:11.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
45892024-10-01T02:35:11.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
45902024-10-01T02:35:11.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
45912024-10-01T02:35:11.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
45922024-10-01T02:35:11.493ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("1af5fb25-d768-4bc6-915c-0b4c59e1f0ef.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("293e78c2-b712-4c13-b502-e2be11a76306.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("71ea2e4f-4772-4ce7-8093-48597fd7fd92.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("71ea2e4f-4772-4ce7-8093-48597fd7fd92.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1364, tv_nsec: 936133923 } })
45932024-10-01T02:35:11.493ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("0a1ed896-5078-4267-b636-10151376f015.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("eb937866-c779-4a9e-aec4-cc18302d4ce1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("eb937866-c779-4a9e-aec4-cc18302d4ce1.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1364, tv_nsec: 936418638 } })
45942024-10-01T02:35:11.494ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45952024-10-01T02:35:11.494ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
45962024-10-01T02:35:11.494ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45972024-10-01T02:35:11.494ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
45982024-10-01T02:35:11.495ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 5.199087ms iteration = 5 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
45992024-10-01T02:35:11.496ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
46002024-10-01T02:35:11.496ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 6.025061ms iteration = 4 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
46012024-10-01T02:35:11.496ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
46022024-10-01T02:35:11.496ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
46032024-10-01T02:35:11.497ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
46042024-10-01T02:35:11.497ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
46052024-10-01T02:35:11.497ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46062024-10-01T02:35:11.497ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
46072024-10-01T02:35:11.497ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 6.639451ms iteration = 4 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
46082024-10-01T02:35:11.497ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1364, tv_nsec: 939683402 } })
46092024-10-01T02:35:11.497ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46102024-10-01T02:35:11.498ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1051
46112024-10-01T02:35:11.501ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1364, tv_nsec: 943502496 } })
46122024-10-01T02:35:11.501ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-10-01 02:25:11.490521226 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
46132024-10-01T02:35:11.501ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 10.615028ms iteration = 3 status = {"expiration":"2024-10-01T02:25:11.490521226Z","pruned":[]}
46142024-10-01T02:35:11.502ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46152024-10-01T02:35:11.502ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1051
46162024-10-01T02:35:11.506ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
46172024-10-01T02:35:11.506ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46182024-10-01T02:35:11.507ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46192024-10-01T02:35:11.511ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
46202024-10-01T02:35:11.511ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
46212024-10-01T02:35:11.511ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 20.044216ms iteration = 3 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
46222024-10-01T02:35:11.515ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 23.755459ms iteration = 3 status = {"errors":[],"found_port_ok":[]}
46232024-10-01T02:35:11.520ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
46242024-10-01T02:35:11.520ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
46252024-10-01T02:35:11.522ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1364, tv_nsec: 964470228 } })
46262024-10-01T02:35:11.522ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1051 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd
46272024-10-01T02:35:11.522ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46282024-10-01T02:35:11.522ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46292024-10-01T02:35:11.540ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
46302024-10-01T02:35:11.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
46312024-10-01T02:35:11.541ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46322024-10-01T02:35:11.545ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
46332024-10-01T02:35:11.545ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
46342024-10-01T02:35:11.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
46352024-10-01T02:35:11.548ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46362024-10-01T02:35:11.551ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
46372024-10-01T02:35:11.551ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
46382024-10-01T02:35:11.551ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
46392024-10-01T02:35:11.553ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46402024-10-01T02:35:11.553ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 61.878227ms iteration = 5 status = {"errors":[],"records_set_to_done":[]}
46412024-10-01T02:35:11.554ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
46422024-10-01T02:35:11.554ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
46432024-10-01T02:35:11.554ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
46442024-10-01T02:35:11.554ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
46452024-10-01T02:35:11.555ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46462024-10-01T02:35:11.555ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 64.115534ms iteration = 5 status = {"errors":[],"garbage_collect_requested":[]}
46472024-10-01T02:35:11.556ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
46482024-10-01T02:35:11.556ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
46492024-10-01T02:35:11.556ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
46502024-10-01T02:35:11.556ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
46512024-10-01T02:35:11.556ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
46522024-10-01T02:35:11.556ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
46532024-10-01T02:35:11.557ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
46542024-10-01T02:35:11.557ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46552024-10-01T02:35:11.559ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46562024-10-01T02:35:11.559ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
46572024-10-01T02:35:11.559ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
46582024-10-01T02:35:11.559ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
46592024-10-01T02:35:11.559ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
46602024-10-01T02:35:11.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
46612024-10-01T02:35:11.561ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46622024-10-01T02:35:11.561ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
46632024-10-01T02:35:11.562ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
46642024-10-01T02:35:11.562ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46652024-10-01T02:35:11.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46662024-10-01T02:35:11.563ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
46672024-10-01T02:35:11.563ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
46682024-10-01T02:35:11.564ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
46692024-10-01T02:35:11.565ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
46702024-10-01T02:35:11.566ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
46712024-10-01T02:35:11.572ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
46722024-10-01T02:35:11.572ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 80.794644ms iteration = 5 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
46732024-10-01T02:35:11.572ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46742024-10-01T02:35:11.575ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
46752024-10-01T02:35:11.575ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
46762024-10-01T02:35:11.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
46772024-10-01T02:35:11.582ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
46782024-10-01T02:35:11.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
46792024-10-01T02:35:11.585ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
46802024-10-01T02:35:11.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
46812024-10-01T02:35:11.587ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46822024-10-01T02:35:11.589ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
46832024-10-01T02:35:11.589ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
46842024-10-01T02:35:11.589ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
46852024-10-01T02:35:11.589ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
46862024-10-01T02:35:11.589ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
46872024-10-01T02:35:11.589ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46882024-10-01T02:35:11.590ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 2a571ec0-85a3-450e-88fc-680c13ffa211, lookup_type: ById(2a571ec0-85a3-450e-88fc-680c13ffa211) } result = Ok(())
46892024-10-01T02:35:11.590ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
46902024-10-01T02:35:11.590ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
46912024-10-01T02:35:11.591ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 99.384305ms iteration = 13 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
46922024-10-01T02:35:11.591ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46932024-10-01T02:35:11.593ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8f598f5c-ad31-4712-b43f-7ac75a933d07, lookup_type: ById(8f598f5c-ad31-4712-b43f-7ac75a933d07) } result = Ok(())
46942024-10-01T02:35:11.593ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46952024-10-01T02:35:11.593ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46962024-10-01T02:35:11.596ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
46972024-10-01T02:35:11.596ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
46982024-10-01T02:35:11.596ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
46992024-10-01T02:35:11.598ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 108.196253ms iteration = 5 status = 0
47002024-10-01T02:35:11.599ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
47012024-10-01T02:35:11.599ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = bc7b49a6-c38c-499f-983e-184e2c58fa04 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
47022024-10-01T02:35:11.599ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
47032024-10-01T02:35:11.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
47042024-10-01T02:35:11.600ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
47052024-10-01T02:35:11.600ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
47062024-10-01T02:35:11.600ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
47072024-10-01T02:35:11.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
47082024-10-01T02:35:11.601ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47092024-10-01T02:35:11.604ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
47102024-10-01T02:35:11.604ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
47112024-10-01T02:35:11.604ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47122024-10-01T02:35:11.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
47132024-10-01T02:35:11.606ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 116.35162ms iteration = 5 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
47142024-10-01T02:35:11.607ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
47152024-10-01T02:35:11.607ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
47162024-10-01T02:35:11.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
47172024-10-01T02:35:11.610ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = bc7b49a6-c38c-499f-983e-184e2c58fa04 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
47182024-10-01T02:35:11.610ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
47192024-10-01T02:35:11.610ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-10-01 02:33:12.369795 UTC dns_group = internal generation = 1
47202024-10-01T02:35:11.610ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 119.97301ms iteration = 4 status = {"generation":1}
47212024-10-01T02:35:11.610ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 118.854862ms iteration = 5 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
47222024-10-01T02:35:11.610ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 original_time_created = 2024-10-01 02:32:51.153042 UTC target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 time_created = 2024-10-01 02:32:51.153042 UTC
47232024-10-01T02:35:11.610ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 120.344227ms iteration = 13 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8f598f5c-ad31-4712-b43f-7ac75a933d07","time_created":"2024-10-01T02:32:51.153042Z"}
47242024-10-01T02:35:11.613ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
47252024-10-01T02:35:11.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
47262024-10-01T02:35:11.616ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
47272024-10-01T02:35:11.617ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
47282024-10-01T02:35:11.618ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
47292024-10-01T02:35:11.618ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
47302024-10-01T02:35:11.618ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 128.346641ms iteration = 3 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
47312024-10-01T02:35:11.619ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
47322024-10-01T02:35:11.619ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
47332024-10-01T02:35:11.619ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
47342024-10-01T02:35:11.619ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
47352024-10-01T02:35:11.620ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
47362024-10-01T02:35:11.623ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
47372024-10-01T02:35:11.626ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47382024-10-01T02:35:11.628ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
47392024-10-01T02:35:11.630ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
47402024-10-01T02:35:11.630ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
47412024-10-01T02:35:11.630ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
47422024-10-01T02:35:11.638ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
47432024-10-01T02:35:11.638ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
47442024-10-01T02:35:11.638ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 146.363053ms iteration = 5 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
47452024-10-01T02:35:11.641ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1059 zone_address = fd00:1122:3344:101::2
47462024-10-01T02:35:11.641ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
47472024-10-01T02:35:11.642ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
47482024-10-01T02:35:11.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
47492024-10-01T02:35:11.642ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "45c3bed3-788d-45db-876c-18683c2a9346", "content-length": "26", "date": "Tue, 01 Oct 2024 02:35:11 GMT"} })
47502024-10-01T02:35:11.642ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1064 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
47512024-10-01T02:35:11.645ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
47522024-10-01T02:35:11.661ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1059 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd zone_address = fd00:1122:3344:101::2
47532024-10-01T02:35:11.661ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
47542024-10-01T02:35:11.661ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a1b6e1ec-3e6f-412c-bb6d-9a1badafcb97", "content-length": "26", "date": "Tue, 01 Oct 2024 02:35:11 GMT"} })
47552024-10-01T02:35:11.661ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1064 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
47562024-10-01T02:35:11.663ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd
47572024-10-01T02:35:11.672ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 181.873378ms iteration = 7 status = {"physical_disks_added":0}
47582024-10-01T02:35:11.672ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1059 zone_address = fd00:1122:3344:101::2
47592024-10-01T02:35:11.672ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
47602024-10-01T02:35:11.673ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "54056d02-5e39-4197-89f1-2bc9812f6141", "content-length": "26", "date": "Tue, 01 Oct 2024 02:35:11 GMT"} })
47612024-10-01T02:35:11.673ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1064 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
47622024-10-01T02:35:11.674ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
47632024-10-01T02:35:11.708ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
47642024-10-01T02:35:11.708ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 216.942355ms iteration = 3 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
47652024-10-01T02:35:11.784ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
47662024-10-01T02:35:11.786ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47672024-10-01T02:35:11.791ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
47682024-10-01T02:35:11.791ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
47692024-10-01T02:35:11.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
47702024-10-01T02:35:11.805ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
47712024-10-01T02:35:11.812ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
47722024-10-01T02:35:11.812ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 322.415743ms iteration = 5 status = {}
47732024-10-01T02:35:11.812ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "26fce963-6c5f-40da-bad2-52693be45148", "date": "Tue, 01 Oct 2024 02:35:11 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
47742024-10-01T02:35:11.812ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
47752024-10-01T02:35:11.813ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "7f0d9892-6546-44bc-aa07-a7d2caa07c36", "date": "Tue, 01 Oct 2024 02:35:11 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
47762024-10-01T02:35:11.813ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
47772024-10-01T02:35:11.815ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
47782024-10-01T02:35:11.815ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 325.247621ms iteration = 5 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
47792024-10-01T02:35:11.817ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 325.84048ms iteration = 5 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
47802024-10-01T02:35:11.826ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
47812024-10-01T02:35:11.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
47822024-10-01T02:35:11.827ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
47832024-10-01T02:35:11.827ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 3d6d7965-c160-4184-b04f-32fa0fb7b928 dns_zone_name = oxide.test found_so_far = 0 version = 2
47842024-10-01T02:35:11.827ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
47852024-10-01T02:35:11.827ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
47862024-10-01T02:35:11.828ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47872024-10-01T02:35:11.829ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47882024-10-01T02:35:11.829ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
47892024-10-01T02:35:11.830ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
47902024-10-01T02:35:11.830ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
47912024-10-01T02:35:11.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
47922024-10-01T02:35:11.830ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "a36cc817-4b55-4036-8d2d-7da2d52ad0eb", "content-length": "2", "date": "Tue, 01 Oct 2024 02:35:11 GMT"} })
47932024-10-01T02:35:11.832ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
47942024-10-01T02:35:11.832ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
47952024-10-01T02:35:11.832ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
47962024-10-01T02:35:11.832ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
47972024-10-01T02:35:11.832ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
47982024-10-01T02:35:11.834ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 3d6d7965-c160-4184-b04f-32fa0fb7b928 dns_zone_name = oxide.test found_so_far = 1 version = 2
47992024-10-01T02:35:11.834ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
48002024-10-01T02:35:11.834ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-10-01 02:33:13.765844 UTC dns_group = external generation = 2
48012024-10-01T02:35:11.834ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 344.30444ms iteration = 4 status = {"generation":2}
48022024-10-01T02:35:11.834ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 344.388771ms iteration = 5 status = null
48032024-10-01T02:35:11.846ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "5596db06-ccb2-4a48-a1b5-48e8bc6fd1bd", "content-length": "372", "date": "Tue, 01 Oct 2024 02:35:11 GMT"} })
48042024-10-01T02:35:11.846ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
48052024-10-01T02:35:11.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
48062024-10-01T02:35:11.848ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
48072024-10-01T02:35:11.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
48082024-10-01T02:35:11.852ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
48092024-10-01T02:35:11.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
48102024-10-01T02:35:11.855ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
48112024-10-01T02:35:11.855ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "bdf0a803-ad65-4c65-91a5-e849b830ed30", "date": "Tue, 01 Oct 2024 02:35:11 GMT"} })
48122024-10-01T02:35:11.857ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 365.662998ms iteration = 6 status = {}
48132024-10-01T02:35:11.862ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (changed) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-10-01T02:33:09.142901Z, time_modified: 2024-10-01T02:33:09.142901Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, db_silo: Silo { identity: SiloIdentity { id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-10-01T02:33:13.712784Z, time_modified: 2024-10-01T02:33:13.712784Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "ca547a59343cd98ceb775f10ce9428d8003a71a149b5b7d33f10c1e7a9820bb1" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, db_silo: Silo { identity: SiloIdentity { id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-10-01T02:33:13.712784Z, time_modified: 2024-10-01T02:33:13.712784Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "ca547a59343cd98ceb775f10ce9428d8003a71a149b5b7d33f10c1e7a9820bb1" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:94
48142024-10-01T02:35:11.862ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 372.331269ms iteration = 4 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"21983b87-d6d0-47c6-a33c-5fe68fbed0c6","tls_certs":["ca547a59343cd98ceb775f10ce9428d8003a71a149b5b7d33f10c1e7a9820bb1"]}},"default_endpoint":{"silo_id":"21983b87-d6d0-47c6-a33c-5fe68fbed0c6","tls_certs":["ca547a59343cd98ceb775f10ce9428d8003a71a149b5b7d33f10c1e7a9820bb1"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
48152024-10-01T02:35:11.883ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
48162024-10-01T02:35:11.884ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "cc7c4864-a7cf-48c2-bcce-21f07cdcc377", "date": "Tue, 01 Oct 2024 02:35:11 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
48172024-10-01T02:35:11.884ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
48182024-10-01T02:35:11.885ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "defab02c-5dc0-45e0-806a-ece4ace131ca", "date": "Tue, 01 Oct 2024 02:35:11 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
48192024-10-01T02:35:11.885ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
48202024-10-01T02:35:11.886ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "f8ba1673-4948-43e5-baf5-654bc07aa433", "date": "Tue, 01 Oct 2024 02:35:11 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
48212024-10-01T02:35:11.886ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
48222024-10-01T02:35:11.888ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
48232024-10-01T02:35:11.888ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 397.953239ms iteration = 5 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
48242024-10-01T02:35:11.890ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
48252024-10-01T02:35:11.890ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
48262024-10-01T02:35:11.892ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48272024-10-01T02:35:11.894ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
48282024-10-01T02:35:11.894ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
48292024-10-01T02:35:11.894ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
48302024-10-01T02:35:11.895ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48312024-10-01T02:35:11.898ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
48322024-10-01T02:35:11.898ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
48332024-10-01T02:35:11.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
48342024-10-01T02:35:11.925ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48352024-10-01T02:35:11.925ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48362024-10-01T02:35:11.928ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 58c2bb06-eaf4-47b5-aefe-83ea06db2406, rack_id: 52547763-7759-42e1-81a9-8b833f59f5dd, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(57ef3335-befd-4872-b57f-5c2571dcca50) } rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd switch_location = Switch0
48372024-10-01T02:35:11.928ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48382024-10-01T02:35:11.928ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48392024-10-01T02:35:11.937ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
48402024-10-01T02:35:11.937ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "2aa8a78c-7001-4aa3-a552-4be385c6c2dd", "content-length": "121", "date": "Tue, 01 Oct 2024 02:35:11 GMT"} })
48412024-10-01T02:35:11.937ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
48422024-10-01T02:35:11.937ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 57ef3335-befd-4872-b57f-5c2571dcca50
48432024-10-01T02:35:11.937ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
48442024-10-01T02:35:11.937ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
48452024-10-01T02:35:11.937ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd routes = {}
48462024-10-01T02:35:11.937ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd routes = {}
48472024-10-01T02:35:11.937ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd
48482024-10-01T02:35:11.937ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48492024-10-01T02:35:11.938ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48502024-10-01T02:35:11.942ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
48512024-10-01T02:35:11.942ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "89235afc-f0a8-44e9-8f6e-ae4138438eb9", "content-length": "691", "date": "Tue, 01 Oct 2024 02:35:11 GMT"} })
48522024-10-01T02:35:11.943ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
48532024-10-01T02:35:11.943ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
48542024-10-01T02:35:11.943ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
48552024-10-01T02:35:11.944ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 454.339954ms iteration = 5 status = {}
48562024-10-01T02:35:11.946ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
48572024-10-01T02:35:11.946ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "19a2cef0-34c2-4f8e-b16b-16316ce9b059", "content-length": "2", "date": "Tue, 01 Oct 2024 02:35:11 GMT"} })
48582024-10-01T02:35:11.946ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
48592024-10-01T02:35:11.947ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "709f0608-20a3-4e6c-a36b-4f28c7d303a7", "content-length": "52", "date": "Tue, 01 Oct 2024 02:35:11 GMT"} })
48602024-10-01T02:35:11.947ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd switch_location = Switch0
48612024-10-01T02:35:11.947ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
48622024-10-01T02:35:12.040ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "abc65ab6-4003-4b98-b4b1-60d8b4361733", "date": "Tue, 01 Oct 2024 02:35:11 GMT"} })
48632024-10-01T02:35:12.040ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd switch = Switch0
48642024-10-01T02:35:12.040ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
48652024-10-01T02:35:12.041ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "a2983cd3-78a5-4fdf-a84f-94520ac7cb2e", "content-length": "667", "date": "Tue, 01 Oct 2024 02:35:11 GMT"} })
48662024-10-01T02:35:12.041ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48672024-10-01T02:35:12.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48682024-10-01T02:35:12.044ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48692024-10-01T02:35:12.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48702024-10-01T02:35:12.047ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48712024-10-01T02:35:12.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48722024-10-01T02:35:12.050ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48732024-10-01T02:35:12.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48742024-10-01T02:35:12.057ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 566.707297ms iteration = 5 status = {}
48752024-10-01T02:35:12.236ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:60878 req_id = 276c983e-2ca7-493f-981d-2bc8e64e83c9 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
48762024-10-01T02:35:12.236ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:60878 req_id = 276c983e-2ca7-493f-981d-2bc8e64e83c9 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
48772024-10-01T02:35:12.238ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2856 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:60878 req_id = 276c983e-2ca7-493f-981d-2bc8e64e83c9 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
48782024-10-01T02:35:14.827ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1113 local_addr = [fd00:1122:3344:101::c]:53319 method = GET remote_addr = [fd00:1122:3344:101::d]:65459 req_id = 79347caa-ea28-41b0-b4ff-f15ff1a23f9a response_code = 200 uri = /3dfd7033-71d8-4eb9-bb97-49dae3b5cd35
48792024-10-01T02:35:21.490ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 14 reason = Timeout
48802024-10-01T02:35:21.490ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48812024-10-01T02:35:21.490ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48822024-10-01T02:35:21.491ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 14 reason = Timeout
48832024-10-01T02:35:21.491ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
48842024-10-01T02:35:21.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
48852024-10-01T02:35:21.492ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48862024-10-01T02:35:21.494ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
48872024-10-01T02:35:21.494ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48882024-10-01T02:35:21.494ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48892024-10-01T02:35:21.496ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48902024-10-01T02:35:21.496ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48912024-10-01T02:35:21.497ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48922024-10-01T02:35:21.500ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8f598f5c-ad31-4712-b43f-7ac75a933d07, lookup_type: ById(8f598f5c-ad31-4712-b43f-7ac75a933d07) } result = Ok(())
48932024-10-01T02:35:21.500ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48942024-10-01T02:35:21.500ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48952024-10-01T02:35:21.508ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 original_time_created = 2024-10-01 02:32:51.153042 UTC target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 time_created = 2024-10-01 02:32:51.153042 UTC
48962024-10-01T02:35:21.508ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.380528ms iteration = 14 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8f598f5c-ad31-4712-b43f-7ac75a933d07","time_created":"2024-10-01T02:32:51.153042Z"}
48972024-10-01T02:35:21.515ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
48982024-10-01T02:35:21.516ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
48992024-10-01T02:35:21.517ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 26.24605ms iteration = 14 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
49002024-10-01T02:35:24.828ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1221 local_addr = [fd00:1122:3344:101::c]:53319 method = GET remote_addr = [fd00:1122:3344:101::d]:65459 req_id = 6c256c36-a050-4d18-a66a-777205f5cda2 response_code = 200 uri = /3dfd7033-71d8-4eb9-bb97-49dae3b5cd35
49012024-10-01T02:35:31.490ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 15 reason = Timeout
49022024-10-01T02:35:31.490ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49032024-10-01T02:35:31.490ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49042024-10-01T02:35:31.490ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 15 reason = Timeout
49052024-10-01T02:35:31.490ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
49062024-10-01T02:35:31.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
49072024-10-01T02:35:31.492ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49082024-10-01T02:35:31.493ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
49092024-10-01T02:35:31.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
49102024-10-01T02:35:31.495ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
49112024-10-01T02:35:31.495ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49122024-10-01T02:35:31.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49132024-10-01T02:35:31.499ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49142024-10-01T02:35:31.500ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49152024-10-01T02:35:31.501ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49162024-10-01T02:35:31.503ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8f598f5c-ad31-4712-b43f-7ac75a933d07, lookup_type: ById(8f598f5c-ad31-4712-b43f-7ac75a933d07) } result = Ok(())
49172024-10-01T02:35:31.503ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49182024-10-01T02:35:31.504ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49192024-10-01T02:35:31.512ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 original_time_created = 2024-10-01 02:32:51.153042 UTC target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 time_created = 2024-10-01 02:32:51.153042 UTC
49202024-10-01T02:35:31.512ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.883607ms iteration = 15 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8f598f5c-ad31-4712-b43f-7ac75a933d07","time_created":"2024-10-01T02:32:51.153042Z"}
49212024-10-01T02:35:31.520ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 29.110157ms iteration = 15 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
49222024-10-01T02:35:34.827ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1121 local_addr = [fd00:1122:3344:101::c]:53319 method = GET remote_addr = [fd00:1122:3344:101::d]:65459 req_id = 181b2c7f-af60-48d4-bc3b-a677ed3f443c response_code = 200 uri = /3dfd7033-71d8-4eb9-bb97-49dae3b5cd35
49232024-10-01T02:35:41.490ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 16 reason = Timeout
49242024-10-01T02:35:41.490ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 6 reason = Timeout
49252024-10-01T02:35:41.490ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49262024-10-01T02:35:41.490ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 6 reason = Timeout
49272024-10-01T02:35:41.490ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
49282024-10-01T02:35:41.490ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 6 reason = Timeout
49292024-10-01T02:35:41.490ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
49302024-10-01T02:35:41.490ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
49312024-10-01T02:35:41.490ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 6 reason = Timeout
49322024-10-01T02:35:41.490ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
49332024-10-01T02:35:41.490ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 8 reason = Timeout
49342024-10-01T02:35:41.490ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
49352024-10-01T02:35:41.490ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 6 reason = Timeout
49362024-10-01T02:35:41.490ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 6 reason = Timeout
49372024-10-01T02:35:41.490ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
49382024-10-01T02:35:41.490ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 6 reason = Timeout
49392024-10-01T02:35:41.490ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
49402024-10-01T02:35:41.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
49412024-10-01T02:35:41.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
49422024-10-01T02:35:41.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
49432024-10-01T02:35:41.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
49442024-10-01T02:35:41.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49452024-10-01T02:35:41.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
49462024-10-01T02:35:41.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
49472024-10-01T02:35:41.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
49482024-10-01T02:35:41.492ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 16 reason = Timeout
49492024-10-01T02:35:41.492ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 6 reason = Timeout
49502024-10-01T02:35:41.492ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
49512024-10-01T02:35:41.492ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
49522024-10-01T02:35:41.492ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 6 reason = Timeout
49532024-10-01T02:35:41.492ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
49542024-10-01T02:35:41.492ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
49552024-10-01T02:35:41.492ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 7 reason = Timeout
49562024-10-01T02:35:41.492ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
49572024-10-01T02:35:41.492ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 6 reason = Timeout
49582024-10-01T02:35:41.492ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 6 reason = Timeout
49592024-10-01T02:35:41.492ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
49602024-10-01T02:35:41.492ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
49612024-10-01T02:35:41.492ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 6 reason = Timeout
49622024-10-01T02:35:41.492ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
49632024-10-01T02:35:41.492ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 6 reason = Timeout
49642024-10-01T02:35:41.492ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
49652024-10-01T02:35:41.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
49662024-10-01T02:35:41.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
49672024-10-01T02:35:41.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
49682024-10-01T02:35:41.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
49692024-10-01T02:35:41.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
49702024-10-01T02:35:41.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
49712024-10-01T02:35:41.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
49722024-10-01T02:35:41.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
49732024-10-01T02:35:41.493ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49742024-10-01T02:35:41.493ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.057922ms iteration = 6 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
49752024-10-01T02:35:41.494ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49762024-10-01T02:35:41.494ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1394, tv_nsec: 936971547 } })
49772024-10-01T02:35:41.495ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1051
49782024-10-01T02:35:41.495ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49792024-10-01T02:35:41.496ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
49802024-10-01T02:35:41.496ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
49812024-10-01T02:35:41.496ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
49822024-10-01T02:35:41.497ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
49832024-10-01T02:35:41.497ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
49842024-10-01T02:35:41.497ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
49852024-10-01T02:35:41.498ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
49862024-10-01T02:35:41.498ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49872024-10-01T02:35:41.498ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49882024-10-01T02:35:41.498ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49892024-10-01T02:35:41.499ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1394, tv_nsec: 941536023 } })
49902024-10-01T02:35:41.499ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49912024-10-01T02:35:41.499ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1051
49922024-10-01T02:35:41.500ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
49932024-10-01T02:35:41.500ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
49942024-10-01T02:35:41.501ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
49952024-10-01T02:35:41.501ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
49962024-10-01T02:35:41.501ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
49972024-10-01T02:35:41.502ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
49982024-10-01T02:35:41.506ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
49992024-10-01T02:35:41.506ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
50002024-10-01T02:35:41.506ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
50012024-10-01T02:35:41.506ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
50022024-10-01T02:35:41.509ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1394, tv_nsec: 951319147 } })
50032024-10-01T02:35:41.510ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1051 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd
50042024-10-01T02:35:41.514ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50052024-10-01T02:35:41.514ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50062024-10-01T02:35:41.515ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50072024-10-01T02:35:41.515ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50082024-10-01T02:35:41.517ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50092024-10-01T02:35:41.518ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
50102024-10-01T02:35:41.518ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
50112024-10-01T02:35:41.518ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
50122024-10-01T02:35:41.519ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
50132024-10-01T02:35:41.519ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
50142024-10-01T02:35:41.520ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
50152024-10-01T02:35:41.520ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8f598f5c-ad31-4712-b43f-7ac75a933d07, lookup_type: ById(8f598f5c-ad31-4712-b43f-7ac75a933d07) } result = Ok(())
50162024-10-01T02:35:41.521ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50172024-10-01T02:35:41.521ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50182024-10-01T02:35:41.527ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
50192024-10-01T02:35:41.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
50202024-10-01T02:35:41.529ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 original_time_created = 2024-10-01 02:32:51.153042 UTC target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 time_created = 2024-10-01 02:32:51.153042 UTC
50212024-10-01T02:35:41.529ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 38.708489ms iteration = 16 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8f598f5c-ad31-4712-b43f-7ac75a933d07","time_created":"2024-10-01T02:32:51.153042Z"}
50222024-10-01T02:35:41.537ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
50232024-10-01T02:35:41.537ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 45.328529ms iteration = 6 status = {"errors":[],"records_set_to_done":[]}
50242024-10-01T02:35:41.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
50252024-10-01T02:35:41.540ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
50262024-10-01T02:35:41.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
50272024-10-01T02:35:41.542ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50282024-10-01T02:35:41.545ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
50292024-10-01T02:35:41.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
50302024-10-01T02:35:41.546ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
50312024-10-01T02:35:41.546ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
50322024-10-01T02:35:41.546ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
50332024-10-01T02:35:41.546ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 2a571ec0-85a3-450e-88fc-680c13ffa211, lookup_type: ById(2a571ec0-85a3-450e-88fc-680c13ffa211) } result = Ok(())
50342024-10-01T02:35:41.546ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
50352024-10-01T02:35:41.546ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
50362024-10-01T02:35:41.547ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
50372024-10-01T02:35:41.547ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
50382024-10-01T02:35:41.547ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
50392024-10-01T02:35:41.548ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 56.019948ms iteration = 6 status = {"errors":[],"garbage_collect_requested":[]}
50402024-10-01T02:35:41.549ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 58.772565ms iteration = 6 status = 0
50412024-10-01T02:35:41.549ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 57.741487ms iteration = 6 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
50422024-10-01T02:35:41.550ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50432024-10-01T02:35:41.550ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
50442024-10-01T02:35:41.551ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
50452024-10-01T02:35:41.552ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 60.166079ms iteration = 6 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
50462024-10-01T02:35:41.552ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
50472024-10-01T02:35:41.552ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
50482024-10-01T02:35:41.552ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
50492024-10-01T02:35:41.554ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
50502024-10-01T02:35:41.554ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
50512024-10-01T02:35:41.555ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 63.695377ms iteration = 16 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
50522024-10-01T02:35:41.570ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 79.480442ms iteration = 6 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
50532024-10-01T02:35:41.581ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1059 zone_address = fd00:1122:3344:101::2
50542024-10-01T02:35:41.581ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
50552024-10-01T02:35:41.581ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "05847757-2e32-43ce-b7c9-b948d6996939", "content-length": "26", "date": "Tue, 01 Oct 2024 02:35:41 GMT"} })
50562024-10-01T02:35:41.581ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1064 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
50572024-10-01T02:35:41.582ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
50582024-10-01T02:35:41.582ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
50592024-10-01T02:35:41.582ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
50602024-10-01T02:35:41.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
50612024-10-01T02:35:41.583ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
50622024-10-01T02:35:41.589ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1059 zone_address = fd00:1122:3344:101::2
50632024-10-01T02:35:41.589ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
50642024-10-01T02:35:41.589ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "5ddf878a-bb2d-4d78-b5ff-0a3e3d66a629", "content-length": "26", "date": "Tue, 01 Oct 2024 02:35:41 GMT"} })
50652024-10-01T02:35:41.589ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1064 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
50662024-10-01T02:35:41.590ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1059 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd zone_address = fd00:1122:3344:101::2
50672024-10-01T02:35:41.590ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
50682024-10-01T02:35:41.590ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c6d74d04-fd4b-4f53-b857-d06208828ae1", "content-length": "26", "date": "Tue, 01 Oct 2024 02:35:41 GMT"} })
50692024-10-01T02:35:41.590ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1064 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
50702024-10-01T02:35:41.591ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
50712024-10-01T02:35:41.591ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
50722024-10-01T02:35:41.591ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 99.612569ms iteration = 6 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
50732024-10-01T02:35:41.594ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd
50742024-10-01T02:35:41.613ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
50752024-10-01T02:35:41.613ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
50762024-10-01T02:35:41.613ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 121.77013ms iteration = 6 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
50772024-10-01T02:35:41.620ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
50782024-10-01T02:35:41.621ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
50792024-10-01T02:35:41.629ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 139.108841ms iteration = 8 status = {"physical_disks_added":0}
50802024-10-01T02:35:41.676ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
50812024-10-01T02:35:41.676ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "047e89c0-cadd-4c2b-a903-8d3031762b83", "content-length": "372", "date": "Tue, 01 Oct 2024 02:35:41 GMT"} })
50822024-10-01T02:35:41.676ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
50832024-10-01T02:35:41.677ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
50842024-10-01T02:35:41.679ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
50852024-10-01T02:35:41.679ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
50862024-10-01T02:35:41.681ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 190.719686ms iteration = 6 status = {}
50872024-10-01T02:35:41.682ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
50882024-10-01T02:35:41.682ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
50892024-10-01T02:35:41.684ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
50902024-10-01T02:35:41.685ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "a1c5974a-355f-4280-a875-6d864a53673f", "date": "Tue, 01 Oct 2024 02:35:41 GMT"} })
50912024-10-01T02:35:41.687ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 194.928507ms iteration = 7 status = {}
50922024-10-01T02:35:41.688ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
50932024-10-01T02:35:41.689ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "f00ada41-754b-4100-bca0-a2428df8f569", "content-length": "2", "date": "Tue, 01 Oct 2024 02:35:40 GMT"} })
50942024-10-01T02:35:41.690ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
50952024-10-01T02:35:41.690ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
50962024-10-01T02:35:41.692ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 202.021935ms iteration = 6 status = null
50972024-10-01T02:35:41.709ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
50982024-10-01T02:35:41.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
50992024-10-01T02:35:41.710ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51002024-10-01T02:35:41.712ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
51012024-10-01T02:35:41.712ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
51022024-10-01T02:35:41.712ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
51032024-10-01T02:35:41.714ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51042024-10-01T02:35:41.715ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
51052024-10-01T02:35:41.715ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
51062024-10-01T02:35:41.716ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
51072024-10-01T02:35:41.747ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
51082024-10-01T02:35:41.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
51092024-10-01T02:35:41.750ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 58c2bb06-eaf4-47b5-aefe-83ea06db2406, rack_id: 52547763-7759-42e1-81a9-8b833f59f5dd, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(57ef3335-befd-4872-b57f-5c2571dcca50) } rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd switch_location = Switch0
51102024-10-01T02:35:41.750ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
51112024-10-01T02:35:41.750ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
51122024-10-01T02:35:41.759ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
51132024-10-01T02:35:41.759ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "8d7dc7ac-e3b6-4bf0-bf6e-481922a064a0", "content-length": "121", "date": "Tue, 01 Oct 2024 02:35:40 GMT"} })
51142024-10-01T02:35:41.759ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
51152024-10-01T02:35:41.759ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 57ef3335-befd-4872-b57f-5c2571dcca50
51162024-10-01T02:35:41.760ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
51172024-10-01T02:35:41.760ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
51182024-10-01T02:35:41.760ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd routes = {}
51192024-10-01T02:35:41.760ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd routes = {}
51202024-10-01T02:35:41.760ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd
51212024-10-01T02:35:41.760ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
51222024-10-01T02:35:41.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
51232024-10-01T02:35:41.766ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
51242024-10-01T02:35:41.766ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "eacc92ca-5d8b-4828-b01d-8ec9b2cca8a1", "content-length": "2", "date": "Tue, 01 Oct 2024 02:35:40 GMT"} })
51252024-10-01T02:35:41.766ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
51262024-10-01T02:35:41.767ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "a1781513-9310-47e1-984d-0cf9bcfd3fe3", "content-length": "52", "date": "Tue, 01 Oct 2024 02:35:40 GMT"} })
51272024-10-01T02:35:41.767ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd switch_location = Switch0
51282024-10-01T02:35:41.767ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
51292024-10-01T02:35:41.797ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
51302024-10-01T02:35:41.867ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "b20083a7-f964-432a-b384-71a31923e701", "date": "Tue, 01 Oct 2024 02:35:41 GMT"} })
51312024-10-01T02:35:41.867ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd switch = Switch0
51322024-10-01T02:35:41.867ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
51332024-10-01T02:35:41.868ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "8ecc6b5f-6351-483e-9263-b921bf9aa0ed", "content-length": "667", "date": "Tue, 01 Oct 2024 02:35:41 GMT"} })
51342024-10-01T02:35:41.868ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
51352024-10-01T02:35:41.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
51362024-10-01T02:35:41.869ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "ccd72c59-8feb-47f2-b61f-610161f94e08", "content-length": "691", "date": "Tue, 01 Oct 2024 02:35:41 GMT"} })
51372024-10-01T02:35:41.869ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
51382024-10-01T02:35:41.869ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
51392024-10-01T02:35:41.869ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
51402024-10-01T02:35:41.871ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 380.14023ms iteration = 6 status = {}
51412024-10-01T02:35:41.872ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
51422024-10-01T02:35:41.873ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
51432024-10-01T02:35:41.876ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
51442024-10-01T02:35:41.876ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
51452024-10-01T02:35:41.878ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
51462024-10-01T02:35:41.878ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
51472024-10-01T02:35:41.885ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 394.731515ms iteration = 6 status = {}
51482024-10-01T02:35:42.269ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:60878 req_id = 4a54dfb3-0a44-45f9-a593-366605624269 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
51492024-10-01T02:35:42.270ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:60878 req_id = 4a54dfb3-0a44-45f9-a593-366605624269 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
51502024-10-01T02:35:42.273ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3364 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:60878 req_id = 4a54dfb3-0a44-45f9-a593-366605624269 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
51512024-10-01T02:35:43.342ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:49401
51522024-10-01T02:35:43.343ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:49401 req_id = 6d4ba530-b2b3-4c0b-a943-29ceea5ede62 roles = RoleSet { roles: {} } uri = /metrics/producers
51532024-10-01T02:35:43.343ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:49401 req_id = 6d4ba530-b2b3-4c0b-a943-29ceea5ede62 resource = Database result = Ok(()) uri = /metrics/producers
51542024-10-01T02:35:43.376ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 41f2943e-6041-44c9-a47a-3cf5fb012644
51552024-10-01T02:35:43.376ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:49401 req_id = 6d4ba530-b2b3-4c0b-a943-29ceea5ede62 roles = RoleSet { roles: {} } uri = /metrics/producers
51562024-10-01T02:35:43.376ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:49401 req_id = 6d4ba530-b2b3-4c0b-a943-29ceea5ede62 resource = Database result = Ok(()) uri = /metrics/producers
51572024-10-01T02:35:43.413ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 41f2943e-6041-44c9-a47a-3cf5fb012644 uri = http://[fd00:1122:3344:101::d]:12223/producers
51582024-10-01T02:35:43.414ZDEBGnexus: client response oximeter-collector = 41f2943e-6041-44c9-a47a-3cf5fb012644 result = Ok(Response { url: "http://[fd00:1122:3344:101::d]:12223/producers", status: 204, headers: {"x-request-id": "711e48db-346a-4b22-838e-a1c051502b18", "date": "Tue, 01 Oct 2024 02:35:43 GMT"} })
51592024-10-01T02:35:43.414ZINFOnexus: assigned collector to new producer collector_id = 41f2943e-6041-44c9-a47a-3cf5fb012644 file = nexus/src/app/oximeter.rs:125 producer_id = 0fb48756-e6d8-4a38-934b-d9ec5c59cf45
51602024-10-01T02:35:43.415ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 72959 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:49401 req_id = 6d4ba530-b2b3-4c0b-a943-29ceea5ede62 response_code = 201 uri = /metrics/producers
51612024-10-01T02:35:44.796ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
51622024-10-01T02:35:44.796ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
51632024-10-01T02:35:44.826ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
51642024-10-01T02:35:44.827ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:38626
51652024-10-01T02:35:44.827ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:38626 req_id = 67dae9cf-8590-42e0-98f6-83f3646470ad roles = RoleSet { roles: {} } uri = /metrics/producers
51662024-10-01T02:35:44.827ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:38626 req_id = 67dae9cf-8590-42e0-98f6-83f3646470ad resource = Database result = Ok(()) uri = /metrics/producers
51672024-10-01T02:35:44.828ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1177 local_addr = [fd00:1122:3344:101::c]:53319 method = GET remote_addr = [fd00:1122:3344:101::d]:65459 req_id = 668507a4-20b9-4a8e-b4f3-4547b8fe0dd5 response_code = 200 uri = /3dfd7033-71d8-4eb9-bb97-49dae3b5cd35
51682024-10-01T02:35:44.860ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 41f2943e-6041-44c9-a47a-3cf5fb012644
51692024-10-01T02:35:44.860ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:38626 req_id = 67dae9cf-8590-42e0-98f6-83f3646470ad roles = RoleSet { roles: {} } uri = /metrics/producers
51702024-10-01T02:35:44.860ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:38626 req_id = 67dae9cf-8590-42e0-98f6-83f3646470ad resource = Database result = Ok(()) uri = /metrics/producers
51712024-10-01T02:35:44.895ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 41f2943e-6041-44c9-a47a-3cf5fb012644 uri = http://[fd00:1122:3344:101::d]:12223/producers
51722024-10-01T02:35:44.895ZDEBGnexus: client response oximeter-collector = 41f2943e-6041-44c9-a47a-3cf5fb012644 result = Ok(Response { url: "http://[fd00:1122:3344:101::d]:12223/producers", status: 204, headers: {"x-request-id": "21fad4bc-cfba-4f04-89a1-134a801bb735", "date": "Tue, 01 Oct 2024 02:35:44 GMT"} })
51732024-10-01T02:35:44.895ZINFOnexus: assigned collector to new producer collector_id = 41f2943e-6041-44c9-a47a-3cf5fb012644 file = nexus/src/app/oximeter.rs:125 producer_id = 3dfd7033-71d8-4eb9-bb97-49dae3b5cd35
51742024-10-01T02:35:44.897ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 70054 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:38626 req_id = 67dae9cf-8590-42e0-98f6-83f3646470ad response_code = 201 uri = /metrics/producers
51752024-10-01T02:35:44.897ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "67dae9cf-8590-42e0-98f6-83f3646470ad", "content-length": "41", "date": "Tue, 01 Oct 2024 02:35:44 GMT"} })
51762024-10-01T02:35:44.898ZDEBGnexus (producer-registration-task): registered with nexus successfully
51772024-10-01T02:35:44.898ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
51782024-10-01T02:35:47.492ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:46468
51792024-10-01T02:35:47.492ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:46468 req_id = 3fda92ab-5eb3-465b-bc55-2f39adf8f3cc roles = RoleSet { roles: {} } uri = /metrics/producers
51802024-10-01T02:35:47.493ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:46468 req_id = 3fda92ab-5eb3-465b-bc55-2f39adf8f3cc resource = Database result = Ok(()) uri = /metrics/producers
51812024-10-01T02:35:47.527ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 41f2943e-6041-44c9-a47a-3cf5fb012644
51822024-10-01T02:35:47.527ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:46468 req_id = 3fda92ab-5eb3-465b-bc55-2f39adf8f3cc roles = RoleSet { roles: {} } uri = /metrics/producers
51832024-10-01T02:35:47.527ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:46468 req_id = 3fda92ab-5eb3-465b-bc55-2f39adf8f3cc resource = Database result = Ok(()) uri = /metrics/producers
51842024-10-01T02:35:47.566ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 41f2943e-6041-44c9-a47a-3cf5fb012644 uri = http://[fd00:1122:3344:101::d]:12223/producers
51852024-10-01T02:35:47.567ZDEBGnexus: client response oximeter-collector = 41f2943e-6041-44c9-a47a-3cf5fb012644 result = Ok(Response { url: "http://[fd00:1122:3344:101::d]:12223/producers", status: 204, headers: {"x-request-id": "9ac334ed-f8b0-4cbe-9504-fd4e22245880", "date": "Tue, 01 Oct 2024 02:35:47 GMT"} })
51862024-10-01T02:35:47.567ZINFOnexus: assigned collector to new producer collector_id = 41f2943e-6041-44c9-a47a-3cf5fb012644 file = nexus/src/app/oximeter.rs:125 producer_id = d6787ad6-35ff-481f-bec7-5f0d93835d2a
51872024-10-01T02:35:47.569ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 76486 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:46468 req_id = 3fda92ab-5eb3-465b-bc55-2f39adf8f3cc response_code = 201 uri = /metrics/producers
51882024-10-01T02:35:51.490ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 17 reason = Timeout
51892024-10-01T02:35:51.490ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51902024-10-01T02:35:51.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51912024-10-01T02:35:51.491ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 17 reason = Timeout
51922024-10-01T02:35:51.491ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
51932024-10-01T02:35:51.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
51942024-10-01T02:35:51.493ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51952024-10-01T02:35:51.494ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
51962024-10-01T02:35:51.494ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
51972024-10-01T02:35:51.495ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
51982024-10-01T02:35:51.495ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51992024-10-01T02:35:51.496ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52002024-10-01T02:35:51.496ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 5.294799ms iteration = 17 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
52012024-10-01T02:35:51.498ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52022024-10-01T02:35:51.498ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52032024-10-01T02:35:51.499ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52042024-10-01T02:35:51.502ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8f598f5c-ad31-4712-b43f-7ac75a933d07, lookup_type: ById(8f598f5c-ad31-4712-b43f-7ac75a933d07) } result = Ok(())
52052024-10-01T02:35:51.502ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52062024-10-01T02:35:51.502ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52072024-10-01T02:35:51.510ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 original_time_created = 2024-10-01 02:32:51.153042 UTC target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 time_created = 2024-10-01 02:32:51.153042 UTC
52082024-10-01T02:35:51.510ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.132537ms iteration = 17 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8f598f5c-ad31-4712-b43f-7ac75a933d07","time_created":"2024-10-01T02:32:51.153042Z"}
52092024-10-01T02:35:52.363ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:64501
52102024-10-01T02:35:52.363ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:64501 req_id = b07f0576-9b50-46c0-8c71-b08fb689fa61 roles = RoleSet { roles: {} } uri = /metrics/producers
52112024-10-01T02:35:52.363ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:64501 req_id = b07f0576-9b50-46c0-8c71-b08fb689fa61 resource = Database result = Ok(()) uri = /metrics/producers
52122024-10-01T02:35:52.396ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 41f2943e-6041-44c9-a47a-3cf5fb012644
52132024-10-01T02:35:52.396ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:64501 req_id = b07f0576-9b50-46c0-8c71-b08fb689fa61 roles = RoleSet { roles: {} } uri = /metrics/producers
52142024-10-01T02:35:52.396ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:64501 req_id = b07f0576-9b50-46c0-8c71-b08fb689fa61 resource = Database result = Ok(()) uri = /metrics/producers
52152024-10-01T02:35:52.403ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 41f2943e-6041-44c9-a47a-3cf5fb012644 uri = http://[fd00:1122:3344:101::d]:12223/producers
52162024-10-01T02:35:52.404ZDEBGnexus: client response oximeter-collector = 41f2943e-6041-44c9-a47a-3cf5fb012644 result = Ok(Response { url: "http://[fd00:1122:3344:101::d]:12223/producers", status: 204, headers: {"x-request-id": "927f9eec-e408-4f50-b26e-668037a662e3", "date": "Tue, 01 Oct 2024 02:35:52 GMT"} })
52172024-10-01T02:35:52.404ZINFOnexus: assigned collector to new producer collector_id = 41f2943e-6041-44c9-a47a-3cf5fb012644 file = nexus/src/app/oximeter.rs:125 producer_id = 2a571ec0-85a3-450e-88fc-680c13ffa211
52182024-10-01T02:35:52.405ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 41993 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:64501 req_id = b07f0576-9b50-46c0-8c71-b08fb689fa61 response_code = 201 uri = /metrics/producers
52192024-10-01T02:35:52.595ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:35774
52202024-10-01T02:35:52.595ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:35774 req_id = d462ffd0-4e84-4518-84e2-a3069f8e6855 roles = RoleSet { roles: {} } uri = /metrics/producers
52212024-10-01T02:35:52.596ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:35774 req_id = d462ffd0-4e84-4518-84e2-a3069f8e6855 resource = Database result = Ok(()) uri = /metrics/producers
52222024-10-01T02:35:52.628ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 41f2943e-6041-44c9-a47a-3cf5fb012644
52232024-10-01T02:35:52.628ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:35774 req_id = d462ffd0-4e84-4518-84e2-a3069f8e6855 roles = RoleSet { roles: {} } uri = /metrics/producers
52242024-10-01T02:35:52.628ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:35774 req_id = d462ffd0-4e84-4518-84e2-a3069f8e6855 resource = Database result = Ok(()) uri = /metrics/producers
52252024-10-01T02:35:52.634ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 41f2943e-6041-44c9-a47a-3cf5fb012644 uri = http://[fd00:1122:3344:101::d]:12223/producers
52262024-10-01T02:35:52.634ZDEBGnexus: client response oximeter-collector = 41f2943e-6041-44c9-a47a-3cf5fb012644 result = Ok(Response { url: "http://[fd00:1122:3344:101::d]:12223/producers", status: 204, headers: {"x-request-id": "53d7e628-b5f7-49d8-930e-01589bf8d18d", "date": "Tue, 01 Oct 2024 02:35:52 GMT"} })
52272024-10-01T02:35:52.634ZINFOnexus: assigned collector to new producer collector_id = 41f2943e-6041-44c9-a47a-3cf5fb012644 file = nexus/src/app/oximeter.rs:125 producer_id = 4fd91d04-882e-49df-98b0-1430a0f50382
52282024-10-01T02:35:52.635ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 39778 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:35774 req_id = d462ffd0-4e84-4518-84e2-a3069f8e6855 response_code = 201 uri = /metrics/producers
52292024-10-01T02:35:54.898ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1133 local_addr = [fd00:1122:3344:101::c]:53319 method = GET remote_addr = [fd00:1122:3344:101::d]:65459 req_id = a560c127-ac04-43dd-9291-943bd777e639 response_code = 200 uri = /3dfd7033-71d8-4eb9-bb97-49dae3b5cd35
52302024-10-01T02:35:55.051ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:48823
52312024-10-01T02:35:55.052ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:48823 req_id = 7f2a98aa-93e5-461b-85b9-176d4568b65a roles = RoleSet { roles: {} } uri = /metrics/producers
52322024-10-01T02:35:55.052ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:48823 req_id = 7f2a98aa-93e5-461b-85b9-176d4568b65a resource = Database result = Ok(()) uri = /metrics/producers
52332024-10-01T02:35:55.084ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 41f2943e-6041-44c9-a47a-3cf5fb012644
52342024-10-01T02:35:55.084ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:48823 req_id = 7f2a98aa-93e5-461b-85b9-176d4568b65a roles = RoleSet { roles: {} } uri = /metrics/producers
52352024-10-01T02:35:55.084ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:48823 req_id = 7f2a98aa-93e5-461b-85b9-176d4568b65a resource = Database result = Ok(()) uri = /metrics/producers
52362024-10-01T02:35:55.115ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 41f2943e-6041-44c9-a47a-3cf5fb012644 uri = http://[fd00:1122:3344:101::d]:12223/producers
52372024-10-01T02:35:55.116ZDEBGnexus: client response oximeter-collector = 41f2943e-6041-44c9-a47a-3cf5fb012644 result = Ok(Response { url: "http://[fd00:1122:3344:101::d]:12223/producers", status: 204, headers: {"x-request-id": "fbd56520-1670-4322-ab62-ab8d99999939", "date": "Tue, 01 Oct 2024 02:35:55 GMT"} })
52382024-10-01T02:35:55.116ZINFOnexus: assigned collector to new producer collector_id = 41f2943e-6041-44c9-a47a-3cf5fb012644 file = nexus/src/app/oximeter.rs:125 producer_id = 4de8ea2f-2b9b-467c-9e71-58559e244afd
52392024-10-01T02:35:55.118ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 66673 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:48823 req_id = 7f2a98aa-93e5-461b-85b9-176d4568b65a response_code = 201 uri = /metrics/producers
52402024-10-01T02:35:59.195ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:57684
52412024-10-01T02:35:59.195ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:57684 req_id = f6645ad4-5827-46ef-a14b-cefa76dfa882 roles = RoleSet { roles: {} } uri = /metrics/producers
52422024-10-01T02:35:59.195ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:57684 req_id = f6645ad4-5827-46ef-a14b-cefa76dfa882 resource = Database result = Ok(()) uri = /metrics/producers
52432024-10-01T02:35:59.228ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 41f2943e-6041-44c9-a47a-3cf5fb012644
52442024-10-01T02:35:59.228ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:57684 req_id = f6645ad4-5827-46ef-a14b-cefa76dfa882 roles = RoleSet { roles: {} } uri = /metrics/producers
52452024-10-01T02:35:59.228ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:57684 req_id = f6645ad4-5827-46ef-a14b-cefa76dfa882 resource = Database result = Ok(()) uri = /metrics/producers
52462024-10-01T02:35:59.262ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 41f2943e-6041-44c9-a47a-3cf5fb012644 uri = http://[fd00:1122:3344:101::d]:12223/producers
52472024-10-01T02:35:59.262ZDEBGnexus: client response oximeter-collector = 41f2943e-6041-44c9-a47a-3cf5fb012644 result = Ok(Response { url: "http://[fd00:1122:3344:101::d]:12223/producers", status: 204, headers: {"x-request-id": "4d6b1237-59ef-48d1-84d8-238da0d22fda", "date": "Tue, 01 Oct 2024 02:35:59 GMT"} })
52482024-10-01T02:35:59.262ZINFOnexus: assigned collector to new producer collector_id = 41f2943e-6041-44c9-a47a-3cf5fb012644 file = nexus/src/app/oximeter.rs:125 producer_id = be900b2d-36c9-44e6-addb-3422c3cbaaec
52492024-10-01T02:35:59.263ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 68506 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:57684 req_id = f6645ad4-5827-46ef-a14b-cefa76dfa882 response_code = 201 uri = /metrics/producers
52502024-10-01T02:36:01.491ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 18 reason = Timeout
52512024-10-01T02:36:01.491ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52522024-10-01T02:36:01.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52532024-10-01T02:36:01.491ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 18 reason = Timeout
52542024-10-01T02:36:01.491ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
52552024-10-01T02:36:01.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
52562024-10-01T02:36:01.493ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52572024-10-01T02:36:01.493ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
52582024-10-01T02:36:01.494ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
52592024-10-01T02:36:01.495ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
52602024-10-01T02:36:01.495ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52612024-10-01T02:36:01.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52622024-10-01T02:36:01.495ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.201721ms iteration = 18 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
52632024-10-01T02:36:01.496ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52642024-10-01T02:36:01.496ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52652024-10-01T02:36:01.498ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52662024-10-01T02:36:01.500ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8f598f5c-ad31-4712-b43f-7ac75a933d07, lookup_type: ById(8f598f5c-ad31-4712-b43f-7ac75a933d07) } result = Ok(())
52672024-10-01T02:36:01.500ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52682024-10-01T02:36:01.500ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52692024-10-01T02:36:01.506ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 original_time_created = 2024-10-01 02:32:51.153042 UTC target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 time_created = 2024-10-01 02:32:51.153042 UTC
52702024-10-01T02:36:01.506ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 15.449668ms iteration = 18 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8f598f5c-ad31-4712-b43f-7ac75a933d07","time_created":"2024-10-01T02:32:51.153042Z"}
52712024-10-01T02:36:04.898ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1209 local_addr = [fd00:1122:3344:101::c]:53319 method = GET remote_addr = [fd00:1122:3344:101::d]:65459 req_id = 8fd269a1-cb32-4f58-86e0-4f3edc21feb8 response_code = 200 uri = /3dfd7033-71d8-4eb9-bb97-49dae3b5cd35
52722024-10-01T02:36:11.490ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 6 reason = Timeout
52732024-10-01T02:36:11.490ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 5 reason = Timeout
52742024-10-01T02:36:11.490ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 5 reason = Timeout
52752024-10-01T02:36:11.490ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
52762024-10-01T02:36:11.490ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 7 reason = Timeout
52772024-10-01T02:36:11.490ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 19 reason = Timeout
52782024-10-01T02:36:11.490ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
52792024-10-01T02:36:11.490ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52802024-10-01T02:36:11.490ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 4 reason = Timeout
52812024-10-01T02:36:11.490ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 4 reason = Timeout
52822024-10-01T02:36:11.490ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 5 reason = Timeout
52832024-10-01T02:36:11.490ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-10-01 02:26:11.490880241 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
52842024-10-01T02:36:11.490ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
52852024-10-01T02:36:11.490ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
52862024-10-01T02:36:11.490ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
52872024-10-01T02:36:11.490ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
52882024-10-01T02:36:11.490ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
52892024-10-01T02:36:11.490ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 6 reason = Timeout
52902024-10-01T02:36:11.490ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 5 reason = Timeout
52912024-10-01T02:36:11.491ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
52922024-10-01T02:36:11.491ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 7 reason = Timeout
52932024-10-01T02:36:11.491ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
52942024-10-01T02:36:11.491ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 5 reason = Timeout
52952024-10-01T02:36:11.491ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 7 reason = Timeout
52962024-10-01T02:36:11.491ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
52972024-10-01T02:36:11.491ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 7 reason = Timeout
52982024-10-01T02:36:11.491ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 5 reason = Timeout
52992024-10-01T02:36:11.491ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
53002024-10-01T02:36:11.491ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07
53012024-10-01T02:36:11.491ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 7 reason = Timeout
53022024-10-01T02:36:11.491ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 7 reason = Timeout
53032024-10-01T02:36:11.491ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 13.02\u{b5}s iteration = 5 status = {"enabled":false,"target_id":"8f598f5c-ad31-4712-b43f-7ac75a933d07"}
53042024-10-01T02:36:11.491ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
53052024-10-01T02:36:11.491ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
53062024-10-01T02:36:11.491ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 3 reason = Timeout
53072024-10-01T02:36:11.491ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 7 reason = Timeout
53082024-10-01T02:36:11.491ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
53092024-10-01T02:36:11.491ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
53102024-10-01T02:36:11.491ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 9 reason = Timeout
53112024-10-01T02:36:11.491ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
53122024-10-01T02:36:11.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
53132024-10-01T02:36:11.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
53142024-10-01T02:36:11.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
53152024-10-01T02:36:11.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
53162024-10-01T02:36:11.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
53172024-10-01T02:36:11.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53182024-10-01T02:36:11.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
53192024-10-01T02:36:11.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
53202024-10-01T02:36:11.491ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 4 reason = Timeout
53212024-10-01T02:36:11.491ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 4 reason = Timeout
53222024-10-01T02:36:11.491ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
53232024-10-01T02:36:11.491ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
53242024-10-01T02:36:11.491ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
53252024-10-01T02:36:11.491ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 7 reason = Timeout
53262024-10-01T02:36:11.491ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
53272024-10-01T02:36:11.491ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 4 reason = Timeout
53282024-10-01T02:36:11.491ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 7 reason = Timeout
53292024-10-01T02:36:11.491ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
53302024-10-01T02:36:11.491ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
53312024-10-01T02:36:11.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
53322024-10-01T02:36:11.491ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 7 reason = Timeout
53332024-10-01T02:36:11.491ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
53342024-10-01T02:36:11.491ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 7 reason = Timeout
53352024-10-01T02:36:11.491ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
53362024-10-01T02:36:11.491ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 7 reason = Timeout
53372024-10-01T02:36:11.491ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
53382024-10-01T02:36:11.491ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
53392024-10-01T02:36:11.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
53402024-10-01T02:36:11.491ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 7 reason = Timeout
53412024-10-01T02:36:11.491ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 19 reason = Timeout
53422024-10-01T02:36:11.491ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
53432024-10-01T02:36:11.491ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
53442024-10-01T02:36:11.491ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 8 reason = Timeout
53452024-10-01T02:36:11.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
53462024-10-01T02:36:11.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
53472024-10-01T02:36:11.491ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
53482024-10-01T02:36:11.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
53492024-10-01T02:36:11.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
53502024-10-01T02:36:11.491ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("1af5fb25-d768-4bc6-915c-0b4c59e1f0ef.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("293e78c2-b712-4c13-b502-e2be11a76306.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("71ea2e4f-4772-4ce7-8093-48597fd7fd92.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("71ea2e4f-4772-4ce7-8093-48597fd7fd92.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1424, tv_nsec: 933484978 } })
53512024-10-01T02:36:11.491ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("0a1ed896-5078-4267-b636-10151376f015.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("eb937866-c779-4a9e-aec4-cc18302d4ce1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("eb937866-c779-4a9e-aec4-cc18302d4ce1.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1424, tv_nsec: 933494409 } })
53522024-10-01T02:36:11.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
53532024-10-01T02:36:11.491ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
53542024-10-01T02:36:11.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
53552024-10-01T02:36:11.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
53562024-10-01T02:36:11.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
53572024-10-01T02:36:11.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
53582024-10-01T02:36:11.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
53592024-10-01T02:36:11.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
53602024-10-01T02:36:11.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
53612024-10-01T02:36:11.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
53622024-10-01T02:36:11.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
53632024-10-01T02:36:11.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
53642024-10-01T02:36:11.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
53652024-10-01T02:36:11.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
53662024-10-01T02:36:11.492ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
53672024-10-01T02:36:11.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
53682024-10-01T02:36:11.492ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
53692024-10-01T02:36:11.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
53702024-10-01T02:36:11.493ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
53712024-10-01T02:36:11.494ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
53722024-10-01T02:36:11.494ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-10-01 02:26:11.490880241 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
53732024-10-01T02:36:11.494ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 3.713033ms iteration = 4 status = {"expiration":"2024-10-01T02:26:11.490880241Z","pruned":[]}
53742024-10-01T02:36:11.494ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
53752024-10-01T02:36:11.494ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 3.710852ms iteration = 5 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
53762024-10-01T02:36:11.495ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.893892ms iteration = 7 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
53772024-10-01T02:36:11.495ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
53782024-10-01T02:36:11.495ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 5.077985ms iteration = 5 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
53792024-10-01T02:36:11.496ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1424, tv_nsec: 937939513 } })
53802024-10-01T02:36:11.496ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53812024-10-01T02:36:11.497ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1051
53822024-10-01T02:36:11.497ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53832024-10-01T02:36:11.498ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53842024-10-01T02:36:11.498ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53852024-10-01T02:36:11.498ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53862024-10-01T02:36:11.500ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
53872024-10-01T02:36:11.500ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53882024-10-01T02:36:11.500ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53892024-10-01T02:36:11.501ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
53902024-10-01T02:36:11.501ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
53912024-10-01T02:36:11.501ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
53922024-10-01T02:36:11.501ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
53932024-10-01T02:36:11.501ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
53942024-10-01T02:36:11.502ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
53952024-10-01T02:36:11.502ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
53962024-10-01T02:36:11.502ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
53972024-10-01T02:36:11.502ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
53982024-10-01T02:36:11.502ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
53992024-10-01T02:36:11.502ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
54002024-10-01T02:36:11.502ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
54012024-10-01T02:36:11.502ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
54022024-10-01T02:36:11.502ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
54032024-10-01T02:36:11.503ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1424, tv_nsec: 944941670 } })
54042024-10-01T02:36:11.504ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1051
54052024-10-01T02:36:11.504ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54062024-10-01T02:36:11.505ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54072024-10-01T02:36:11.506ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
54082024-10-01T02:36:11.506ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 14.874139ms iteration = 7 status = {"errors":[],"records_set_to_done":[]}
54092024-10-01T02:36:11.506ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
54102024-10-01T02:36:11.507ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
54112024-10-01T02:36:11.507ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
54122024-10-01T02:36:11.507ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
54132024-10-01T02:36:11.507ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
54142024-10-01T02:36:11.507ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
54152024-10-01T02:36:11.507ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
54162024-10-01T02:36:11.507ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
54172024-10-01T02:36:11.507ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
54182024-10-01T02:36:11.509ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 18.373868ms iteration = 7 status = {"errors":[],"garbage_collect_requested":[]}
54192024-10-01T02:36:11.510ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
54202024-10-01T02:36:11.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
54212024-10-01T02:36:11.511ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
54222024-10-01T02:36:11.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
54232024-10-01T02:36:11.511ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
54242024-10-01T02:36:11.511ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
54252024-10-01T02:36:11.511ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
54262024-10-01T02:36:11.511ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54272024-10-01T02:36:11.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
54282024-10-01T02:36:11.512ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 21.034102ms iteration = 4 status = {"errors":[],"found_port_ok":[]}
54292024-10-01T02:36:11.512ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54302024-10-01T02:36:11.513ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54312024-10-01T02:36:11.515ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
54322024-10-01T02:36:11.515ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
54332024-10-01T02:36:11.515ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
54342024-10-01T02:36:11.515ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
54352024-10-01T02:36:11.515ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
54362024-10-01T02:36:11.515ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
54372024-10-01T02:36:11.516ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
54382024-10-01T02:36:11.516ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
54392024-10-01T02:36:11.516ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
54402024-10-01T02:36:11.518ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54412024-10-01T02:36:11.518ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54422024-10-01T02:36:11.519ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54432024-10-01T02:36:11.520ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
54442024-10-01T02:36:11.521ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
54452024-10-01T02:36:11.521ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
54462024-10-01T02:36:11.522ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
54472024-10-01T02:36:11.522ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
54482024-10-01T02:36:11.522ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
54492024-10-01T02:36:11.522ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
54502024-10-01T02:36:11.523ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
54512024-10-01T02:36:11.523ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54522024-10-01T02:36:11.524ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1424, tv_nsec: 966732986 } })
54532024-10-01T02:36:11.525ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1051 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd
54542024-10-01T02:36:11.526ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
54552024-10-01T02:36:11.528ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 37.299585ms iteration = 7 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
54562024-10-01T02:36:11.529ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
54572024-10-01T02:36:11.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
54582024-10-01T02:36:11.530ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
54592024-10-01T02:36:11.530ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
54602024-10-01T02:36:11.530ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
54612024-10-01T02:36:11.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
54622024-10-01T02:36:11.531ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 40.208174ms iteration = 19 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
54632024-10-01T02:36:11.533ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54642024-10-01T02:36:11.537ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8f598f5c-ad31-4712-b43f-7ac75a933d07, lookup_type: ById(8f598f5c-ad31-4712-b43f-7ac75a933d07) } result = Ok(())
54652024-10-01T02:36:11.537ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54662024-10-01T02:36:11.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54672024-10-01T02:36:11.542ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54682024-10-01T02:36:11.542ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54692024-10-01T02:36:11.544ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
54702024-10-01T02:36:11.544ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
54712024-10-01T02:36:11.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
54722024-10-01T02:36:11.546ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54732024-10-01T02:36:11.547ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
54742024-10-01T02:36:11.547ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
54752024-10-01T02:36:11.547ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
54762024-10-01T02:36:11.549ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
54772024-10-01T02:36:11.549ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
54782024-10-01T02:36:11.549ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
54792024-10-01T02:36:11.552ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54802024-10-01T02:36:11.554ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
54812024-10-01T02:36:11.554ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
54822024-10-01T02:36:11.554ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
54832024-10-01T02:36:11.554ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
54842024-10-01T02:36:11.554ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
54852024-10-01T02:36:11.556ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
54862024-10-01T02:36:11.556ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
54872024-10-01T02:36:11.558ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54882024-10-01T02:36:11.559ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
54892024-10-01T02:36:11.559ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 original_time_created = 2024-10-01 02:32:51.153042 UTC target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 time_created = 2024-10-01 02:32:51.153042 UTC
54902024-10-01T02:36:11.559ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 68.579289ms iteration = 19 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8f598f5c-ad31-4712-b43f-7ac75a933d07","time_created":"2024-10-01T02:32:51.153042Z"}
54912024-10-01T02:36:11.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
54922024-10-01T02:36:11.563ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
54932024-10-01T02:36:11.563ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
54942024-10-01T02:36:11.563ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54952024-10-01T02:36:11.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
54962024-10-01T02:36:11.565ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 73.574483ms iteration = 7 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
54972024-10-01T02:36:11.565ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
54982024-10-01T02:36:11.565ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
54992024-10-01T02:36:11.565ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 74.244454ms iteration = 4 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
55002024-10-01T02:36:11.566ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
55012024-10-01T02:36:11.566ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
55022024-10-01T02:36:11.566ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
55032024-10-01T02:36:11.568ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
55042024-10-01T02:36:11.568ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
55052024-10-01T02:36:11.569ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 78.607297ms iteration = 3 status = {"nsuccess":5}
55062024-10-01T02:36:11.570ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55072024-10-01T02:36:11.572ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
55082024-10-01T02:36:11.572ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
55092024-10-01T02:36:11.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
55102024-10-01T02:36:11.574ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
55112024-10-01T02:36:11.574ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
55122024-10-01T02:36:11.574ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 83.248175ms iteration = 4 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
55132024-10-01T02:36:11.576ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
55142024-10-01T02:36:11.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
55152024-10-01T02:36:11.578ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
55162024-10-01T02:36:11.578ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
55172024-10-01T02:36:11.578ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
55182024-10-01T02:36:11.578ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
55192024-10-01T02:36:11.579ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
55202024-10-01T02:36:11.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
55212024-10-01T02:36:11.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
55222024-10-01T02:36:11.580ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55232024-10-01T02:36:11.580ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55242024-10-01T02:36:11.583ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
55252024-10-01T02:36:11.583ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 92.171075ms iteration = 7 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
55262024-10-01T02:36:11.584ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 2a571ec0-85a3-450e-88fc-680c13ffa211, lookup_type: ById(2a571ec0-85a3-450e-88fc-680c13ffa211) } result = Ok(())
55272024-10-01T02:36:11.584ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
55282024-10-01T02:36:11.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
55292024-10-01T02:36:11.585ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
55302024-10-01T02:36:11.585ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
55312024-10-01T02:36:11.585ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55322024-10-01T02:36:11.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
55332024-10-01T02:36:11.586ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 95.643513ms iteration = 7 status = 0
55342024-10-01T02:36:11.588ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
55352024-10-01T02:36:11.588ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
55362024-10-01T02:36:11.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
55372024-10-01T02:36:11.589ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
55382024-10-01T02:36:11.589ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
55392024-10-01T02:36:11.589ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 98.266927ms iteration = 7 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
55402024-10-01T02:36:11.598ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
55412024-10-01T02:36:11.598ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = bc7b49a6-c38c-499f-983e-184e2c58fa04 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
55422024-10-01T02:36:11.598ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
55432024-10-01T02:36:11.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
55442024-10-01T02:36:11.600ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55452024-10-01T02:36:11.602ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
55462024-10-01T02:36:11.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
55472024-10-01T02:36:11.603ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
55482024-10-01T02:36:11.603ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
55492024-10-01T02:36:11.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
55502024-10-01T02:36:11.604ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 113.3412ms iteration = 7 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
55512024-10-01T02:36:11.605ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = bc7b49a6-c38c-499f-983e-184e2c58fa04 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
55522024-10-01T02:36:11.605ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
55532024-10-01T02:36:11.605ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-10-01 02:33:12.369795 UTC dns_group = internal generation = 1
55542024-10-01T02:36:11.605ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 114.641401ms iteration = 5 status = {"generation":1}
55552024-10-01T02:36:11.619ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
55562024-10-01T02:36:11.619ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 128.028906ms iteration = 4 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
55572024-10-01T02:36:11.620ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
55582024-10-01T02:36:11.620ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 3d6d7965-c160-4184-b04f-32fa0fb7b928 dns_zone_name = oxide.test found_so_far = 0 version = 2
55592024-10-01T02:36:11.620ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
55602024-10-01T02:36:11.620ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
55612024-10-01T02:36:11.622ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-10-01T02:33:09.142901Z, time_modified: 2024-10-01T02:33:09.142901Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, db_silo: Silo { identity: SiloIdentity { id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-10-01T02:33:13.712784Z, time_modified: 2024-10-01T02:33:13.712784Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "ca547a59343cd98ceb775f10ce9428d8003a71a149b5b7d33f10c1e7a9820bb1" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, db_silo: Silo { identity: SiloIdentity { id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-10-01T02:33:13.712784Z, time_modified: 2024-10-01T02:33:13.712784Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "ca547a59343cd98ceb775f10ce9428d8003a71a149b5b7d33f10c1e7a9820bb1" }] }) }
55622024-10-01T02:36:11.622ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 131.228659ms iteration = 5 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"21983b87-d6d0-47c6-a33c-5fe68fbed0c6","tls_certs":["ca547a59343cd98ceb775f10ce9428d8003a71a149b5b7d33f10c1e7a9820bb1"]}},"default_endpoint":{"silo_id":"21983b87-d6d0-47c6-a33c-5fe68fbed0c6","tls_certs":["ca547a59343cd98ceb775f10ce9428d8003a71a149b5b7d33f10c1e7a9820bb1"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
55632024-10-01T02:36:11.622ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55642024-10-01T02:36:11.624ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
55652024-10-01T02:36:11.624ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
55662024-10-01T02:36:11.625ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
55672024-10-01T02:36:11.625ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
55682024-10-01T02:36:11.627ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 3d6d7965-c160-4184-b04f-32fa0fb7b928 dns_zone_name = oxide.test found_so_far = 1 version = 2
55692024-10-01T02:36:11.627ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
55702024-10-01T02:36:11.627ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-10-01 02:33:13.765844 UTC dns_group = external generation = 2
55712024-10-01T02:36:11.627ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 136.143841ms iteration = 5 status = {"generation":2}
55722024-10-01T02:36:11.652ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
55732024-10-01T02:36:11.652ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
55742024-10-01T02:36:11.654ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55752024-10-01T02:36:11.656ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
55762024-10-01T02:36:11.656ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
55772024-10-01T02:36:11.656ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
55782024-10-01T02:36:11.656ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 165.678886ms iteration = 9 status = {"physical_disks_added":0}
55792024-10-01T02:36:11.676ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1059 zone_address = fd00:1122:3344:101::2
55802024-10-01T02:36:11.676ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
55812024-10-01T02:36:11.677ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "0e9defa1-3c41-4648-ba58-780aaa579dfe", "content-length": "26", "date": "Tue, 01 Oct 2024 02:36:11 GMT"} })
55822024-10-01T02:36:11.677ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1064 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
55832024-10-01T02:36:11.678ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
55842024-10-01T02:36:11.680ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1059 zone_address = fd00:1122:3344:101::2
55852024-10-01T02:36:11.680ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
55862024-10-01T02:36:11.680ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "0d314412-8f07-4b8f-bb07-fbccfd020917", "content-length": "26", "date": "Tue, 01 Oct 2024 02:36:11 GMT"} })
55872024-10-01T02:36:11.680ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1064 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
55882024-10-01T02:36:11.682ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
55892024-10-01T02:36:11.764ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
55902024-10-01T02:36:11.786ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
55912024-10-01T02:36:11.787ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "430dd041-70cd-466a-bf8f-0eb885a83f96", "content-length": "372", "date": "Tue, 01 Oct 2024 02:36:11 GMT"} })
55922024-10-01T02:36:11.787ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
55932024-10-01T02:36:11.787ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
55942024-10-01T02:36:11.788ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55952024-10-01T02:36:11.789ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
55962024-10-01T02:36:11.789ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
55972024-10-01T02:36:11.790ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
55982024-10-01T02:36:11.790ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
55992024-10-01T02:36:11.790ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
56002024-10-01T02:36:11.793ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
56012024-10-01T02:36:11.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
56022024-10-01T02:36:11.796ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
56032024-10-01T02:36:11.797ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "ff43c670-b66f-4fea-a628-fc3906555722", "date": "Tue, 01 Oct 2024 02:36:11 GMT"} })
56042024-10-01T02:36:11.798ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 306.619548ms iteration = 8 status = {}
56052024-10-01T02:36:11.838ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1059 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd zone_address = fd00:1122:3344:101::2
56062024-10-01T02:36:11.838ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
56072024-10-01T02:36:11.839ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6e940c1c-2e8e-466b-a57e-aeed6c8ef3a2", "content-length": "26", "date": "Tue, 01 Oct 2024 02:36:11 GMT"} })
56082024-10-01T02:36:11.839ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1064 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
56092024-10-01T02:36:11.840ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd
56102024-10-01T02:36:11.861ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 370.637641ms iteration = 7 status = {}
56112024-10-01T02:36:11.879ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
56122024-10-01T02:36:11.960ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
56132024-10-01T02:36:11.960ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
56142024-10-01T02:36:11.960ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "84c5611b-1fc1-4693-9393-272b8eb28fb6", "date": "Tue, 01 Oct 2024 02:36:11 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
56152024-10-01T02:36:11.960ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
56162024-10-01T02:36:11.961ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "351cf6e3-a37a-4d29-8a10-969e3c59db1e", "content-length": "691", "date": "Tue, 01 Oct 2024 02:36:11 GMT"} })
56172024-10-01T02:36:11.961ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
56182024-10-01T02:36:11.961ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
56192024-10-01T02:36:11.961ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
56202024-10-01T02:36:11.961ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "3cef1098-367b-4858-b469-0d377f837b61", "date": "Tue, 01 Oct 2024 02:36:11 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
56212024-10-01T02:36:11.961ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
56222024-10-01T02:36:11.961ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 470.950082ms iteration = 7 status = {}
56232024-10-01T02:36:11.963ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
56242024-10-01T02:36:11.963ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 472.516788ms iteration = 6 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
56252024-10-01T02:36:11.973ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
56262024-10-01T02:36:11.974ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "074921cf-4f94-442a-8ea0-93f2b44db1f1", "content-length": "2", "date": "Tue, 01 Oct 2024 02:36:11 GMT"} })
56272024-10-01T02:36:11.975ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
56282024-10-01T02:36:11.975ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
56292024-10-01T02:36:11.977ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 486.520282ms iteration = 7 status = null
56302024-10-01T02:36:12.017ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
56312024-10-01T02:36:12.018ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "2b876e7a-0965-4843-82a6-49e52dc93b75", "date": "Tue, 01 Oct 2024 02:36:11 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
56322024-10-01T02:36:12.018ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
56332024-10-01T02:36:12.021ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "4c9433f0-195e-472d-bac4-7b7c29cf5b93", "date": "Tue, 01 Oct 2024 02:36:11 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
56342024-10-01T02:36:12.021ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
56352024-10-01T02:36:12.023ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "2caff6b9-2cb6-4dd9-a8a7-590d8a5acc51", "date": "Tue, 01 Oct 2024 02:36:11 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
56362024-10-01T02:36:12.023ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
56372024-10-01T02:36:12.025ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
56382024-10-01T02:36:12.025ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 534.423755ms iteration = 6 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
56392024-10-01T02:36:12.060ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56402024-10-01T02:36:12.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56412024-10-01T02:36:12.062ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 58c2bb06-eaf4-47b5-aefe-83ea06db2406, rack_id: 52547763-7759-42e1-81a9-8b833f59f5dd, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(57ef3335-befd-4872-b57f-5c2571dcca50) } rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd switch_location = Switch0
56422024-10-01T02:36:12.062ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56432024-10-01T02:36:12.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56442024-10-01T02:36:12.074ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
56452024-10-01T02:36:12.074ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "228b3ba8-5da3-49fc-bd68-3fbc65dca5db", "content-length": "121", "date": "Tue, 01 Oct 2024 02:36:11 GMT"} })
56462024-10-01T02:36:12.074ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
56472024-10-01T02:36:12.074ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 57ef3335-befd-4872-b57f-5c2571dcca50
56482024-10-01T02:36:12.074ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
56492024-10-01T02:36:12.074ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
56502024-10-01T02:36:12.074ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd routes = {}
56512024-10-01T02:36:12.074ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd routes = {}
56522024-10-01T02:36:12.074ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd
56532024-10-01T02:36:12.074ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56542024-10-01T02:36:12.075ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56552024-10-01T02:36:12.077ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
56562024-10-01T02:36:12.077ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "cb30ae31-ed14-4a71-8069-346dc2104ad8", "content-length": "2", "date": "Tue, 01 Oct 2024 02:36:11 GMT"} })
56572024-10-01T02:36:12.077ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
56582024-10-01T02:36:12.077ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "3648f336-5146-412e-a8d0-fc587d5b8ada", "content-length": "52", "date": "Tue, 01 Oct 2024 02:36:11 GMT"} })
56592024-10-01T02:36:12.077ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd switch_location = Switch0
56602024-10-01T02:36:12.077ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
56612024-10-01T02:36:12.173ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "e44a1e58-ac36-48a8-8cf7-ff06e30c55ce", "date": "Tue, 01 Oct 2024 02:36:11 GMT"} })
56622024-10-01T02:36:12.173ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd switch = Switch0
56632024-10-01T02:36:12.173ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
56642024-10-01T02:36:12.173ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "5a351f45-c90f-4d35-8469-73b712fbb4da", "content-length": "667", "date": "Tue, 01 Oct 2024 02:36:11 GMT"} })
56652024-10-01T02:36:12.173ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56662024-10-01T02:36:12.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56672024-10-01T02:36:12.177ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56682024-10-01T02:36:12.177ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56692024-10-01T02:36:12.180ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56702024-10-01T02:36:12.181ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56712024-10-01T02:36:12.182ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56722024-10-01T02:36:12.182ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56732024-10-01T02:36:12.189ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 698.79057ms iteration = 7 status = {}
56742024-10-01T02:36:12.303ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:60878 req_id = 443c5507-fb29-4552-8666-a661e75defd2 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
56752024-10-01T02:36:12.304ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:60878 req_id = 443c5507-fb29-4552-8666-a661e75defd2 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
56762024-10-01T02:36:12.306ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3238 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:60878 req_id = 443c5507-fb29-4552-8666-a661e75defd2 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
56772024-10-01T02:36:14.898ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1202 local_addr = [fd00:1122:3344:101::c]:53319 method = GET remote_addr = [fd00:1122:3344:101::d]:65459 req_id = f769105b-c0af-4020-ac48-58c882f126c9 response_code = 200 uri = /3dfd7033-71d8-4eb9-bb97-49dae3b5cd35
56782024-10-01T02:36:21.490ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 20 reason = Timeout
56792024-10-01T02:36:21.490ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56802024-10-01T02:36:21.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56812024-10-01T02:36:21.491ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 20 reason = Timeout
56822024-10-01T02:36:21.491ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
56832024-10-01T02:36:21.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
56842024-10-01T02:36:21.492ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56852024-10-01T02:36:21.495ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
56862024-10-01T02:36:21.495ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56872024-10-01T02:36:21.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56882024-10-01T02:36:21.497ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56892024-10-01T02:36:21.497ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56902024-10-01T02:36:21.498ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56912024-10-01T02:36:21.501ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8f598f5c-ad31-4712-b43f-7ac75a933d07, lookup_type: ById(8f598f5c-ad31-4712-b43f-7ac75a933d07) } result = Ok(())
56922024-10-01T02:36:21.501ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56932024-10-01T02:36:21.501ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56942024-10-01T02:36:21.508ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 original_time_created = 2024-10-01 02:32:51.153042 UTC target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 time_created = 2024-10-01 02:32:51.153042 UTC
56952024-10-01T02:36:21.508ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 17.514763ms iteration = 20 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8f598f5c-ad31-4712-b43f-7ac75a933d07","time_created":"2024-10-01T02:32:51.153042Z"}
56962024-10-01T02:36:21.519ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
56972024-10-01T02:36:21.520ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
56982024-10-01T02:36:21.521ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.303127ms iteration = 20 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
56992024-10-01T02:36:24.899ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2136 local_addr = [fd00:1122:3344:101::c]:53319 method = GET remote_addr = [fd00:1122:3344:101::d]:65459 req_id = 3619a357-6b89-438d-97e9-a0ff5ef6e3ef response_code = 200 uri = /3dfd7033-71d8-4eb9-bb97-49dae3b5cd35
57002024-10-01T02:36:31.491ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 21 reason = Timeout
57012024-10-01T02:36:31.491ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57022024-10-01T02:36:31.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57032024-10-01T02:36:31.492ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 21 reason = Timeout
57042024-10-01T02:36:31.492ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
57052024-10-01T02:36:31.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
57062024-10-01T02:36:31.493ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57072024-10-01T02:36:31.496ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
57082024-10-01T02:36:31.496ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57092024-10-01T02:36:31.496ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57102024-10-01T02:36:31.498ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57112024-10-01T02:36:31.498ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57122024-10-01T02:36:31.500ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57132024-10-01T02:36:31.502ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8f598f5c-ad31-4712-b43f-7ac75a933d07, lookup_type: ById(8f598f5c-ad31-4712-b43f-7ac75a933d07) } result = Ok(())
57142024-10-01T02:36:31.502ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57152024-10-01T02:36:31.502ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57162024-10-01T02:36:31.511ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 original_time_created = 2024-10-01 02:32:51.153042 UTC target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 time_created = 2024-10-01 02:32:51.153042 UTC
57172024-10-01T02:36:31.511ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.362872ms iteration = 21 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8f598f5c-ad31-4712-b43f-7ac75a933d07","time_created":"2024-10-01T02:32:51.153042Z"}
57182024-10-01T02:36:31.518ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
57192024-10-01T02:36:31.518ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
57202024-10-01T02:36:31.519ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 27.487021ms iteration = 21 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
57212024-10-01T02:36:34.898ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1176 local_addr = [fd00:1122:3344:101::c]:53319 method = GET remote_addr = [fd00:1122:3344:101::d]:65459 req_id = b4e029fc-0c3f-4fca-8818-20d43e5321c9 response_code = 200 uri = /3dfd7033-71d8-4eb9-bb97-49dae3b5cd35
57222024-10-01T02:36:41.491ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 22 reason = Timeout
57232024-10-01T02:36:41.491ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 8 reason = Timeout
57242024-10-01T02:36:41.491ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57252024-10-01T02:36:41.491ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 8 reason = Timeout
57262024-10-01T02:36:41.491ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
57272024-10-01T02:36:41.491ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
57282024-10-01T02:36:41.491ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 8 reason = Timeout
57292024-10-01T02:36:41.491ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
57302024-10-01T02:36:41.491ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 10 reason = Timeout
57312024-10-01T02:36:41.491ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 8 reason = Timeout
57322024-10-01T02:36:41.491ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 8 reason = Timeout
57332024-10-01T02:36:41.491ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
57342024-10-01T02:36:41.491ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
57352024-10-01T02:36:41.491ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 8 reason = Timeout
57362024-10-01T02:36:41.491ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 8 reason = Timeout
57372024-10-01T02:36:41.491ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
57382024-10-01T02:36:41.491ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
57392024-10-01T02:36:41.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57402024-10-01T02:36:41.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
57412024-10-01T02:36:41.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
57422024-10-01T02:36:41.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
57432024-10-01T02:36:41.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
57442024-10-01T02:36:41.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
57452024-10-01T02:36:41.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
57462024-10-01T02:36:41.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
57472024-10-01T02:36:41.492ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 22 reason = Timeout
57482024-10-01T02:36:41.492ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 8 reason = Timeout
57492024-10-01T02:36:41.492ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
57502024-10-01T02:36:41.492ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
57512024-10-01T02:36:41.492ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 8 reason = Timeout
57522024-10-01T02:36:41.492ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
57532024-10-01T02:36:41.492ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 8 reason = Timeout
57542024-10-01T02:36:41.492ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
57552024-10-01T02:36:41.492ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 8 reason = Timeout
57562024-10-01T02:36:41.492ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
57572024-10-01T02:36:41.492ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
57582024-10-01T02:36:41.492ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 8 reason = Timeout
57592024-10-01T02:36:41.492ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
57602024-10-01T02:36:41.492ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 9 reason = Timeout
57612024-10-01T02:36:41.492ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
57622024-10-01T02:36:41.492ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 8 reason = Timeout
57632024-10-01T02:36:41.492ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
57642024-10-01T02:36:41.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
57652024-10-01T02:36:41.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
57662024-10-01T02:36:41.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
57672024-10-01T02:36:41.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
57682024-10-01T02:36:41.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
57692024-10-01T02:36:41.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
57702024-10-01T02:36:41.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
57712024-10-01T02:36:41.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
57722024-10-01T02:36:41.494ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57732024-10-01T02:36:41.494ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57742024-10-01T02:36:41.495ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57752024-10-01T02:36:41.496ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.445105ms iteration = 8 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
57762024-10-01T02:36:41.497ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1454, tv_nsec: 938864829 } })
57772024-10-01T02:36:41.497ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1051
57782024-10-01T02:36:41.498ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
57792024-10-01T02:36:41.498ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57802024-10-01T02:36:41.498ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57812024-10-01T02:36:41.498ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
57822024-10-01T02:36:41.498ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
57832024-10-01T02:36:41.498ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
57842024-10-01T02:36:41.498ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
57852024-10-01T02:36:41.498ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
57862024-10-01T02:36:41.498ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
57872024-10-01T02:36:41.500ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57882024-10-01T02:36:41.503ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
57892024-10-01T02:36:41.503ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
57902024-10-01T02:36:41.503ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
57912024-10-01T02:36:41.503ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1454, tv_nsec: 945291146 } })
57922024-10-01T02:36:41.504ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1051
57932024-10-01T02:36:41.506ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57942024-10-01T02:36:41.506ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
57952024-10-01T02:36:41.506ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
57962024-10-01T02:36:41.506ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
57972024-10-01T02:36:41.507ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
57982024-10-01T02:36:41.508ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
57992024-10-01T02:36:41.508ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
58002024-10-01T02:36:41.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
58012024-10-01T02:36:41.513ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
58022024-10-01T02:36:41.514ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1454, tv_nsec: 955496047 } })
58032024-10-01T02:36:41.514ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
58042024-10-01T02:36:41.514ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58052024-10-01T02:36:41.514ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58062024-10-01T02:36:41.516ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1051 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd
58072024-10-01T02:36:41.518ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
58082024-10-01T02:36:41.518ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
58092024-10-01T02:36:41.527ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
58102024-10-01T02:36:41.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
58112024-10-01T02:36:41.542ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 49.715053ms iteration = 8 status = {"errors":[],"records_set_to_done":[]}
58122024-10-01T02:36:41.545ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
58132024-10-01T02:36:41.546ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
58142024-10-01T02:36:41.548ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 57.041346ms iteration = 8 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
58152024-10-01T02:36:41.549ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 56.212552ms iteration = 8 status = {"errors":[],"garbage_collect_requested":[]}
58162024-10-01T02:36:41.549ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58172024-10-01T02:36:41.551ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
58182024-10-01T02:36:41.551ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
58192024-10-01T02:36:41.552ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
58202024-10-01T02:36:41.552ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
58212024-10-01T02:36:41.552ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
58222024-10-01T02:36:41.555ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1059 zone_address = fd00:1122:3344:101::2
58232024-10-01T02:36:41.555ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
58242024-10-01T02:36:41.555ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d7fbb07f-39bf-4a12-9148-fdce9727ca3c", "content-length": "26", "date": "Tue, 01 Oct 2024 02:36:41 GMT"} })
58252024-10-01T02:36:41.555ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1064 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
58262024-10-01T02:36:41.557ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
58272024-10-01T02:36:41.557ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58282024-10-01T02:36:41.557ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1059 zone_address = fd00:1122:3344:101::2
58292024-10-01T02:36:41.557ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
58302024-10-01T02:36:41.558ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
58312024-10-01T02:36:41.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
58322024-10-01T02:36:41.558ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f6f12376-bc5b-4a75-ab42-94e0d7c8aee6", "content-length": "26", "date": "Tue, 01 Oct 2024 02:36:41 GMT"} })
58332024-10-01T02:36:41.558ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1064 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
58342024-10-01T02:36:41.559ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
58352024-10-01T02:36:41.560ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
58362024-10-01T02:36:41.561ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
58372024-10-01T02:36:41.561ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
58382024-10-01T02:36:41.561ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
58392024-10-01T02:36:41.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
58402024-10-01T02:36:41.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
58412024-10-01T02:36:41.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
58422024-10-01T02:36:41.563ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58432024-10-01T02:36:41.564ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
58442024-10-01T02:36:41.565ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58452024-10-01T02:36:41.565ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
58462024-10-01T02:36:41.567ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8f598f5c-ad31-4712-b43f-7ac75a933d07, lookup_type: ById(8f598f5c-ad31-4712-b43f-7ac75a933d07) } result = Ok(())
58472024-10-01T02:36:41.567ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58482024-10-01T02:36:41.567ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58492024-10-01T02:36:41.568ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
58502024-10-01T02:36:41.568ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
58512024-10-01T02:36:41.568ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
58522024-10-01T02:36:41.569ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
58532024-10-01T02:36:41.569ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
58542024-10-01T02:36:41.569ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
58552024-10-01T02:36:41.569ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
58562024-10-01T02:36:41.570ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58572024-10-01T02:36:41.574ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 2a571ec0-85a3-450e-88fc-680c13ffa211, lookup_type: ById(2a571ec0-85a3-450e-88fc-680c13ffa211) } result = Ok(())
58582024-10-01T02:36:41.574ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
58592024-10-01T02:36:41.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
58602024-10-01T02:36:41.576ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 85.30067ms iteration = 8 status = 0
58612024-10-01T02:36:41.577ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1059 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd zone_address = fd00:1122:3344:101::2
58622024-10-01T02:36:41.577ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
58632024-10-01T02:36:41.577ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "cb8f1ba4-f170-42a6-9a4d-919b3b35c612", "content-length": "26", "date": "Tue, 01 Oct 2024 02:36:41 GMT"} })
58642024-10-01T02:36:41.577ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1064 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
58652024-10-01T02:36:41.579ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd
58662024-10-01T02:36:41.580ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 original_time_created = 2024-10-01 02:32:51.153042 UTC target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 time_created = 2024-10-01 02:32:51.153042 UTC
58672024-10-01T02:36:41.580ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 88.90747ms iteration = 22 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8f598f5c-ad31-4712-b43f-7ac75a933d07","time_created":"2024-10-01T02:32:51.153042Z"}
58682024-10-01T02:36:41.597ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 104.904228ms iteration = 8 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
58692024-10-01T02:36:41.600ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
58702024-10-01T02:36:41.600ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 107.937109ms iteration = 8 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
58712024-10-01T02:36:41.602ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
58722024-10-01T02:36:41.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
58732024-10-01T02:36:41.605ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 112.620217ms iteration = 22 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
58742024-10-01T02:36:41.616ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
58752024-10-01T02:36:41.616ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
58762024-10-01T02:36:41.616ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 123.663953ms iteration = 8 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
58772024-10-01T02:36:41.641ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 148.346926ms iteration = 8 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
58782024-10-01T02:36:41.646ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
58792024-10-01T02:36:41.646ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "6a17d910-19f4-4821-8c20-7c29c8762e05", "content-length": "2", "date": "Tue, 01 Oct 2024 02:36:40 GMT"} })
58802024-10-01T02:36:41.647ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
58812024-10-01T02:36:41.647ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 155.548766ms iteration = 8 status = {}
58822024-10-01T02:36:41.647ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
58832024-10-01T02:36:41.648ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
58842024-10-01T02:36:41.649ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
58852024-10-01T02:36:41.651ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 159.398271ms iteration = 8 status = null
58862024-10-01T02:36:41.678ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58872024-10-01T02:36:41.680ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
58882024-10-01T02:36:41.680ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
58892024-10-01T02:36:41.681ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
58902024-10-01T02:36:41.681ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 189.665618ms iteration = 10 status = {"physical_disks_added":0}
58912024-10-01T02:36:41.686ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
58922024-10-01T02:36:41.687ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "4f35ad07-0372-46c6-8e4b-1f66ffc179ec", "content-length": "372", "date": "Tue, 01 Oct 2024 02:36:41 GMT"} })
58932024-10-01T02:36:41.687ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
58942024-10-01T02:36:41.688ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
58952024-10-01T02:36:41.690ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
58962024-10-01T02:36:41.690ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
58972024-10-01T02:36:41.693ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
58982024-10-01T02:36:41.694ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
58992024-10-01T02:36:41.697ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
59002024-10-01T02:36:41.698ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "3bcd1b89-3126-46d4-9100-8f8d65e35bb7", "date": "Tue, 01 Oct 2024 02:36:41 GMT"} })
59012024-10-01T02:36:41.700ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 207.561888ms iteration = 9 status = {}
59022024-10-01T02:36:41.712ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59032024-10-01T02:36:41.714ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
59042024-10-01T02:36:41.714ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
59052024-10-01T02:36:41.714ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
59062024-10-01T02:36:41.730ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
59072024-10-01T02:36:41.731ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
59082024-10-01T02:36:41.732ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 58c2bb06-eaf4-47b5-aefe-83ea06db2406, rack_id: 52547763-7759-42e1-81a9-8b833f59f5dd, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(57ef3335-befd-4872-b57f-5c2571dcca50) } rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd switch_location = Switch0
59092024-10-01T02:36:41.732ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
59102024-10-01T02:36:41.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
59112024-10-01T02:36:41.743ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
59122024-10-01T02:36:41.743ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "a384676e-bf42-414d-93b0-e8f2539511b1", "content-length": "121", "date": "Tue, 01 Oct 2024 02:36:40 GMT"} })
59132024-10-01T02:36:41.743ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
59142024-10-01T02:36:41.744ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 57ef3335-befd-4872-b57f-5c2571dcca50
59152024-10-01T02:36:41.744ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
59162024-10-01T02:36:41.744ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
59172024-10-01T02:36:41.744ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd routes = {}
59182024-10-01T02:36:41.744ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd routes = {}
59192024-10-01T02:36:41.744ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd
59202024-10-01T02:36:41.744ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
59212024-10-01T02:36:41.744ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
59222024-10-01T02:36:41.750ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
59232024-10-01T02:36:41.752ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "1f33ebb4-5612-4eaf-898c-92867e9d3b74", "content-length": "2", "date": "Tue, 01 Oct 2024 02:36:40 GMT"} })
59242024-10-01T02:36:41.752ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
59252024-10-01T02:36:41.752ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "6ad281ac-c547-4758-a29c-f31ba6bc843c", "content-length": "52", "date": "Tue, 01 Oct 2024 02:36:40 GMT"} })
59262024-10-01T02:36:41.752ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd switch_location = Switch0
59272024-10-01T02:36:41.752ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
59282024-10-01T02:36:41.828ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
59292024-10-01T02:36:41.882ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "9a4358a5-3d70-48b3-bade-b2835927d7f3", "date": "Tue, 01 Oct 2024 02:36:41 GMT"} })
59302024-10-01T02:36:41.882ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd switch = Switch0
59312024-10-01T02:36:41.882ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
59322024-10-01T02:36:41.882ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "7876993f-0b60-4d58-994e-8796cda80fb8", "content-length": "667", "date": "Tue, 01 Oct 2024 02:36:41 GMT"} })
59332024-10-01T02:36:41.882ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
59342024-10-01T02:36:41.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
59352024-10-01T02:36:41.883ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "fc1ff5af-6666-4a34-9731-2c9070921557", "content-length": "691", "date": "Tue, 01 Oct 2024 02:36:41 GMT"} })
59362024-10-01T02:36:41.883ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
59372024-10-01T02:36:41.883ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
59382024-10-01T02:36:41.883ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
59392024-10-01T02:36:41.884ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 393.103047ms iteration = 8 status = {}
59402024-10-01T02:36:41.888ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
59412024-10-01T02:36:41.888ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
59422024-10-01T02:36:41.892ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
59432024-10-01T02:36:41.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
59442024-10-01T02:36:41.895ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
59452024-10-01T02:36:41.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
59462024-10-01T02:36:41.904ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 413.310676ms iteration = 8 status = {}
59472024-10-01T02:36:42.340ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:60878 req_id = c7d23e66-c1b2-4205-aa45-de2347e6b145 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
59482024-10-01T02:36:42.340ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:60878 req_id = c7d23e66-c1b2-4205-aa45-de2347e6b145 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
59492024-10-01T02:36:42.343ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3121 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:60878 req_id = c7d23e66-c1b2-4205-aa45-de2347e6b145 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
59502024-10-01T02:36:44.899ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1191 local_addr = [fd00:1122:3344:101::c]:53319 method = GET remote_addr = [fd00:1122:3344:101::d]:65459 req_id = a56a7cc3-8aec-4b2e-9030-a60847f1fef0 response_code = 200 uri = /3dfd7033-71d8-4eb9-bb97-49dae3b5cd35
59512024-10-01T02:36:51.491ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 23 reason = Timeout
59522024-10-01T02:36:51.491ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59532024-10-01T02:36:51.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59542024-10-01T02:36:51.492ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 23 reason = Timeout
59552024-10-01T02:36:51.492ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
59562024-10-01T02:36:51.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
59572024-10-01T02:36:51.521ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
59582024-10-01T02:36:51.521ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
59592024-10-01T02:36:51.522ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.937948ms iteration = 23 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
59602024-10-01T02:36:51.524ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59612024-10-01T02:36:51.527ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
59622024-10-01T02:36:51.527ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59632024-10-01T02:36:51.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59642024-10-01T02:36:51.529ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59652024-10-01T02:36:51.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59662024-10-01T02:36:51.531ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59672024-10-01T02:36:51.534ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8f598f5c-ad31-4712-b43f-7ac75a933d07, lookup_type: ById(8f598f5c-ad31-4712-b43f-7ac75a933d07) } result = Ok(())
59682024-10-01T02:36:51.534ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59692024-10-01T02:36:51.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59702024-10-01T02:36:51.542ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 original_time_created = 2024-10-01 02:32:51.153042 UTC target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 time_created = 2024-10-01 02:32:51.153042 UTC
59712024-10-01T02:36:51.542ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 51.006974ms iteration = 23 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8f598f5c-ad31-4712-b43f-7ac75a933d07","time_created":"2024-10-01T02:32:51.153042Z"}
59722024-10-01T02:36:54.899ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1344 local_addr = [fd00:1122:3344:101::c]:53319 method = GET remote_addr = [fd00:1122:3344:101::d]:65459 req_id = c5a89d22-3d00-4e1f-8d43-da4d276e4fc8 response_code = 200 uri = /3dfd7033-71d8-4eb9-bb97-49dae3b5cd35
59732024-10-01T02:37:01.491ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 24 reason = Timeout
59742024-10-01T02:37:01.491ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59752024-10-01T02:37:01.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59762024-10-01T02:37:01.492ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 24 reason = Timeout
59772024-10-01T02:37:01.492ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
59782024-10-01T02:37:01.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
59792024-10-01T02:37:01.493ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59802024-10-01T02:37:01.493ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
59812024-10-01T02:37:01.494ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
59822024-10-01T02:37:01.495ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
59832024-10-01T02:37:01.495ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59842024-10-01T02:37:01.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59852024-10-01T02:37:01.497ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59862024-10-01T02:37:01.497ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59872024-10-01T02:37:01.499ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59882024-10-01T02:37:01.501ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8f598f5c-ad31-4712-b43f-7ac75a933d07, lookup_type: ById(8f598f5c-ad31-4712-b43f-7ac75a933d07) } result = Ok(())
59892024-10-01T02:37:01.501ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59902024-10-01T02:37:01.501ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59912024-10-01T02:37:01.509ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 original_time_created = 2024-10-01 02:32:51.153042 UTC target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 time_created = 2024-10-01 02:32:51.153042 UTC
59922024-10-01T02:37:01.509ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.412149ms iteration = 24 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8f598f5c-ad31-4712-b43f-7ac75a933d07","time_created":"2024-10-01T02:32:51.153042Z"}
59932024-10-01T02:37:01.526ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 34.185523ms iteration = 24 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
59942024-10-01T02:37:04.898ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1242 local_addr = [fd00:1122:3344:101::c]:53319 method = GET remote_addr = [fd00:1122:3344:101::d]:65459 req_id = 3563b41d-b64c-4215-9164-033388eb6abb response_code = 200 uri = /3dfd7033-71d8-4eb9-bb97-49dae3b5cd35
59952024-10-01T02:37:11.491ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 7 reason = Timeout
59962024-10-01T02:37:11.491ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 6 reason = Timeout
59972024-10-01T02:37:11.491ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 7 reason = Timeout
59982024-10-01T02:37:11.491ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 6 reason = Timeout
59992024-10-01T02:37:11.491ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
60002024-10-01T02:37:11.491ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 9 reason = Timeout
60012024-10-01T02:37:11.491ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
60022024-10-01T02:37:11.491ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
60032024-10-01T02:37:11.491ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 25 reason = Timeout
60042024-10-01T02:37:11.491ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60052024-10-01T02:37:11.491ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 9 reason = Timeout
60062024-10-01T02:37:11.491ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 5 reason = Timeout
60072024-10-01T02:37:11.491ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 6 reason = Timeout
60082024-10-01T02:37:11.491ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
60092024-10-01T02:37:11.491ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
60102024-10-01T02:37:11.491ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 6 reason = Timeout
60112024-10-01T02:37:11.491ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 6 reason = Timeout
60122024-10-01T02:37:11.491ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
60132024-10-01T02:37:11.491ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
60142024-10-01T02:37:11.491ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 5 reason = Timeout
60152024-10-01T02:37:11.491ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
60162024-10-01T02:37:11.491ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-10-01 02:27:11.491694715 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
60172024-10-01T02:37:11.491ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
60182024-10-01T02:37:11.491ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 6 reason = Timeout
60192024-10-01T02:37:11.491ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07
60202024-10-01T02:37:11.491ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 9 reason = Timeout
60212024-10-01T02:37:11.491ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 14.31\u{b5}s iteration = 6 status = {"enabled":false,"target_id":"8f598f5c-ad31-4712-b43f-7ac75a933d07"}
60222024-10-01T02:37:11.491ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 9 reason = Timeout
60232024-10-01T02:37:11.491ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
60242024-10-01T02:37:11.491ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 9 reason = Timeout
60252024-10-01T02:37:11.491ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
60262024-10-01T02:37:11.491ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 9 reason = Timeout
60272024-10-01T02:37:11.491ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
60282024-10-01T02:37:11.491ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
60292024-10-01T02:37:11.491ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 9 reason = Timeout
60302024-10-01T02:37:11.491ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 11 reason = Timeout
60312024-10-01T02:37:11.491ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60322024-10-01T02:37:11.491ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
60332024-10-01T02:37:11.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
60342024-10-01T02:37:11.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
60352024-10-01T02:37:11.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
60362024-10-01T02:37:11.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60372024-10-01T02:37:11.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
60382024-10-01T02:37:11.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
60392024-10-01T02:37:11.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
60402024-10-01T02:37:11.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
60412024-10-01T02:37:11.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60422024-10-01T02:37:11.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
60432024-10-01T02:37:11.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
60442024-10-01T02:37:11.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
60452024-10-01T02:37:11.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
60462024-10-01T02:37:11.492ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 25 reason = Timeout
60472024-10-01T02:37:11.492ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 9 reason = Timeout
60482024-10-01T02:37:11.492ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 9 reason = Timeout
60492024-10-01T02:37:11.492ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
60502024-10-01T02:37:11.492ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
60512024-10-01T02:37:11.492ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 9 reason = Timeout
60522024-10-01T02:37:11.492ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
60532024-10-01T02:37:11.492ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
60542024-10-01T02:37:11.492ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 5 reason = Timeout
60552024-10-01T02:37:11.492ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
60562024-10-01T02:37:11.492ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 9 reason = Timeout
60572024-10-01T02:37:11.492ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
60582024-10-01T02:37:11.492ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
60592024-10-01T02:37:11.492ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 5 reason = Timeout
60602024-10-01T02:37:11.492ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
60612024-10-01T02:37:11.492ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 10 reason = Timeout
60622024-10-01T02:37:11.492ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 9 reason = Timeout
60632024-10-01T02:37:11.492ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
60642024-10-01T02:37:11.492ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
60652024-10-01T02:37:11.492ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 9 reason = Timeout
60662024-10-01T02:37:11.492ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
60672024-10-01T02:37:11.492ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 5 reason = Timeout
60682024-10-01T02:37:11.492ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
60692024-10-01T02:37:11.492ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("1af5fb25-d768-4bc6-915c-0b4c59e1f0ef.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("293e78c2-b712-4c13-b502-e2be11a76306.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("71ea2e4f-4772-4ce7-8093-48597fd7fd92.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("71ea2e4f-4772-4ce7-8093-48597fd7fd92.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1484, tv_nsec: 933739323 } })
60702024-10-01T02:37:11.492ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("0a1ed896-5078-4267-b636-10151376f015.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("eb937866-c779-4a9e-aec4-cc18302d4ce1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("eb937866-c779-4a9e-aec4-cc18302d4ce1.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1484, tv_nsec: 933791584 } })
60712024-10-01T02:37:11.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
60722024-10-01T02:37:11.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
60732024-10-01T02:37:11.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
60742024-10-01T02:37:11.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
60752024-10-01T02:37:11.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
60762024-10-01T02:37:11.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
60772024-10-01T02:37:11.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
60782024-10-01T02:37:11.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
60792024-10-01T02:37:11.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
60802024-10-01T02:37:11.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
60812024-10-01T02:37:11.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
60822024-10-01T02:37:11.493ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
60832024-10-01T02:37:11.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
60842024-10-01T02:37:11.496ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60852024-10-01T02:37:11.496ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
60862024-10-01T02:37:11.496ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 5.122266ms iteration = 6 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
60872024-10-01T02:37:11.496ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
60882024-10-01T02:37:11.496ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 5.274858ms iteration = 6 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
60892024-10-01T02:37:11.498ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 6.490879ms iteration = 9 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
60902024-10-01T02:37:11.498ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60912024-10-01T02:37:11.499ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
60922024-10-01T02:37:11.499ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
60932024-10-01T02:37:11.500ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
60942024-10-01T02:37:11.500ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1484, tv_nsec: 941418342 } })
60952024-10-01T02:37:11.500ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1051
60962024-10-01T02:37:11.502ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
60972024-10-01T02:37:11.502ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60982024-10-01T02:37:11.503ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60992024-10-01T02:37:11.503ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-10-01 02:27:11.491694715 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
61002024-10-01T02:37:11.503ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 11.506023ms iteration = 5 status = {"expiration":"2024-10-01T02:27:11.491694715Z","pruned":[]}
61012024-10-01T02:37:11.503ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
61022024-10-01T02:37:11.504ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
61032024-10-01T02:37:11.505ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61042024-10-01T02:37:11.505ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61052024-10-01T02:37:11.508ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
61062024-10-01T02:37:11.508ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
61072024-10-01T02:37:11.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
61082024-10-01T02:37:11.508ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61092024-10-01T02:37:11.509ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
61102024-10-01T02:37:11.509ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
61112024-10-01T02:37:11.510ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
61122024-10-01T02:37:11.511ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1484, tv_nsec: 952828393 } })
61132024-10-01T02:37:11.511ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
61142024-10-01T02:37:11.511ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
61152024-10-01T02:37:11.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
61162024-10-01T02:37:11.512ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1051
61172024-10-01T02:37:11.514ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 22.507697ms iteration = 5 status = {"errors":[],"found_port_ok":[]}
61182024-10-01T02:37:11.518ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61192024-10-01T02:37:11.521ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
61202024-10-01T02:37:11.521ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
61212024-10-01T02:37:11.521ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
61222024-10-01T02:37:11.521ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
61232024-10-01T02:37:11.521ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
61242024-10-01T02:37:11.526ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61252024-10-01T02:37:11.526ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61262024-10-01T02:37:11.530ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
61272024-10-01T02:37:11.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
61282024-10-01T02:37:11.532ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1484, tv_nsec: 973349087 } })
61292024-10-01T02:37:11.532ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
61302024-10-01T02:37:11.532ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
61312024-10-01T02:37:11.532ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 39.722856ms iteration = 5 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
61322024-10-01T02:37:11.532ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1051 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd
61332024-10-01T02:37:11.532ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61342024-10-01T02:37:11.533ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
61352024-10-01T02:37:11.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
61362024-10-01T02:37:11.536ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
61372024-10-01T02:37:11.536ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
61382024-10-01T02:37:11.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
61392024-10-01T02:37:11.538ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61402024-10-01T02:37:11.539ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61412024-10-01T02:37:11.542ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
61422024-10-01T02:37:11.542ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
61432024-10-01T02:37:11.543ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8f598f5c-ad31-4712-b43f-7ac75a933d07, lookup_type: ById(8f598f5c-ad31-4712-b43f-7ac75a933d07) } result = Ok(())
61442024-10-01T02:37:11.543ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61452024-10-01T02:37:11.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
61462024-10-01T02:37:11.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61472024-10-01T02:37:11.553ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
61482024-10-01T02:37:11.553ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
61492024-10-01T02:37:11.556ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61502024-10-01T02:37:11.559ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
61512024-10-01T02:37:11.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
61522024-10-01T02:37:11.560ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
61532024-10-01T02:37:11.560ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
61542024-10-01T02:37:11.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
61552024-10-01T02:37:11.562ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 69.577726ms iteration = 9 status = {"errors":[],"garbage_collect_requested":[]}
61562024-10-01T02:37:11.563ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61572024-10-01T02:37:11.566ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
61582024-10-01T02:37:11.566ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
61592024-10-01T02:37:11.566ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
61602024-10-01T02:37:11.568ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
61612024-10-01T02:37:11.568ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
61622024-10-01T02:37:11.568ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
61632024-10-01T02:37:11.568ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
61642024-10-01T02:37:11.570ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61652024-10-01T02:37:11.571ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 78.686559ms iteration = 9 status = {"errors":[],"records_set_to_done":[]}
61662024-10-01T02:37:11.571ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
61672024-10-01T02:37:11.571ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
61682024-10-01T02:37:11.573ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
61692024-10-01T02:37:11.573ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
61702024-10-01T02:37:11.574ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61712024-10-01T02:37:11.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
61722024-10-01T02:37:11.577ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
61732024-10-01T02:37:11.579ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
61742024-10-01T02:37:11.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
61752024-10-01T02:37:11.579ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 87.312713ms iteration = 9 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
61762024-10-01T02:37:11.581ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
61772024-10-01T02:37:11.581ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
61782024-10-01T02:37:11.581ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 90.12938ms iteration = 5 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
61792024-10-01T02:37:11.603ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
61802024-10-01T02:37:11.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
61812024-10-01T02:37:11.603ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
61822024-10-01T02:37:11.603ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
61832024-10-01T02:37:11.603ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
61842024-10-01T02:37:11.603ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
61852024-10-01T02:37:11.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
61862024-10-01T02:37:11.607ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
61872024-10-01T02:37:11.607ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
61882024-10-01T02:37:11.607ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
61892024-10-01T02:37:11.607ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
61902024-10-01T02:37:11.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
61912024-10-01T02:37:11.626ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
61922024-10-01T02:37:11.650ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
61932024-10-01T02:37:11.661ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 169.399708ms iteration = 11 status = {"physical_disks_added":0}
61942024-10-01T02:37:11.739ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
61952024-10-01T02:37:11.739ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "1c6d2afb-d92d-41bb-8824-184dc40caacc", "content-length": "372", "date": "Tue, 01 Oct 2024 02:37:11 GMT"} })
61962024-10-01T02:37:11.739ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
61972024-10-01T02:37:11.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
61982024-10-01T02:37:11.741ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
61992024-10-01T02:37:11.742ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
62002024-10-01T02:37:11.743ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
62012024-10-01T02:37:11.744ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
62022024-10-01T02:37:11.745ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
62032024-10-01T02:37:11.745ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
62042024-10-01T02:37:11.747ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
62052024-10-01T02:37:11.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
62062024-10-01T02:37:11.750ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 original_time_created = 2024-10-01 02:32:51.153042 UTC target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 time_created = 2024-10-01 02:32:51.153042 UTC
62072024-10-01T02:37:11.750ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 258.510662ms iteration = 25 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8f598f5c-ad31-4712-b43f-7ac75a933d07","time_created":"2024-10-01T02:32:51.153042Z"}
62082024-10-01T02:37:11.751ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
62092024-10-01T02:37:11.751ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
62102024-10-01T02:37:11.754ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
62112024-10-01T02:37:11.755ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "1e059471-b7bb-435e-8768-892a0794a208", "date": "Tue, 01 Oct 2024 02:37:11 GMT"} })
62122024-10-01T02:37:11.758ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 266.019448ms iteration = 10 status = {}
62132024-10-01T02:37:11.774ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62142024-10-01T02:37:11.775ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 283.891517ms iteration = 9 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
62152024-10-01T02:37:11.778ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
62162024-10-01T02:37:11.778ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
62172024-10-01T02:37:11.778ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
62182024-10-01T02:37:11.782ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62192024-10-01T02:37:11.784ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62202024-10-01T02:37:11.785ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 293.117492ms iteration = 9 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
62212024-10-01T02:37:11.786ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
62222024-10-01T02:37:11.786ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 293.700961ms iteration = 9 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
62232024-10-01T02:37:11.786ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
62242024-10-01T02:37:11.786ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
62252024-10-01T02:37:11.786ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
62262024-10-01T02:37:11.788ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 2a571ec0-85a3-450e-88fc-680c13ffa211, lookup_type: ById(2a571ec0-85a3-450e-88fc-680c13ffa211) } result = Ok(())
62272024-10-01T02:37:11.788ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
62282024-10-01T02:37:11.788ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
62292024-10-01T02:37:11.790ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 297.900212ms iteration = 25 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
62302024-10-01T02:37:11.790ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62312024-10-01T02:37:11.792ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 300.244572ms iteration = 9 status = 0
62322024-10-01T02:37:11.793ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
62332024-10-01T02:37:11.793ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
62342024-10-01T02:37:11.793ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
62352024-10-01T02:37:11.793ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
62362024-10-01T02:37:11.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
62372024-10-01T02:37:11.794ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
62382024-10-01T02:37:11.794ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
62392024-10-01T02:37:11.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
62402024-10-01T02:37:11.822ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
62412024-10-01T02:37:11.822ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = bc7b49a6-c38c-499f-983e-184e2c58fa04 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
62422024-10-01T02:37:11.822ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
62432024-10-01T02:37:11.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
62442024-10-01T02:37:11.824ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
62452024-10-01T02:37:11.824ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
62462024-10-01T02:37:11.824ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 331.955483ms iteration = 9 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
62472024-10-01T02:37:11.825ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62482024-10-01T02:37:11.825ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
62492024-10-01T02:37:11.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
62502024-10-01T02:37:11.827ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
62512024-10-01T02:37:11.827ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
62522024-10-01T02:37:11.828ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
62532024-10-01T02:37:11.829ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
62542024-10-01T02:37:11.829ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 3d6d7965-c160-4184-b04f-32fa0fb7b928 dns_zone_name = oxide.test found_so_far = 0 version = 2
62552024-10-01T02:37:11.829ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
62562024-10-01T02:37:11.829ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
62572024-10-01T02:37:11.830ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = bc7b49a6-c38c-499f-983e-184e2c58fa04 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
62582024-10-01T02:37:11.830ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
62592024-10-01T02:37:11.830ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-10-01 02:33:12.369795 UTC dns_group = internal generation = 1
62602024-10-01T02:37:11.830ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 338.775388ms iteration = 6 status = {"generation":1}
62612024-10-01T02:37:11.831ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
62622024-10-01T02:37:11.832ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "6e831ea2-c373-4e34-9cba-4a8a5f6813d1", "date": "Tue, 01 Oct 2024 02:37:11 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
62632024-10-01T02:37:11.832ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
62642024-10-01T02:37:11.834ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "943e7270-3d5a-4d22-abd3-10116b859fe6", "date": "Tue, 01 Oct 2024 02:37:11 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
62652024-10-01T02:37:11.834ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
62662024-10-01T02:37:11.837ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
62672024-10-01T02:37:11.837ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 345.49156ms iteration = 7 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
62682024-10-01T02:37:11.841ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
62692024-10-01T02:37:11.842ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
62702024-10-01T02:37:11.843ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62712024-10-01T02:37:11.845ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
62722024-10-01T02:37:11.845ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
62732024-10-01T02:37:11.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
62742024-10-01T02:37:11.846ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
62752024-10-01T02:37:11.846ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 353.796699ms iteration = 5 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
62762024-10-01T02:37:11.847ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62772024-10-01T02:37:11.849ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
62782024-10-01T02:37:11.849ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
62792024-10-01T02:37:11.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
62802024-10-01T02:37:11.859ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62812024-10-01T02:37:11.860ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62822024-10-01T02:37:11.861ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
62832024-10-01T02:37:11.861ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
62842024-10-01T02:37:11.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
62852024-10-01T02:37:11.863ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
62862024-10-01T02:37:11.863ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
62872024-10-01T02:37:11.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
62882024-10-01T02:37:11.865ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 3d6d7965-c160-4184-b04f-32fa0fb7b928 dns_zone_name = oxide.test found_so_far = 1 version = 2
62892024-10-01T02:37:11.865ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
62902024-10-01T02:37:11.865ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-10-01 02:33:13.765844 UTC dns_group = external generation = 2
62912024-10-01T02:37:11.865ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 373.782864ms iteration = 6 status = {"generation":2}
62922024-10-01T02:37:11.869ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1059 zone_address = fd00:1122:3344:101::2
62932024-10-01T02:37:11.869ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
62942024-10-01T02:37:11.869ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1f786734-ceee-4504-997f-ec971c621646", "content-length": "26", "date": "Tue, 01 Oct 2024 02:37:11 GMT"} })
62952024-10-01T02:37:11.869ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1064 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
62962024-10-01T02:37:11.871ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
62972024-10-01T02:37:11.893ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1059 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd zone_address = fd00:1122:3344:101::2
62982024-10-01T02:37:11.893ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
62992024-10-01T02:37:11.893ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1059 zone_address = fd00:1122:3344:101::2
63002024-10-01T02:37:11.893ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
63012024-10-01T02:37:11.893ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d6333bb1-0c5f-44e6-88fc-8989257cb440", "content-length": "26", "date": "Tue, 01 Oct 2024 02:37:11 GMT"} })
63022024-10-01T02:37:11.893ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1064 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
63032024-10-01T02:37:11.893ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "495952b5-ad97-4ce5-bc35-26b48712000b", "content-length": "26", "date": "Tue, 01 Oct 2024 02:37:11 GMT"} })
63042024-10-01T02:37:11.893ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1064 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
63052024-10-01T02:37:11.894ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-10-01T02:33:09.142901Z, time_modified: 2024-10-01T02:33:09.142901Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, db_silo: Silo { identity: SiloIdentity { id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-10-01T02:33:13.712784Z, time_modified: 2024-10-01T02:33:13.712784Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "ca547a59343cd98ceb775f10ce9428d8003a71a149b5b7d33f10c1e7a9820bb1" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, db_silo: Silo { identity: SiloIdentity { id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-10-01T02:33:13.712784Z, time_modified: 2024-10-01T02:33:13.712784Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "ca547a59343cd98ceb775f10ce9428d8003a71a149b5b7d33f10c1e7a9820bb1" }] }) }
63062024-10-01T02:37:11.894ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 403.079014ms iteration = 6 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"21983b87-d6d0-47c6-a33c-5fe68fbed0c6","tls_certs":["ca547a59343cd98ceb775f10ce9428d8003a71a149b5b7d33f10c1e7a9820bb1"]}},"default_endpoint":{"silo_id":"21983b87-d6d0-47c6-a33c-5fe68fbed0c6","tls_certs":["ca547a59343cd98ceb775f10ce9428d8003a71a149b5b7d33f10c1e7a9820bb1"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
63072024-10-01T02:37:11.897ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd
63082024-10-01T02:37:11.897ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
63092024-10-01T02:37:11.962ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
63102024-10-01T02:37:11.963ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "1b9aee08-3c93-429d-9ba1-969543e1bf10", "date": "Tue, 01 Oct 2024 02:37:11 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
63112024-10-01T02:37:11.963ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
63122024-10-01T02:37:11.965ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "4013f9d8-7ca6-4bdb-b650-bf6a112631b8", "date": "Tue, 01 Oct 2024 02:37:11 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
63132024-10-01T02:37:11.965ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
63142024-10-01T02:37:11.967ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "fa35cfc6-058d-44aa-8e2e-276719502ca2", "date": "Tue, 01 Oct 2024 02:37:11 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
63152024-10-01T02:37:11.967ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
63162024-10-01T02:37:11.969ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
63172024-10-01T02:37:11.969ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 477.624543ms iteration = 7 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
63182024-10-01T02:37:12.014ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
63192024-10-01T02:37:12.015ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "fc76c4f5-fd94-42af-ab32-194df3733586", "content-length": "2", "date": "Tue, 01 Oct 2024 02:37:11 GMT"} })
63202024-10-01T02:37:12.016ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
63212024-10-01T02:37:12.017ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
63222024-10-01T02:37:12.019ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 527.55882ms iteration = 9 status = null
63232024-10-01T02:37:12.122ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 630.366063ms iteration = 9 status = {}
63242024-10-01T02:37:12.125ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
63252024-10-01T02:37:12.125ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "c3a6b84f-b37c-4809-9a79-5289c08ed972", "content-length": "691", "date": "Tue, 01 Oct 2024 02:37:11 GMT"} })
63262024-10-01T02:37:12.125ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
63272024-10-01T02:37:12.125ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
63282024-10-01T02:37:12.125ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
63292024-10-01T02:37:12.127ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 635.281886ms iteration = 9 status = {}
63302024-10-01T02:37:12.166ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63312024-10-01T02:37:12.166ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63322024-10-01T02:37:12.169ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 58c2bb06-eaf4-47b5-aefe-83ea06db2406, rack_id: 52547763-7759-42e1-81a9-8b833f59f5dd, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(57ef3335-befd-4872-b57f-5c2571dcca50) } rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd switch_location = Switch0
63332024-10-01T02:37:12.169ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63342024-10-01T02:37:12.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63352024-10-01T02:37:12.178ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
63362024-10-01T02:37:12.178ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "64cd36dd-4a97-4f5c-878a-7daf5390303b", "content-length": "121", "date": "Tue, 01 Oct 2024 02:37:11 GMT"} })
63372024-10-01T02:37:12.178ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
63382024-10-01T02:37:12.178ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 57ef3335-befd-4872-b57f-5c2571dcca50
63392024-10-01T02:37:12.179ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
63402024-10-01T02:37:12.179ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
63412024-10-01T02:37:12.179ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd routes = {}
63422024-10-01T02:37:12.179ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd routes = {}
63432024-10-01T02:37:12.179ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd
63442024-10-01T02:37:12.179ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63452024-10-01T02:37:12.179ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63462024-10-01T02:37:12.181ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
63472024-10-01T02:37:12.181ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "b4b51a1d-aaf4-4a7d-a6bb-c039fca7921b", "content-length": "2", "date": "Tue, 01 Oct 2024 02:37:11 GMT"} })
63482024-10-01T02:37:12.181ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
63492024-10-01T02:37:12.182ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "598e3ad8-03d1-4123-8d18-2d3cb84f8106", "content-length": "52", "date": "Tue, 01 Oct 2024 02:37:11 GMT"} })
63502024-10-01T02:37:12.182ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd switch_location = Switch0
63512024-10-01T02:37:12.182ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
63522024-10-01T02:37:12.281ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "2208c0ea-bd13-4362-bc82-9289f041cdf4", "date": "Tue, 01 Oct 2024 02:37:11 GMT"} })
63532024-10-01T02:37:12.281ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd switch = Switch0
63542024-10-01T02:37:12.281ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
63552024-10-01T02:37:12.282ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "776d3ba9-0917-47da-bdd3-da4dc2233cd5", "content-length": "667", "date": "Tue, 01 Oct 2024 02:37:11 GMT"} })
63562024-10-01T02:37:12.282ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63572024-10-01T02:37:12.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63582024-10-01T02:37:12.286ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63592024-10-01T02:37:12.286ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63602024-10-01T02:37:12.291ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63612024-10-01T02:37:12.292ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63622024-10-01T02:37:12.294ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63632024-10-01T02:37:12.294ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63642024-10-01T02:37:12.301ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 809.665328ms iteration = 9 status = {}
63652024-10-01T02:37:12.373ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:60878 req_id = 308151e2-17e9-44dc-9c2a-f79345cfa844 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
63662024-10-01T02:37:12.374ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:60878 req_id = 308151e2-17e9-44dc-9c2a-f79345cfa844 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
63672024-10-01T02:37:12.376ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2394 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:60878 req_id = 308151e2-17e9-44dc-9c2a-f79345cfa844 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
63682024-10-01T02:37:14.898ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1344 local_addr = [fd00:1122:3344:101::c]:53319 method = GET remote_addr = [fd00:1122:3344:101::d]:65459 req_id = 3fc53dbc-01fe-491c-b9b9-64af03de2ed8 response_code = 200 uri = /3dfd7033-71d8-4eb9-bb97-49dae3b5cd35
63692024-10-01T02:37:21.491ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 26 reason = Timeout
63702024-10-01T02:37:21.491ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63712024-10-01T02:37:21.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63722024-10-01T02:37:21.492ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 26 reason = Timeout
63732024-10-01T02:37:21.492ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
63742024-10-01T02:37:21.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
63752024-10-01T02:37:21.493ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63762024-10-01T02:37:21.496ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
63772024-10-01T02:37:21.496ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63782024-10-01T02:37:21.496ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63792024-10-01T02:37:21.497ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63802024-10-01T02:37:21.498ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63812024-10-01T02:37:21.499ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63822024-10-01T02:37:21.502ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8f598f5c-ad31-4712-b43f-7ac75a933d07, lookup_type: ById(8f598f5c-ad31-4712-b43f-7ac75a933d07) } result = Ok(())
63832024-10-01T02:37:21.502ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63842024-10-01T02:37:21.502ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63852024-10-01T02:37:21.509ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 original_time_created = 2024-10-01 02:32:51.153042 UTC target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 time_created = 2024-10-01 02:32:51.153042 UTC
63862024-10-01T02:37:21.509ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 17.832079ms iteration = 26 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8f598f5c-ad31-4712-b43f-7ac75a933d07","time_created":"2024-10-01T02:32:51.153042Z"}
63872024-10-01T02:37:21.525ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
63882024-10-01T02:37:21.526ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
63892024-10-01T02:37:21.553ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 60.92368ms iteration = 26 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
63902024-10-01T02:37:24.899ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1527 local_addr = [fd00:1122:3344:101::c]:53319 method = GET remote_addr = [fd00:1122:3344:101::d]:65459 req_id = 4954e68e-40c7-4548-b69f-02683d630e31 response_code = 200 uri = /3dfd7033-71d8-4eb9-bb97-49dae3b5cd35
63912024-10-01T02:37:31.491ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 27 reason = Timeout
63922024-10-01T02:37:31.491ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63932024-10-01T02:37:31.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63942024-10-01T02:37:31.492ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 27 reason = Timeout
63952024-10-01T02:37:31.492ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
63962024-10-01T02:37:31.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
63972024-10-01T02:37:31.493ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63982024-10-01T02:37:31.494ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
63992024-10-01T02:37:31.494ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
64002024-10-01T02:37:31.495ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
64012024-10-01T02:37:31.495ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64022024-10-01T02:37:31.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64032024-10-01T02:37:31.495ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.473698ms iteration = 27 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
64042024-10-01T02:37:31.497ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64052024-10-01T02:37:31.497ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64062024-10-01T02:37:31.499ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64072024-10-01T02:37:31.501ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8f598f5c-ad31-4712-b43f-7ac75a933d07, lookup_type: ById(8f598f5c-ad31-4712-b43f-7ac75a933d07) } result = Ok(())
64082024-10-01T02:37:31.501ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64092024-10-01T02:37:31.501ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64102024-10-01T02:37:31.508ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 original_time_created = 2024-10-01 02:32:51.153042 UTC target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 time_created = 2024-10-01 02:32:51.153042 UTC
64112024-10-01T02:37:31.508ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 16.860422ms iteration = 27 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8f598f5c-ad31-4712-b43f-7ac75a933d07","time_created":"2024-10-01T02:32:51.153042Z"}
64122024-10-01T02:37:34.899ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1495 local_addr = [fd00:1122:3344:101::c]:53319 method = GET remote_addr = [fd00:1122:3344:101::d]:65459 req_id = 4f366493-5260-43cf-9848-06779caed569 response_code = 200 uri = /3dfd7033-71d8-4eb9-bb97-49dae3b5cd35
64132024-10-01T02:37:41.491ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 10 reason = Timeout
64142024-10-01T02:37:41.491ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
64152024-10-01T02:37:41.491ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 10 reason = Timeout
64162024-10-01T02:37:41.491ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
64172024-10-01T02:37:41.491ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 10 reason = Timeout
64182024-10-01T02:37:41.491ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 28 reason = Timeout
64192024-10-01T02:37:41.491ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
64202024-10-01T02:37:41.491ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64212024-10-01T02:37:41.491ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 10 reason = Timeout
64222024-10-01T02:37:41.491ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 10 reason = Timeout
64232024-10-01T02:37:41.491ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
64242024-10-01T02:37:41.491ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 10 reason = Timeout
64252024-10-01T02:37:41.491ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 10 reason = Timeout
64262024-10-01T02:37:41.491ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
64272024-10-01T02:37:41.491ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 12 reason = Timeout
64282024-10-01T02:37:41.491ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64292024-10-01T02:37:41.491ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
64302024-10-01T02:37:41.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
64312024-10-01T02:37:41.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
64322024-10-01T02:37:41.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
64332024-10-01T02:37:41.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
64342024-10-01T02:37:41.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64352024-10-01T02:37:41.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
64362024-10-01T02:37:41.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64372024-10-01T02:37:41.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
64382024-10-01T02:37:41.492ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 28 reason = Timeout
64392024-10-01T02:37:41.492ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 10 reason = Timeout
64402024-10-01T02:37:41.492ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
64412024-10-01T02:37:41.492ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
64422024-10-01T02:37:41.492ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 10 reason = Timeout
64432024-10-01T02:37:41.492ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
64442024-10-01T02:37:41.492ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 10 reason = Timeout
64452024-10-01T02:37:41.492ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
64462024-10-01T02:37:41.492ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 10 reason = Timeout
64472024-10-01T02:37:41.492ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
64482024-10-01T02:37:41.492ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 10 reason = Timeout
64492024-10-01T02:37:41.492ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
64502024-10-01T02:37:41.492ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 10 reason = Timeout
64512024-10-01T02:37:41.492ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
64522024-10-01T02:37:41.492ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
64532024-10-01T02:37:41.492ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 11 reason = Timeout
64542024-10-01T02:37:41.492ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
64552024-10-01T02:37:41.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
64562024-10-01T02:37:41.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
64572024-10-01T02:37:41.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
64582024-10-01T02:37:41.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
64592024-10-01T02:37:41.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
64602024-10-01T02:37:41.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
64612024-10-01T02:37:41.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
64622024-10-01T02:37:41.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
64632024-10-01T02:37:41.495ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1514, tv_nsec: 935993761 } })
64642024-10-01T02:37:41.495ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.906395ms iteration = 10 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
64652024-10-01T02:37:41.495ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1051
64662024-10-01T02:37:41.496ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1514, tv_nsec: 937362144 } })
64672024-10-01T02:37:41.496ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64682024-10-01T02:37:41.496ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64692024-10-01T02:37:41.497ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1051
64702024-10-01T02:37:41.499ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
64712024-10-01T02:37:41.499ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
64722024-10-01T02:37:41.500ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
64732024-10-01T02:37:41.500ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
64742024-10-01T02:37:41.500ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64752024-10-01T02:37:41.500ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64762024-10-01T02:37:41.501ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64772024-10-01T02:37:41.505ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
64782024-10-01T02:37:41.505ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
64792024-10-01T02:37:41.505ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
64802024-10-01T02:37:41.508ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64812024-10-01T02:37:41.511ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
64822024-10-01T02:37:41.511ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
64832024-10-01T02:37:41.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
64842024-10-01T02:37:41.513ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64852024-10-01T02:37:41.513ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64862024-10-01T02:37:41.515ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64872024-10-01T02:37:41.517ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
64882024-10-01T02:37:41.517ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
64892024-10-01T02:37:41.518ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8f598f5c-ad31-4712-b43f-7ac75a933d07, lookup_type: ById(8f598f5c-ad31-4712-b43f-7ac75a933d07) } result = Ok(())
64902024-10-01T02:37:41.518ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64912024-10-01T02:37:41.518ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64922024-10-01T02:37:41.529ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 original_time_created = 2024-10-01 02:32:51.153042 UTC target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 time_created = 2024-10-01 02:32:51.153042 UTC
64932024-10-01T02:37:41.529ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 37.771383ms iteration = 28 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8f598f5c-ad31-4712-b43f-7ac75a933d07","time_created":"2024-10-01T02:32:51.153042Z"}
64942024-10-01T02:37:41.532ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 39.576393ms iteration = 10 status = {"errors":[],"records_set_to_done":[]}
64952024-10-01T02:37:41.535ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
64962024-10-01T02:37:41.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
64972024-10-01T02:37:41.538ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 46.441968ms iteration = 10 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
64982024-10-01T02:37:41.539ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64992024-10-01T02:37:41.541ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
65002024-10-01T02:37:41.541ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
65012024-10-01T02:37:41.541ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
65022024-10-01T02:37:41.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
65032024-10-01T02:37:41.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
65042024-10-01T02:37:41.542ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
65052024-10-01T02:37:41.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
65062024-10-01T02:37:41.543ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
65072024-10-01T02:37:41.543ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
65082024-10-01T02:37:41.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
65092024-10-01T02:37:41.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
65102024-10-01T02:37:41.545ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
65112024-10-01T02:37:41.545ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
65122024-10-01T02:37:41.545ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
65132024-10-01T02:37:41.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
65142024-10-01T02:37:41.545ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65152024-10-01T02:37:41.545ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65162024-10-01T02:37:41.546ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65172024-10-01T02:37:41.547ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
65182024-10-01T02:37:41.547ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
65192024-10-01T02:37:41.547ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
65202024-10-01T02:37:41.547ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
65212024-10-01T02:37:41.549ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 2a571ec0-85a3-450e-88fc-680c13ffa211, lookup_type: ById(2a571ec0-85a3-450e-88fc-680c13ffa211) } result = Ok(())
65222024-10-01T02:37:41.549ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
65232024-10-01T02:37:41.549ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
65242024-10-01T02:37:41.549ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
65252024-10-01T02:37:41.549ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
65262024-10-01T02:37:41.549ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
65272024-10-01T02:37:41.549ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
65282024-10-01T02:37:41.549ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
65292024-10-01T02:37:41.550ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
65302024-10-01T02:37:41.550ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
65312024-10-01T02:37:41.550ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
65322024-10-01T02:37:41.552ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 60.797459ms iteration = 10 status = 0
65332024-10-01T02:37:41.555ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 62.362705ms iteration = 10 status = {"errors":[],"garbage_collect_requested":[]}
65342024-10-01T02:37:41.556ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1059 zone_address = fd00:1122:3344:101::2
65352024-10-01T02:37:41.556ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
65362024-10-01T02:37:41.556ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1514, tv_nsec: 997521392 } })
65372024-10-01T02:37:41.556ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "28f165b0-1189-420c-9715-1fff84a85612", "content-length": "26", "date": "Tue, 01 Oct 2024 02:37:41 GMT"} })
65382024-10-01T02:37:41.556ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1064 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
65392024-10-01T02:37:41.556ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1051 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd
65402024-10-01T02:37:41.559ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65412024-10-01T02:37:41.559ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
65422024-10-01T02:37:41.561ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
65432024-10-01T02:37:41.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
65442024-10-01T02:37:41.562ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
65452024-10-01T02:37:41.562ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
65462024-10-01T02:37:41.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
65472024-10-01T02:37:41.564ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1059 zone_address = fd00:1122:3344:101::2
65482024-10-01T02:37:41.564ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
65492024-10-01T02:37:41.564ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6df74b09-bc58-49a8-bfc6-4a2ad081465d", "content-length": "26", "date": "Tue, 01 Oct 2024 02:37:41 GMT"} })
65502024-10-01T02:37:41.564ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1064 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
65512024-10-01T02:37:41.567ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
65522024-10-01T02:37:41.567ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
65532024-10-01T02:37:41.567ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 74.815294ms iteration = 10 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
65542024-10-01T02:37:41.582ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 89.707134ms iteration = 10 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
65552024-10-01T02:37:41.582ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
65562024-10-01T02:37:41.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
65572024-10-01T02:37:41.593ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
65582024-10-01T02:37:41.593ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
65592024-10-01T02:37:41.593ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 100.634086ms iteration = 10 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
65602024-10-01T02:37:41.597ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 104.567792ms iteration = 28 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
65612024-10-01T02:37:41.620ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 127.383595ms iteration = 10 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
65622024-10-01T02:37:41.622ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
65632024-10-01T02:37:41.622ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
65642024-10-01T02:37:41.637ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1059 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd zone_address = fd00:1122:3344:101::2
65652024-10-01T02:37:41.638ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
65662024-10-01T02:37:41.638ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4e6ccad5-cba6-47a5-ab10-64ae36b830bc", "content-length": "26", "date": "Tue, 01 Oct 2024 02:37:41 GMT"} })
65672024-10-01T02:37:41.638ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1064 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
65682024-10-01T02:37:41.641ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd
65692024-10-01T02:37:41.650ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
65702024-10-01T02:37:41.650ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "06048c43-70a0-4378-a3c2-c27a9b6d0ca2", "content-length": "2", "date": "Tue, 01 Oct 2024 02:37:40 GMT"} })
65712024-10-01T02:37:41.651ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
65722024-10-01T02:37:41.651ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
65732024-10-01T02:37:41.655ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 163.606851ms iteration = 12 status = {"physical_disks_added":0}
65742024-10-01T02:37:41.655ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 164.07392ms iteration = 10 status = {}
65752024-10-01T02:37:41.657ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
65762024-10-01T02:37:41.658ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
65772024-10-01T02:37:41.696ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
65782024-10-01T02:37:41.696ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "1cb9668b-85d4-4c81-adef-64c5b6b82202", "content-length": "372", "date": "Tue, 01 Oct 2024 02:37:41 GMT"} })
65792024-10-01T02:37:41.696ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
65802024-10-01T02:37:41.696ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
65812024-10-01T02:37:41.697ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 205.956461ms iteration = 10 status = null
65822024-10-01T02:37:41.697ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65832024-10-01T02:37:41.698ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
65842024-10-01T02:37:41.698ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
65852024-10-01T02:37:41.699ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
65862024-10-01T02:37:41.699ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
65872024-10-01T02:37:41.699ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
65882024-10-01T02:37:41.701ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65892024-10-01T02:37:41.701ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
65902024-10-01T02:37:41.702ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
65912024-10-01T02:37:41.702ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
65922024-10-01T02:37:41.702ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
65932024-10-01T02:37:41.703ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
65942024-10-01T02:37:41.705ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
65952024-10-01T02:37:41.705ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "ff842039-e67d-4341-ae4d-7f99eb86c199", "date": "Tue, 01 Oct 2024 02:37:41 GMT"} })
65962024-10-01T02:37:41.707ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 214.700878ms iteration = 11 status = {}
65972024-10-01T02:37:41.764ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
65982024-10-01T02:37:41.764ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "053cef42-c53e-403c-b28b-6cd3b8613cc8", "content-length": "691", "date": "Tue, 01 Oct 2024 02:37:41 GMT"} })
65992024-10-01T02:37:41.764ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
66002024-10-01T02:37:41.764ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
66012024-10-01T02:37:41.764ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
66022024-10-01T02:37:41.766ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 275.0879ms iteration = 10 status = {}
66032024-10-01T02:37:41.793ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
66042024-10-01T02:37:41.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
66052024-10-01T02:37:41.795ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 58c2bb06-eaf4-47b5-aefe-83ea06db2406, rack_id: 52547763-7759-42e1-81a9-8b833f59f5dd, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(57ef3335-befd-4872-b57f-5c2571dcca50) } rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd switch_location = Switch0
66062024-10-01T02:37:41.795ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
66072024-10-01T02:37:41.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
66082024-10-01T02:37:41.804ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
66092024-10-01T02:37:41.805ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "dfe1254b-1aaa-4af0-831c-451fadcd413a", "content-length": "121", "date": "Tue, 01 Oct 2024 02:37:40 GMT"} })
66102024-10-01T02:37:41.805ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
66112024-10-01T02:37:41.805ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 57ef3335-befd-4872-b57f-5c2571dcca50
66122024-10-01T02:37:41.805ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
66132024-10-01T02:37:41.805ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
66142024-10-01T02:37:41.805ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd routes = {}
66152024-10-01T02:37:41.805ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd routes = {}
66162024-10-01T02:37:41.805ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd
66172024-10-01T02:37:41.805ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
66182024-10-01T02:37:41.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
66192024-10-01T02:37:41.807ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
66202024-10-01T02:37:41.807ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "f3be08d9-4b6a-4fce-b3fb-7746706cc6f3", "content-length": "2", "date": "Tue, 01 Oct 2024 02:37:40 GMT"} })
66212024-10-01T02:37:41.807ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
66222024-10-01T02:37:41.807ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "e202ddcd-9de8-4d97-9b1c-f86d9cd3545a", "content-length": "52", "date": "Tue, 01 Oct 2024 02:37:40 GMT"} })
66232024-10-01T02:37:41.807ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd switch_location = Switch0
66242024-10-01T02:37:41.807ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
66252024-10-01T02:37:41.907ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "de06ff0d-3c10-485e-96df-93bea964f359", "date": "Tue, 01 Oct 2024 02:37:41 GMT"} })
66262024-10-01T02:37:41.907ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd switch = Switch0
66272024-10-01T02:37:41.907ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
66282024-10-01T02:37:41.907ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "6a25f6f0-1ea8-4343-b9d0-277e283efba2", "content-length": "667", "date": "Tue, 01 Oct 2024 02:37:41 GMT"} })
66292024-10-01T02:37:41.907ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
66302024-10-01T02:37:41.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
66312024-10-01T02:37:41.911ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
66322024-10-01T02:37:41.912ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
66332024-10-01T02:37:41.915ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
66342024-10-01T02:37:41.915ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
66352024-10-01T02:37:41.917ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
66362024-10-01T02:37:41.917ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
66372024-10-01T02:37:41.925ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 434.078103ms iteration = 10 status = {}
66382024-10-01T02:37:42.407ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:60878 req_id = 83b723a5-d252-4b63-856f-85161baab85d roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
66392024-10-01T02:37:42.407ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:60878 req_id = 83b723a5-d252-4b63-856f-85161baab85d resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
66402024-10-01T02:37:42.410ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3253 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:60878 req_id = 83b723a5-d252-4b63-856f-85161baab85d response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
66412024-10-01T02:37:44.899ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1640 local_addr = [fd00:1122:3344:101::c]:53319 method = GET remote_addr = [fd00:1122:3344:101::d]:65459 req_id = 2e687ee5-aaf2-4261-a7d6-4767d3481b44 response_code = 200 uri = /3dfd7033-71d8-4eb9-bb97-49dae3b5cd35
66422024-10-01T02:37:51.492ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 29 reason = Timeout
66432024-10-01T02:37:51.492ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66442024-10-01T02:37:51.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66452024-10-01T02:37:51.492ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 29 reason = Timeout
66462024-10-01T02:37:51.492ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
66472024-10-01T02:37:51.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
66482024-10-01T02:37:51.494ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66492024-10-01T02:37:51.494ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
66502024-10-01T02:37:51.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
66512024-10-01T02:37:51.497ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
66522024-10-01T02:37:51.497ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66532024-10-01T02:37:51.497ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66542024-10-01T02:37:51.498ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66552024-10-01T02:37:51.499ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66562024-10-01T02:37:51.500ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66572024-10-01T02:37:51.502ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8f598f5c-ad31-4712-b43f-7ac75a933d07, lookup_type: ById(8f598f5c-ad31-4712-b43f-7ac75a933d07) } result = Ok(())
66582024-10-01T02:37:51.502ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66592024-10-01T02:37:51.503ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66602024-10-01T02:37:51.510ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 original_time_created = 2024-10-01 02:32:51.153042 UTC target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 time_created = 2024-10-01 02:32:51.153042 UTC
66612024-10-01T02:37:51.510ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.656952ms iteration = 29 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8f598f5c-ad31-4712-b43f-7ac75a933d07","time_created":"2024-10-01T02:32:51.153042Z"}
66622024-10-01T02:37:51.522ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 29.459854ms iteration = 29 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
66632024-10-01T02:37:54.899ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1380 local_addr = [fd00:1122:3344:101::c]:53319 method = GET remote_addr = [fd00:1122:3344:101::d]:65459 req_id = 6f6b6f2d-58c3-4025-bf77-775b4b889f41 response_code = 200 uri = /3dfd7033-71d8-4eb9-bb97-49dae3b5cd35
66642024-10-01T02:38:01.491ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 30 reason = Timeout
66652024-10-01T02:38:01.491ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66662024-10-01T02:38:01.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66672024-10-01T02:38:01.492ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 30 reason = Timeout
66682024-10-01T02:38:01.492ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
66692024-10-01T02:38:01.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
66702024-10-01T02:38:01.493ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66712024-10-01T02:38:01.494ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
66722024-10-01T02:38:01.494ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
66732024-10-01T02:38:01.496ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.912306ms iteration = 30 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
66742024-10-01T02:38:01.496ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
66752024-10-01T02:38:01.496ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66762024-10-01T02:38:01.496ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66772024-10-01T02:38:01.498ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66782024-10-01T02:38:01.499ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66792024-10-01T02:38:01.500ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66802024-10-01T02:38:01.503ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8f598f5c-ad31-4712-b43f-7ac75a933d07, lookup_type: ById(8f598f5c-ad31-4712-b43f-7ac75a933d07) } result = Ok(())
66812024-10-01T02:38:01.503ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66822024-10-01T02:38:01.503ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66832024-10-01T02:38:01.510ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 original_time_created = 2024-10-01 02:32:51.153042 UTC target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 time_created = 2024-10-01 02:32:51.153042 UTC
66842024-10-01T02:38:01.510ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.033129ms iteration = 30 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8f598f5c-ad31-4712-b43f-7ac75a933d07","time_created":"2024-10-01T02:32:51.153042Z"}
66852024-10-01T02:38:04.899ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1405 local_addr = [fd00:1122:3344:101::c]:53319 method = GET remote_addr = [fd00:1122:3344:101::d]:65459 req_id = a4135432-ddce-4c89-b1bc-33d1f3ac8ae5 response_code = 200 uri = /3dfd7033-71d8-4eb9-bb97-49dae3b5cd35
66862024-10-01T02:38:11.492ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 8 reason = Timeout
66872024-10-01T02:38:11.492ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 7 reason = Timeout
66882024-10-01T02:38:11.492ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 11 reason = Timeout
66892024-10-01T02:38:11.492ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
66902024-10-01T02:38:11.492ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 13 reason = Timeout
66912024-10-01T02:38:11.492ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 11 reason = Timeout
66922024-10-01T02:38:11.492ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
66932024-10-01T02:38:11.492ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 7 reason = Timeout
66942024-10-01T02:38:11.492ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
66952024-10-01T02:38:11.492ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
66962024-10-01T02:38:11.492ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 7 reason = Timeout
66972024-10-01T02:38:11.492ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 7 reason = Timeout
66982024-10-01T02:38:11.492ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07
66992024-10-01T02:38:11.492ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 11 reason = Timeout
67002024-10-01T02:38:11.492ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 11.881\u{b5}s iteration = 7 status = {"enabled":false,"target_id":"8f598f5c-ad31-4712-b43f-7ac75a933d07"}
67012024-10-01T02:38:11.492ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
67022024-10-01T02:38:11.492ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 11 reason = Timeout
67032024-10-01T02:38:11.492ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
67042024-10-01T02:38:11.492ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 6 reason = Timeout
67052024-10-01T02:38:11.492ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
67062024-10-01T02:38:11.492ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 7 reason = Timeout
67072024-10-01T02:38:11.492ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
67082024-10-01T02:38:11.492ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
67092024-10-01T02:38:11.492ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
67102024-10-01T02:38:11.492ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 8 reason = Timeout
67112024-10-01T02:38:11.492ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 11 reason = Timeout
67122024-10-01T02:38:11.492ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 7 reason = Timeout
67132024-10-01T02:38:11.492ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
67142024-10-01T02:38:11.492ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
67152024-10-01T02:38:11.492ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
67162024-10-01T02:38:11.492ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 11 reason = Timeout
67172024-10-01T02:38:11.492ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 31 reason = Timeout
67182024-10-01T02:38:11.492ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
67192024-10-01T02:38:11.492ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 11 reason = Timeout
67202024-10-01T02:38:11.492ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 6 reason = Timeout
67212024-10-01T02:38:11.492ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
67222024-10-01T02:38:11.492ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-10-01 02:28:11.492585850 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
67232024-10-01T02:38:11.492ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
67242024-10-01T02:38:11.492ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 31 reason = Timeout
67252024-10-01T02:38:11.492ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
67262024-10-01T02:38:11.492ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 11 reason = Timeout
67272024-10-01T02:38:11.492ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
67282024-10-01T02:38:11.492ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 11 reason = Timeout
67292024-10-01T02:38:11.492ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
67302024-10-01T02:38:11.492ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 11 reason = Timeout
67312024-10-01T02:38:11.492ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 11 reason = Timeout
67322024-10-01T02:38:11.492ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 6 reason = Timeout
67332024-10-01T02:38:11.492ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
67342024-10-01T02:38:11.492ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
67352024-10-01T02:38:11.492ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
67362024-10-01T02:38:11.492ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 6 reason = Timeout
67372024-10-01T02:38:11.492ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
67382024-10-01T02:38:11.492ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 11 reason = Timeout
67392024-10-01T02:38:11.492ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
67402024-10-01T02:38:11.492ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 11 reason = Timeout
67412024-10-01T02:38:11.492ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
67422024-10-01T02:38:11.492ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
67432024-10-01T02:38:11.492ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 12 reason = Timeout
67442024-10-01T02:38:11.492ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
67452024-10-01T02:38:11.492ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 6 reason = Timeout
67462024-10-01T02:38:11.492ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
67472024-10-01T02:38:11.493ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 2 reason = Timeout
67482024-10-01T02:38:11.493ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
67492024-10-01T02:38:11.493ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
67502024-10-01T02:38:11.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
67512024-10-01T02:38:11.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
67522024-10-01T02:38:11.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
67532024-10-01T02:38:11.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
67542024-10-01T02:38:11.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
67552024-10-01T02:38:11.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
67562024-10-01T02:38:11.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
67572024-10-01T02:38:11.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
67582024-10-01T02:38:11.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
67592024-10-01T02:38:11.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
67602024-10-01T02:38:11.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
67612024-10-01T02:38:11.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
67622024-10-01T02:38:11.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
67632024-10-01T02:38:11.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
67642024-10-01T02:38:11.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
67652024-10-01T02:38:11.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
67662024-10-01T02:38:11.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
67672024-10-01T02:38:11.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
67682024-10-01T02:38:11.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
67692024-10-01T02:38:11.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
67702024-10-01T02:38:11.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
67712024-10-01T02:38:11.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
67722024-10-01T02:38:11.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
67732024-10-01T02:38:11.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
67742024-10-01T02:38:11.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
67752024-10-01T02:38:11.494ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("0a1ed896-5078-4267-b636-10151376f015.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("eb937866-c779-4a9e-aec4-cc18302d4ce1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("eb937866-c779-4a9e-aec4-cc18302d4ce1.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1544, tv_nsec: 935399031 } })
67762024-10-01T02:38:11.495ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("1af5fb25-d768-4bc6-915c-0b4c59e1f0ef.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("293e78c2-b712-4c13-b502-e2be11a76306.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("71ea2e4f-4772-4ce7-8093-48597fd7fd92.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("71ea2e4f-4772-4ce7-8093-48597fd7fd92.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1544, tv_nsec: 935613604 } })
67772024-10-01T02:38:11.495ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67782024-10-01T02:38:11.496ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
67792024-10-01T02:38:11.496ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 4.375654ms iteration = 7 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
67802024-10-01T02:38:11.497ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67812024-10-01T02:38:11.497ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67822024-10-01T02:38:11.498ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
67832024-10-01T02:38:11.498ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
67842024-10-01T02:38:11.498ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
67852024-10-01T02:38:11.498ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 6.315086ms iteration = 7 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
67862024-10-01T02:38:11.498ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
67872024-10-01T02:38:11.500ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
67882024-10-01T02:38:11.500ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
67892024-10-01T02:38:11.500ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67902024-10-01T02:38:11.500ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
67912024-10-01T02:38:11.502ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
67922024-10-01T02:38:11.502ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
67932024-10-01T02:38:11.502ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
67942024-10-01T02:38:11.502ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
67952024-10-01T02:38:11.503ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
67962024-10-01T02:38:11.503ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
67972024-10-01T02:38:11.503ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
67982024-10-01T02:38:11.503ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
67992024-10-01T02:38:11.504ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68002024-10-01T02:38:11.504ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 11.669816ms iteration = 11 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
68012024-10-01T02:38:11.506ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1544, tv_nsec: 946606058 } })
68022024-10-01T02:38:11.506ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1544, tv_nsec: 946774231 } })
68032024-10-01T02:38:11.507ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
68042024-10-01T02:38:11.507ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
68052024-10-01T02:38:11.507ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
68062024-10-01T02:38:11.507ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
68072024-10-01T02:38:11.507ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
68082024-10-01T02:38:11.507ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1051
68092024-10-01T02:38:11.508ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1051
68102024-10-01T02:38:11.509ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68112024-10-01T02:38:11.510ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-10-01 02:28:11.492585850 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
68122024-10-01T02:38:11.510ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 17.91515ms iteration = 6 status = {"expiration":"2024-10-01T02:28:11.492585850Z","pruned":[]}
68132024-10-01T02:38:11.510ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 18.227105ms iteration = 11 status = {"errors":[],"records_set_to_done":[]}
68142024-10-01T02:38:11.510ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
68152024-10-01T02:38:11.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
68162024-10-01T02:38:11.512ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
68172024-10-01T02:38:11.512ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68182024-10-01T02:38:11.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68192024-10-01T02:38:11.514ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68202024-10-01T02:38:11.516ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
68212024-10-01T02:38:11.516ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
68222024-10-01T02:38:11.516ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 23.501414ms iteration = 6 status = {"errors":[],"found_port_ok":[]}
68232024-10-01T02:38:11.516ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
68242024-10-01T02:38:11.521ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
68252024-10-01T02:38:11.522ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
68262024-10-01T02:38:11.528ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
68272024-10-01T02:38:11.528ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1544, tv_nsec: 969449971 } })
68282024-10-01T02:38:11.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
68292024-10-01T02:38:11.529ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1051 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd
68302024-10-01T02:38:11.530ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
68312024-10-01T02:38:11.530ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
68322024-10-01T02:38:11.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
68332024-10-01T02:38:11.531ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68342024-10-01T02:38:11.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
68352024-10-01T02:38:11.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68362024-10-01T02:38:11.534ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
68372024-10-01T02:38:11.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
68382024-10-01T02:38:11.560ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
68392024-10-01T02:38:11.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
68402024-10-01T02:38:11.566ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68412024-10-01T02:38:11.569ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
68422024-10-01T02:38:11.569ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
68432024-10-01T02:38:11.570ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
68442024-10-01T02:38:11.571ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
68452024-10-01T02:38:11.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
68462024-10-01T02:38:11.572ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68472024-10-01T02:38:11.574ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
68482024-10-01T02:38:11.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
68492024-10-01T02:38:11.576ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8f598f5c-ad31-4712-b43f-7ac75a933d07, lookup_type: ById(8f598f5c-ad31-4712-b43f-7ac75a933d07) } result = Ok(())
68502024-10-01T02:38:11.576ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68512024-10-01T02:38:11.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68522024-10-01T02:38:11.578ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 85.761257ms iteration = 31 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
68532024-10-01T02:38:11.579ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
68542024-10-01T02:38:11.579ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
68552024-10-01T02:38:11.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
68562024-10-01T02:38:11.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
68572024-10-01T02:38:11.579ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
68582024-10-01T02:38:11.579ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
68592024-10-01T02:38:11.579ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 87.205302ms iteration = 6 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
68602024-10-01T02:38:11.580ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68612024-10-01T02:38:11.581ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
68622024-10-01T02:38:11.581ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68632024-10-01T02:38:11.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
68642024-10-01T02:38:11.581ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
68652024-10-01T02:38:11.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
68662024-10-01T02:38:11.583ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
68672024-10-01T02:38:11.583ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68682024-10-01T02:38:11.583ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 91.114037ms iteration = 11 status = {"errors":[],"garbage_collect_requested":[]}
68692024-10-01T02:38:11.584ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
68702024-10-01T02:38:11.584ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
68712024-10-01T02:38:11.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
68722024-10-01T02:38:11.584ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68732024-10-01T02:38:11.585ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
68742024-10-01T02:38:11.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
68752024-10-01T02:38:11.585ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
68762024-10-01T02:38:11.585ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
68772024-10-01T02:38:11.585ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
68782024-10-01T02:38:11.585ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
68792024-10-01T02:38:11.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
68802024-10-01T02:38:11.585ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
68812024-10-01T02:38:11.585ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
68822024-10-01T02:38:11.585ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 93.256423ms iteration = 6 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
68832024-10-01T02:38:11.585ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 93.148151ms iteration = 11 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
68842024-10-01T02:38:11.586ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 93.323844ms iteration = 11 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
68852024-10-01T02:38:11.588ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
68862024-10-01T02:38:11.588ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
68872024-10-01T02:38:11.588ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
68882024-10-01T02:38:11.589ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
68892024-10-01T02:38:11.589ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
68902024-10-01T02:38:11.589ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 96.693371ms iteration = 11 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
68912024-10-01T02:38:11.590ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
68922024-10-01T02:38:11.590ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
68932024-10-01T02:38:11.590ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
68942024-10-01T02:38:11.590ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
68952024-10-01T02:38:11.591ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68962024-10-01T02:38:11.591ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
68972024-10-01T02:38:11.592ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
68982024-10-01T02:38:11.592ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
68992024-10-01T02:38:11.592ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
69002024-10-01T02:38:11.593ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69012024-10-01T02:38:11.595ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 2a571ec0-85a3-450e-88fc-680c13ffa211, lookup_type: ById(2a571ec0-85a3-450e-88fc-680c13ffa211) } result = Ok(())
69022024-10-01T02:38:11.595ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
69032024-10-01T02:38:11.595ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
69042024-10-01T02:38:11.595ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
69052024-10-01T02:38:11.595ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
69062024-10-01T02:38:11.595ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
69072024-10-01T02:38:11.596ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 original_time_created = 2024-10-01 02:32:51.153042 UTC target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 time_created = 2024-10-01 02:32:51.153042 UTC
69082024-10-01T02:38:11.596ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 103.696537ms iteration = 31 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8f598f5c-ad31-4712-b43f-7ac75a933d07","time_created":"2024-10-01T02:32:51.153042Z"}
69092024-10-01T02:38:11.598ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 106.529625ms iteration = 11 status = 0
69102024-10-01T02:38:11.599ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
69112024-10-01T02:38:11.599ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
69122024-10-01T02:38:11.599ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
69132024-10-01T02:38:11.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
69142024-10-01T02:38:11.612ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
69152024-10-01T02:38:11.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
69162024-10-01T02:38:11.627ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69172024-10-01T02:38:11.629ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
69182024-10-01T02:38:11.629ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
69192024-10-01T02:38:11.629ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
69202024-10-01T02:38:11.635ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69212024-10-01T02:38:11.638ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69222024-10-01T02:38:11.638ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 145.696111ms iteration = 11 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
69232024-10-01T02:38:11.640ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
69242024-10-01T02:38:11.640ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
69252024-10-01T02:38:11.640ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
69262024-10-01T02:38:11.640ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
69272024-10-01T02:38:11.640ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
69282024-10-01T02:38:11.640ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
69292024-10-01T02:38:11.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
69302024-10-01T02:38:11.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
69312024-10-01T02:38:11.642ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
69322024-10-01T02:38:11.642ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
69332024-10-01T02:38:11.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
69342024-10-01T02:38:11.643ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
69352024-10-01T02:38:11.643ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
69362024-10-01T02:38:11.643ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 151.008861ms iteration = 11 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
69372024-10-01T02:38:11.643ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69382024-10-01T02:38:11.644ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
69392024-10-01T02:38:11.644ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
69402024-10-01T02:38:11.648ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
69412024-10-01T02:38:11.648ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
69422024-10-01T02:38:11.648ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
69432024-10-01T02:38:11.650ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
69442024-10-01T02:38:11.650ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
69452024-10-01T02:38:11.653ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
69462024-10-01T02:38:11.657ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69472024-10-01T02:38:11.662ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
69482024-10-01T02:38:11.662ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
69492024-10-01T02:38:11.662ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
69502024-10-01T02:38:11.666ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
69512024-10-01T02:38:11.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
69522024-10-01T02:38:11.667ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
69532024-10-01T02:38:11.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
69542024-10-01T02:38:11.668ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
69552024-10-01T02:38:11.669ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
69562024-10-01T02:38:11.670ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
69572024-10-01T02:38:11.671ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
69582024-10-01T02:38:11.673ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
69592024-10-01T02:38:11.673ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
69602024-10-01T02:38:11.675ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-10-01T02:33:09.142901Z, time_modified: 2024-10-01T02:33:09.142901Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, db_silo: Silo { identity: SiloIdentity { id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-10-01T02:33:13.712784Z, time_modified: 2024-10-01T02:33:13.712784Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "ca547a59343cd98ceb775f10ce9428d8003a71a149b5b7d33f10c1e7a9820bb1" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, db_silo: Silo { identity: SiloIdentity { id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-10-01T02:33:13.712784Z, time_modified: 2024-10-01T02:33:13.712784Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "ca547a59343cd98ceb775f10ce9428d8003a71a149b5b7d33f10c1e7a9820bb1" }] }) }
69612024-10-01T02:38:11.675ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 182.776973ms iteration = 7 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"21983b87-d6d0-47c6-a33c-5fe68fbed0c6","tls_certs":["ca547a59343cd98ceb775f10ce9428d8003a71a149b5b7d33f10c1e7a9820bb1"]}},"default_endpoint":{"silo_id":"21983b87-d6d0-47c6-a33c-5fe68fbed0c6","tls_certs":["ca547a59343cd98ceb775f10ce9428d8003a71a149b5b7d33f10c1e7a9820bb1"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
69622024-10-01T02:38:11.676ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
69632024-10-01T02:38:11.677ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
69642024-10-01T02:38:11.678ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
69652024-10-01T02:38:11.679ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
69662024-10-01T02:38:11.680ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69672024-10-01T02:38:11.680ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
69682024-10-01T02:38:11.680ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 3d6d7965-c160-4184-b04f-32fa0fb7b928 dns_zone_name = oxide.test found_so_far = 0 version = 2
69692024-10-01T02:38:11.680ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
69702024-10-01T02:38:11.681ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
69712024-10-01T02:38:11.683ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69722024-10-01T02:38:11.686ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
69732024-10-01T02:38:11.686ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
69742024-10-01T02:38:11.686ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
69752024-10-01T02:38:11.686ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
69762024-10-01T02:38:11.686ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
69772024-10-01T02:38:11.686ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
69782024-10-01T02:38:11.687ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 3d6d7965-c160-4184-b04f-32fa0fb7b928 dns_zone_name = oxide.test found_so_far = 1 version = 2
69792024-10-01T02:38:11.687ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
69802024-10-01T02:38:11.687ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-10-01 02:33:13.765844 UTC dns_group = external generation = 2
69812024-10-01T02:38:11.687ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 195.338084ms iteration = 7 status = {"generation":2}
69822024-10-01T02:38:11.688ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
69832024-10-01T02:38:11.688ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = bc7b49a6-c38c-499f-983e-184e2c58fa04 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
69842024-10-01T02:38:11.688ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
69852024-10-01T02:38:11.688ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
69862024-10-01T02:38:11.689ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
69872024-10-01T02:38:11.689ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
69882024-10-01T02:38:11.691ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69892024-10-01T02:38:11.691ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
69902024-10-01T02:38:11.691ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
69912024-10-01T02:38:11.694ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
69922024-10-01T02:38:11.694ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
69932024-10-01T02:38:11.694ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
69942024-10-01T02:38:11.694ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
69952024-10-01T02:38:11.694ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
69962024-10-01T02:38:11.696ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = bc7b49a6-c38c-499f-983e-184e2c58fa04 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
69972024-10-01T02:38:11.696ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
69982024-10-01T02:38:11.696ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-10-01 02:33:12.369795 UTC dns_group = internal generation = 1
69992024-10-01T02:38:11.696ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 203.636623ms iteration = 7 status = {"generation":1}
70002024-10-01T02:38:11.697ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
70012024-10-01T02:38:11.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
70022024-10-01T02:38:11.698ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
70032024-10-01T02:38:11.698ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
70042024-10-01T02:38:11.700ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
70052024-10-01T02:38:11.700ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
70062024-10-01T02:38:11.701ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70072024-10-01T02:38:11.705ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
70082024-10-01T02:38:11.705ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
70092024-10-01T02:38:11.706ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
70102024-10-01T02:38:11.707ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
70112024-10-01T02:38:11.707ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
70122024-10-01T02:38:11.707ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70132024-10-01T02:38:11.708ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
70142024-10-01T02:38:11.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
70152024-10-01T02:38:11.709ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
70162024-10-01T02:38:11.709ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
70172024-10-01T02:38:11.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
70182024-10-01T02:38:11.710ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
70192024-10-01T02:38:11.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
70202024-10-01T02:38:11.711ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70212024-10-01T02:38:11.711ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70222024-10-01T02:38:11.713ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
70232024-10-01T02:38:11.713ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
70242024-10-01T02:38:11.713ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
70252024-10-01T02:38:11.715ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
70262024-10-01T02:38:11.715ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
70272024-10-01T02:38:11.715ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
70282024-10-01T02:38:11.719ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 226.935023ms iteration = 13 status = {"physical_disks_added":0}
70292024-10-01T02:38:11.721ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
70302024-10-01T02:38:11.721ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
70312024-10-01T02:38:11.722ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
70322024-10-01T02:38:11.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
70332024-10-01T02:38:11.723ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
70342024-10-01T02:38:11.723ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 230.817148ms iteration = 6 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
70352024-10-01T02:38:11.724ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
70362024-10-01T02:38:11.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
70372024-10-01T02:38:11.726ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
70382024-10-01T02:38:11.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
70392024-10-01T02:38:11.774ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
70402024-10-01T02:38:11.785ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1059 zone_address = fd00:1122:3344:101::2
70412024-10-01T02:38:11.785ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
70422024-10-01T02:38:11.785ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "5bb85f88-3733-427b-9bcb-552c2e3bb96d", "content-length": "26", "date": "Tue, 01 Oct 2024 02:38:11 GMT"} })
70432024-10-01T02:38:11.785ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1064 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
70442024-10-01T02:38:11.787ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
70452024-10-01T02:38:11.850ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1059 zone_address = fd00:1122:3344:101::2
70462024-10-01T02:38:11.850ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
70472024-10-01T02:38:11.851ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "65baaffc-3b89-49e8-92e6-9e50c63318e4", "content-length": "26", "date": "Tue, 01 Oct 2024 02:38:11 GMT"} })
70482024-10-01T02:38:11.851ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1064 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
70492024-10-01T02:38:11.852ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
70502024-10-01T02:38:11.899ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1059 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd zone_address = fd00:1122:3344:101::2
70512024-10-01T02:38:11.899ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
70522024-10-01T02:38:11.899ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "5ffdc06f-c7e4-4355-a27a-334973f9c017", "content-length": "26", "date": "Tue, 01 Oct 2024 02:38:11 GMT"} })
70532024-10-01T02:38:11.899ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1064 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
70542024-10-01T02:38:11.901ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd
70552024-10-01T02:38:12.040ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
70562024-10-01T02:38:12.041ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "08edd721-9d71-42ae-8acc-95dc64658046", "date": "Tue, 01 Oct 2024 02:38:11 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
70572024-10-01T02:38:12.041ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
70582024-10-01T02:38:12.043ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "40eb887e-2cf6-46f3-94ce-dafbfad3c931", "date": "Tue, 01 Oct 2024 02:38:11 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
70592024-10-01T02:38:12.043ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
70602024-10-01T02:38:12.044ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
70612024-10-01T02:38:12.044ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 552.264324ms iteration = 8 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
70622024-10-01T02:38:12.063ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
70632024-10-01T02:38:12.063ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "a4d63860-8601-43e8-b938-1c841265b1f8", "content-length": "372", "date": "Tue, 01 Oct 2024 02:38:11 GMT"} })
70642024-10-01T02:38:12.063ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
70652024-10-01T02:38:12.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
70662024-10-01T02:38:12.117ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
70672024-10-01T02:38:12.117ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "8c290063-ffaa-489b-8550-2680c313c108", "content-length": "691", "date": "Tue, 01 Oct 2024 02:38:11 GMT"} })
70682024-10-01T02:38:12.117ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
70692024-10-01T02:38:12.117ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
70702024-10-01T02:38:12.117ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
70712024-10-01T02:38:12.119ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 627.223811ms iteration = 11 status = {}
70722024-10-01T02:38:12.119ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
70732024-10-01T02:38:12.119ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
70742024-10-01T02:38:12.120ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
70752024-10-01T02:38:12.120ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
70762024-10-01T02:38:12.121ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
70772024-10-01T02:38:12.121ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
70782024-10-01T02:38:12.123ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
70792024-10-01T02:38:12.123ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
70802024-10-01T02:38:12.123ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
70812024-10-01T02:38:12.123ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
70822024-10-01T02:38:12.124ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70832024-10-01T02:38:12.126ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
70842024-10-01T02:38:12.126ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "68afde62-c7a4-4708-95d1-5e671e67f8c8", "date": "Tue, 01 Oct 2024 02:38:11 GMT"} })
70852024-10-01T02:38:12.128ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 635.315116ms iteration = 12 status = {}
70862024-10-01T02:38:12.128ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
70872024-10-01T02:38:12.128ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
70882024-10-01T02:38:12.128ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
70892024-10-01T02:38:12.129ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
70902024-10-01T02:38:12.129ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
70912024-10-01T02:38:12.130ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
70922024-10-01T02:38:12.131ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
70932024-10-01T02:38:12.132ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70942024-10-01T02:38:12.134ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
70952024-10-01T02:38:12.135ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 642.872823ms iteration = 11 status = {}
70962024-10-01T02:38:12.136ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
70972024-10-01T02:38:12.136ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
70982024-10-01T02:38:12.136ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
70992024-10-01T02:38:12.144ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {Name("external-dns"): [NetworkInterface { id: 498a9376-2ad6-4307-b191-e6d73cf2f1a4, kind: Service { id: 0a1ed896-5078-4267-b636-10151376f015 }, name: Name("external-dns-0a1ed896-5078-4267-b636-10151376f015"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 226, 149])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e4ffe935-3383-46e7-947f-e87df509f06f, kind: Service { id: eb937866-c779-4a9e-aec4-cc18302d4ce1 }, name: Name("external-dns-eb937866-c779-4a9e-aec4-cc18302d4ce1"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 254, 225])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("nexus"): [NetworkInterface { id: 611bfb6e-9731-4e0b-9af8-03e07b661aa3, kind: Service { id: 772acfa5-ee20-4a17-a053-c207ffa50ed6 }, name: Name("nexus-772acfa5-ee20-4a17-a053-c207ffa50ed6"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 139, 222])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 98b85cfc-ac80-4175-9f04-dd15c9b20d24, kind: Service { id: 3dfd7033-71d8-4eb9-bb97-49dae3b5cd35 }, name: Name("nexus-3dfd7033-71d8-4eb9-bb97-49dae3b5cd35"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 167, 29])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a840a1d8-f258-45fe-96a0-7b8383461d51, kind: Service { id: e9e4c757-e076-4386-92e2-8217b8bb307d }, name: Name("nexus-e9e4c757-e076-4386-92e2-8217b8bb307d"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 176, 241])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })], Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })]} vpc_interfaces = {}
71002024-10-01T02:38:12.144ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
71012024-10-01T02:38:12.144ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
71022024-10-01T02:38:12.145ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71032024-10-01T02:38:12.147ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
71042024-10-01T02:38:12.147ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
71052024-10-01T02:38:12.147ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
71062024-10-01T02:38:12.149ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
71072024-10-01T02:38:12.149ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 498a9376-2ad6-4307-b191-e6d73cf2f1a4, kind: Service { id: 0a1ed896-5078-4267-b636-10151376f015 }, name: Name("external-dns-0a1ed896-5078-4267-b636-10151376f015"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 226, 149])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e4ffe935-3383-46e7-947f-e87df509f06f, kind: Service { id: eb937866-c779-4a9e-aec4-cc18302d4ce1 }, name: Name("external-dns-eb937866-c779-4a9e-aec4-cc18302d4ce1"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 254, 225])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 611bfb6e-9731-4e0b-9af8-03e07b661aa3, kind: Service { id: 772acfa5-ee20-4a17-a053-c207ffa50ed6 }, name: Name("nexus-772acfa5-ee20-4a17-a053-c207ffa50ed6"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 139, 222])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 98b85cfc-ac80-4175-9f04-dd15c9b20d24, kind: Service { id: 3dfd7033-71d8-4eb9-bb97-49dae3b5cd35 }, name: Name("nexus-3dfd7033-71d8-4eb9-bb97-49dae3b5cd35"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 167, 29])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a840a1d8-f258-45fe-96a0-7b8383461d51, kind: Service { id: e9e4c757-e076-4386-92e2-8217b8bb307d }, name: Name("nexus-e9e4c757-e076-4386-92e2-8217b8bb307d"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 176, 241])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
71082024-10-01T02:38:12.149ZDEBGnexus (service-firewall-rule-progator): resolved 2 rules for sleds background_task = service_firewall_rule_propagation
71092024-10-01T02:38:12.175ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
71102024-10-01T02:38:12.175ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "3136ba10-62d9-4bd8-a763-6d8b9cdf3325", "content-length": "2", "date": "Tue, 01 Oct 2024 02:38:12 GMT"} })
71112024-10-01T02:38:12.176ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
71122024-10-01T02:38:12.177ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
71132024-10-01T02:38:12.178ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 686.017945ms iteration = 11 status = null
71142024-10-01T02:38:12.204ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = [Sled { identity: SledIdentity { id: 2a571ec0-85a3-450e-88fc-680c13ffa211, time_created: 2024-10-01T02:33:11.506220Z, time_modified: 2024-10-01T02:33:11.506220Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: 52547763-7759-42e1-81a9-8b833f59f5dd, is_scrimlet: true, serial_number: "buskin", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
71152024-10-01T02:38:12.204ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
71162024-10-01T02:38:12.204ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
71172024-10-01T02:38:12.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
71182024-10-01T02:38:12.206ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
71192024-10-01T02:38:12.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
71202024-10-01T02:38:12.207ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71212024-10-01T02:38:12.210ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Sled { parent: Fleet, key: 2a571ec0-85a3-450e-88fc-680c13ffa211, lookup_type: ById(2a571ec0-85a3-450e-88fc-680c13ffa211) } result = Ok(())
71222024-10-01T02:38:12.253ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
71232024-10-01T02:38:12.253ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "73728cbf-93db-4a4a-a757-81753fb508a8", "date": "Tue, 01 Oct 2024 02:38:11 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
71242024-10-01T02:38:12.253ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
71252024-10-01T02:38:12.255ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "9bbf1288-3e2a-4b1b-ad9b-a26e4856ca0d", "date": "Tue, 01 Oct 2024 02:38:11 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
71262024-10-01T02:38:12.255ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
71272024-10-01T02:38:12.256ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "55a50f28-0e14-4c35-9175-c7e7061f64ae", "date": "Tue, 01 Oct 2024 02:38:11 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
71282024-10-01T02:38:12.256ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
71292024-10-01T02:38:12.258ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
71302024-10-01T02:38:12.258ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 766.457424ms iteration = 8 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
71312024-10-01T02:38:12.281ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
71322024-10-01T02:38:12.281ZDEBGnexus (service-firewall-rule-progator): client request SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = service_firewall_rule_propagation body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
71332024-10-01T02:38:12.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
71342024-10-01T02:38:12.282ZDEBGnexus (service-firewall-rule-progator): client response SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = service_firewall_rule_propagation result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "a7a85127-0774-4c79-a7c3-35dcce6c162a", "date": "Tue, 01 Oct 2024 02:38:11 GMT"} })
71352024-10-01T02:38:12.283ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 1 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
71362024-10-01T02:38:12.283ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 790.145751ms
71372024-10-01T02:38:12.283ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 790.165262ms iteration = 2 status = {}
71382024-10-01T02:38:12.283ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 58c2bb06-eaf4-47b5-aefe-83ea06db2406, rack_id: 52547763-7759-42e1-81a9-8b833f59f5dd, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(57ef3335-befd-4872-b57f-5c2571dcca50) } rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd switch_location = Switch0
71392024-10-01T02:38:12.283ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
71402024-10-01T02:38:12.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
71412024-10-01T02:38:12.292ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
71422024-10-01T02:38:12.292ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "f5cf34a3-cd14-442f-a9ee-f004d77c8c13", "content-length": "121", "date": "Tue, 01 Oct 2024 02:38:12 GMT"} })
71432024-10-01T02:38:12.292ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
71442024-10-01T02:38:12.292ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 57ef3335-befd-4872-b57f-5c2571dcca50
71452024-10-01T02:38:12.292ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
71462024-10-01T02:38:12.292ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
71472024-10-01T02:38:12.292ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd routes = {}
71482024-10-01T02:38:12.292ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd routes = {}
71492024-10-01T02:38:12.292ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd
71502024-10-01T02:38:12.292ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
71512024-10-01T02:38:12.292ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
71522024-10-01T02:38:12.294ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
71532024-10-01T02:38:12.295ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "3058f4c3-238a-424a-a27b-bc447699f232", "content-length": "2", "date": "Tue, 01 Oct 2024 02:38:12 GMT"} })
71542024-10-01T02:38:12.295ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
71552024-10-01T02:38:12.295ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "f716521d-8e43-4c4e-9482-7d4011a56c78", "content-length": "52", "date": "Tue, 01 Oct 2024 02:38:12 GMT"} })
71562024-10-01T02:38:12.295ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd switch_location = Switch0
71572024-10-01T02:38:12.295ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
71582024-10-01T02:38:12.386ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "3cbd132e-ce3b-4864-9236-819d6da34c82", "date": "Tue, 01 Oct 2024 02:38:12 GMT"} })
71592024-10-01T02:38:12.386ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd switch = Switch0
71602024-10-01T02:38:12.386ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
71612024-10-01T02:38:12.386ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "694e1766-ddd6-43f1-8325-baa286c5a857", "content-length": "667", "date": "Tue, 01 Oct 2024 02:38:11 GMT"} })
71622024-10-01T02:38:12.386ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
71632024-10-01T02:38:12.386ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
71642024-10-01T02:38:12.389ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
71652024-10-01T02:38:12.389ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
71662024-10-01T02:38:12.392ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
71672024-10-01T02:38:12.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
71682024-10-01T02:38:12.395ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
71692024-10-01T02:38:12.395ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
71702024-10-01T02:38:12.403ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 910.679861ms iteration = 11 status = {}
71712024-10-01T02:38:12.442ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:60878 req_id = bdaf4edc-4939-49eb-80f5-12681730d37d roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
71722024-10-01T02:38:12.442ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:60878 req_id = bdaf4edc-4939-49eb-80f5-12681730d37d resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
71732024-10-01T02:38:12.444ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2556 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:60878 req_id = bdaf4edc-4939-49eb-80f5-12681730d37d response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
71742024-10-01T02:38:13.452ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:41601
71752024-10-01T02:38:13.452ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:41601 req_id = 45ca0572-2b23-47d0-a2e6-9a702ce3e19d roles = RoleSet { roles: {} } uri = /metrics/producers
71762024-10-01T02:38:13.453ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:41601 req_id = 45ca0572-2b23-47d0-a2e6-9a702ce3e19d resource = Database result = Ok(()) uri = /metrics/producers
71772024-10-01T02:38:13.485ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 41f2943e-6041-44c9-a47a-3cf5fb012644
71782024-10-01T02:38:13.485ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:41601 req_id = 45ca0572-2b23-47d0-a2e6-9a702ce3e19d roles = RoleSet { roles: {} } uri = /metrics/producers
71792024-10-01T02:38:13.485ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:41601 req_id = 45ca0572-2b23-47d0-a2e6-9a702ce3e19d resource = Database result = Ok(()) uri = /metrics/producers
71802024-10-01T02:38:13.515ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 41f2943e-6041-44c9-a47a-3cf5fb012644 uri = http://[fd00:1122:3344:101::d]:12223/producers
71812024-10-01T02:38:13.516ZDEBGnexus: client response oximeter-collector = 41f2943e-6041-44c9-a47a-3cf5fb012644 result = Ok(Response { url: "http://[fd00:1122:3344:101::d]:12223/producers", status: 204, headers: {"x-request-id": "18372010-4e90-46fd-8d52-763bc9836524", "date": "Tue, 01 Oct 2024 02:38:13 GMT"} })
71822024-10-01T02:38:13.516ZINFOnexus: assigned collector to new producer collector_id = 41f2943e-6041-44c9-a47a-3cf5fb012644 file = nexus/src/app/oximeter.rs:125 producer_id = 0fb48756-e6d8-4a38-934b-d9ec5c59cf45
71832024-10-01T02:38:13.518ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 65338 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:41601 req_id = 45ca0572-2b23-47d0-a2e6-9a702ce3e19d response_code = 201 uri = /metrics/producers
71842024-10-01T02:38:14.899ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1148 local_addr = [fd00:1122:3344:101::c]:53319 method = GET remote_addr = [fd00:1122:3344:101::d]:65459 req_id = f4993288-76db-4d73-9b27-fa95111b1a99 response_code = 200 uri = /3dfd7033-71d8-4eb9-bb97-49dae3b5cd35
71852024-10-01T02:38:14.901ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
71862024-10-01T02:38:14.901ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
71872024-10-01T02:38:14.931ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
71882024-10-01T02:38:14.931ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:61125
71892024-10-01T02:38:14.931ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:61125 req_id = f2db7f27-b7f4-4108-bb7d-070b3ccb0e06 roles = RoleSet { roles: {} } uri = /metrics/producers
71902024-10-01T02:38:14.932ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:61125 req_id = f2db7f27-b7f4-4108-bb7d-070b3ccb0e06 resource = Database result = Ok(()) uri = /metrics/producers
71912024-10-01T02:38:14.964ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 41f2943e-6041-44c9-a47a-3cf5fb012644
71922024-10-01T02:38:14.964ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:61125 req_id = f2db7f27-b7f4-4108-bb7d-070b3ccb0e06 roles = RoleSet { roles: {} } uri = /metrics/producers
71932024-10-01T02:38:14.964ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:61125 req_id = f2db7f27-b7f4-4108-bb7d-070b3ccb0e06 resource = Database result = Ok(()) uri = /metrics/producers
71942024-10-01T02:38:14.994ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 41f2943e-6041-44c9-a47a-3cf5fb012644 uri = http://[fd00:1122:3344:101::d]:12223/producers
71952024-10-01T02:38:14.994ZDEBGnexus: client response oximeter-collector = 41f2943e-6041-44c9-a47a-3cf5fb012644 result = Ok(Response { url: "http://[fd00:1122:3344:101::d]:12223/producers", status: 204, headers: {"x-request-id": "359d255a-f94c-4811-9bb1-7a5455d6c863", "date": "Tue, 01 Oct 2024 02:38:14 GMT"} })
71962024-10-01T02:38:14.994ZINFOnexus: assigned collector to new producer collector_id = 41f2943e-6041-44c9-a47a-3cf5fb012644 file = nexus/src/app/oximeter.rs:125 producer_id = 3dfd7033-71d8-4eb9-bb97-49dae3b5cd35
71972024-10-01T02:38:14.995ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 63619 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:61125 req_id = f2db7f27-b7f4-4108-bb7d-070b3ccb0e06 response_code = 201 uri = /metrics/producers
71982024-10-01T02:38:14.995ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "f2db7f27-b7f4-4108-bb7d-070b3ccb0e06", "content-length": "41", "date": "Tue, 01 Oct 2024 02:38:14 GMT"} })
71992024-10-01T02:38:14.997ZDEBGnexus (producer-registration-task): registered with nexus successfully
72002024-10-01T02:38:14.997ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
72012024-10-01T02:38:17.617ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:52025
72022024-10-01T02:38:17.617ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:52025 req_id = b3e23c1a-2333-4e19-9782-c908cfb77497 roles = RoleSet { roles: {} } uri = /metrics/producers
72032024-10-01T02:38:17.618ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:52025 req_id = b3e23c1a-2333-4e19-9782-c908cfb77497 resource = Database result = Ok(()) uri = /metrics/producers
72042024-10-01T02:38:17.650ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 41f2943e-6041-44c9-a47a-3cf5fb012644
72052024-10-01T02:38:17.650ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:52025 req_id = b3e23c1a-2333-4e19-9782-c908cfb77497 roles = RoleSet { roles: {} } uri = /metrics/producers
72062024-10-01T02:38:17.651ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:52025 req_id = b3e23c1a-2333-4e19-9782-c908cfb77497 resource = Database result = Ok(()) uri = /metrics/producers
72072024-10-01T02:38:17.685ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 41f2943e-6041-44c9-a47a-3cf5fb012644 uri = http://[fd00:1122:3344:101::d]:12223/producers
72082024-10-01T02:38:17.685ZDEBGnexus: client response oximeter-collector = 41f2943e-6041-44c9-a47a-3cf5fb012644 result = Ok(Response { url: "http://[fd00:1122:3344:101::d]:12223/producers", status: 204, headers: {"x-request-id": "eac69430-3f1c-43b8-b489-807f7afbddf9", "date": "Tue, 01 Oct 2024 02:38:17 GMT"} })
72092024-10-01T02:38:17.685ZINFOnexus: assigned collector to new producer collector_id = 41f2943e-6041-44c9-a47a-3cf5fb012644 file = nexus/src/app/oximeter.rs:125 producer_id = d6787ad6-35ff-481f-bec7-5f0d93835d2a
72102024-10-01T02:38:17.687ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 69732 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:52025 req_id = b3e23c1a-2333-4e19-9782-c908cfb77497 response_code = 201 uri = /metrics/producers
72112024-10-01T02:38:21.491ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 32 reason = Timeout
72122024-10-01T02:38:21.491ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
72132024-10-01T02:38:21.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
72142024-10-01T02:38:21.493ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72152024-10-01T02:38:21.493ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 32 reason = Timeout
72162024-10-01T02:38:21.493ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
72172024-10-01T02:38:21.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
72182024-10-01T02:38:21.495ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
72192024-10-01T02:38:21.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
72202024-10-01T02:38:21.496ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
72212024-10-01T02:38:21.496ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
72222024-10-01T02:38:21.496ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
72232024-10-01T02:38:21.497ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.202381ms iteration = 32 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
72242024-10-01T02:38:21.498ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
72252024-10-01T02:38:21.498ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
72262024-10-01T02:38:21.500ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72272024-10-01T02:38:21.502ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8f598f5c-ad31-4712-b43f-7ac75a933d07, lookup_type: ById(8f598f5c-ad31-4712-b43f-7ac75a933d07) } result = Ok(())
72282024-10-01T02:38:21.502ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
72292024-10-01T02:38:21.502ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
72302024-10-01T02:38:21.515ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 original_time_created = 2024-10-01 02:32:51.153042 UTC target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 time_created = 2024-10-01 02:32:51.153042 UTC
72312024-10-01T02:38:21.515ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.802289ms iteration = 32 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8f598f5c-ad31-4712-b43f-7ac75a933d07","time_created":"2024-10-01T02:32:51.153042Z"}
72322024-10-01T02:38:22.450ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:56039
72332024-10-01T02:38:22.450ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:56039 req_id = b27b874d-4b48-4a4e-8fb8-c53eee338ff5 roles = RoleSet { roles: {} } uri = /metrics/producers
72342024-10-01T02:38:22.450ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:56039 req_id = b27b874d-4b48-4a4e-8fb8-c53eee338ff5 resource = Database result = Ok(()) uri = /metrics/producers
72352024-10-01T02:38:22.484ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 41f2943e-6041-44c9-a47a-3cf5fb012644
72362024-10-01T02:38:22.484ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:56039 req_id = b27b874d-4b48-4a4e-8fb8-c53eee338ff5 roles = RoleSet { roles: {} } uri = /metrics/producers
72372024-10-01T02:38:22.484ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:56039 req_id = b27b874d-4b48-4a4e-8fb8-c53eee338ff5 resource = Database result = Ok(()) uri = /metrics/producers
72382024-10-01T02:38:22.489ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 41f2943e-6041-44c9-a47a-3cf5fb012644 uri = http://[fd00:1122:3344:101::d]:12223/producers
72392024-10-01T02:38:22.490ZDEBGnexus: client response oximeter-collector = 41f2943e-6041-44c9-a47a-3cf5fb012644 result = Ok(Response { url: "http://[fd00:1122:3344:101::d]:12223/producers", status: 204, headers: {"x-request-id": "a88aee5e-d629-4574-909c-9619be2a8775", "date": "Tue, 01 Oct 2024 02:38:22 GMT"} })
72402024-10-01T02:38:22.490ZINFOnexus: assigned collector to new producer collector_id = 41f2943e-6041-44c9-a47a-3cf5fb012644 file = nexus/src/app/oximeter.rs:125 producer_id = 2a571ec0-85a3-450e-88fc-680c13ffa211
72412024-10-01T02:38:22.492ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 41560 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:56039 req_id = b27b874d-4b48-4a4e-8fb8-c53eee338ff5 response_code = 201 uri = /metrics/producers
72422024-10-01T02:38:22.673ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:55872
72432024-10-01T02:38:22.673ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:55872 req_id = 8718ec76-db0d-4edb-92f9-0e04b45d1b15 roles = RoleSet { roles: {} } uri = /metrics/producers
72442024-10-01T02:38:22.673ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:55872 req_id = 8718ec76-db0d-4edb-92f9-0e04b45d1b15 resource = Database result = Ok(()) uri = /metrics/producers
72452024-10-01T02:38:22.706ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 41f2943e-6041-44c9-a47a-3cf5fb012644
72462024-10-01T02:38:22.706ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:55872 req_id = 8718ec76-db0d-4edb-92f9-0e04b45d1b15 roles = RoleSet { roles: {} } uri = /metrics/producers
72472024-10-01T02:38:22.706ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:55872 req_id = 8718ec76-db0d-4edb-92f9-0e04b45d1b15 resource = Database result = Ok(()) uri = /metrics/producers
72482024-10-01T02:38:22.711ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 41f2943e-6041-44c9-a47a-3cf5fb012644 uri = http://[fd00:1122:3344:101::d]:12223/producers
72492024-10-01T02:38:22.712ZDEBGnexus: client response oximeter-collector = 41f2943e-6041-44c9-a47a-3cf5fb012644 result = Ok(Response { url: "http://[fd00:1122:3344:101::d]:12223/producers", status: 204, headers: {"x-request-id": "70b629ec-0f67-4f0e-a661-22ce4d6bdeb7", "date": "Tue, 01 Oct 2024 02:38:22 GMT"} })
72502024-10-01T02:38:22.712ZINFOnexus: assigned collector to new producer collector_id = 41f2943e-6041-44c9-a47a-3cf5fb012644 file = nexus/src/app/oximeter.rs:125 producer_id = 4fd91d04-882e-49df-98b0-1430a0f50382
72512024-10-01T02:38:22.712ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 39797 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:55872 req_id = 8718ec76-db0d-4edb-92f9-0e04b45d1b15 response_code = 201 uri = /metrics/producers
72522024-10-01T02:38:24.996ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1239 local_addr = [fd00:1122:3344:101::c]:53319 method = GET remote_addr = [fd00:1122:3344:101::d]:65459 req_id = 1ec62a9f-1841-4d3e-98e6-bf07735d0ee8 response_code = 200 uri = /3dfd7033-71d8-4eb9-bb97-49dae3b5cd35
72532024-10-01T02:38:25.153ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:41066
72542024-10-01T02:38:25.153ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:41066 req_id = 797644c8-db8b-420a-822f-769ed87f402c roles = RoleSet { roles: {} } uri = /metrics/producers
72552024-10-01T02:38:25.154ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:41066 req_id = 797644c8-db8b-420a-822f-769ed87f402c resource = Database result = Ok(()) uri = /metrics/producers
72562024-10-01T02:38:25.186ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 41f2943e-6041-44c9-a47a-3cf5fb012644
72572024-10-01T02:38:25.186ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:41066 req_id = 797644c8-db8b-420a-822f-769ed87f402c roles = RoleSet { roles: {} } uri = /metrics/producers
72582024-10-01T02:38:25.187ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:41066 req_id = 797644c8-db8b-420a-822f-769ed87f402c resource = Database result = Ok(()) uri = /metrics/producers
72592024-10-01T02:38:25.219ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 41f2943e-6041-44c9-a47a-3cf5fb012644 uri = http://[fd00:1122:3344:101::d]:12223/producers
72602024-10-01T02:38:25.219ZDEBGnexus: client response oximeter-collector = 41f2943e-6041-44c9-a47a-3cf5fb012644 result = Ok(Response { url: "http://[fd00:1122:3344:101::d]:12223/producers", status: 204, headers: {"x-request-id": "a3a9a225-5658-4bde-9454-2af732a17012", "date": "Tue, 01 Oct 2024 02:38:25 GMT"} })
72612024-10-01T02:38:25.219ZINFOnexus: assigned collector to new producer collector_id = 41f2943e-6041-44c9-a47a-3cf5fb012644 file = nexus/src/app/oximeter.rs:125 producer_id = 4de8ea2f-2b9b-467c-9e71-58559e244afd
72622024-10-01T02:38:25.220ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 66421 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:41066 req_id = 797644c8-db8b-420a-822f-769ed87f402c response_code = 201 uri = /metrics/producers
72632024-10-01T02:38:29.303ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:43009
72642024-10-01T02:38:29.303ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:43009 req_id = 83b39f1b-cc6e-4c62-ad74-2b1e53c0ee3f roles = RoleSet { roles: {} } uri = /metrics/producers
72652024-10-01T02:38:29.303ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:43009 req_id = 83b39f1b-cc6e-4c62-ad74-2b1e53c0ee3f resource = Database result = Ok(()) uri = /metrics/producers
72662024-10-01T02:38:29.336ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 41f2943e-6041-44c9-a47a-3cf5fb012644
72672024-10-01T02:38:29.336ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:43009 req_id = 83b39f1b-cc6e-4c62-ad74-2b1e53c0ee3f roles = RoleSet { roles: {} } uri = /metrics/producers
72682024-10-01T02:38:29.336ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:43009 req_id = 83b39f1b-cc6e-4c62-ad74-2b1e53c0ee3f resource = Database result = Ok(()) uri = /metrics/producers
72692024-10-01T02:38:29.368ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 41f2943e-6041-44c9-a47a-3cf5fb012644 uri = http://[fd00:1122:3344:101::d]:12223/producers
72702024-10-01T02:38:29.369ZDEBGnexus: client response oximeter-collector = 41f2943e-6041-44c9-a47a-3cf5fb012644 result = Ok(Response { url: "http://[fd00:1122:3344:101::d]:12223/producers", status: 204, headers: {"x-request-id": "2ef8333c-06e7-4750-ab7b-79174282ad69", "date": "Tue, 01 Oct 2024 02:38:29 GMT"} })
72712024-10-01T02:38:29.369ZINFOnexus: assigned collector to new producer collector_id = 41f2943e-6041-44c9-a47a-3cf5fb012644 file = nexus/src/app/oximeter.rs:125 producer_id = be900b2d-36c9-44e6-addb-3422c3cbaaec
72722024-10-01T02:38:29.371ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 68015 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:43009 req_id = 83b39f1b-cc6e-4c62-ad74-2b1e53c0ee3f response_code = 201 uri = /metrics/producers
72732024-10-01T02:38:31.492ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 33 reason = Timeout
72742024-10-01T02:38:31.492ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
72752024-10-01T02:38:31.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
72762024-10-01T02:38:31.492ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 33 reason = Timeout
72772024-10-01T02:38:31.492ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
72782024-10-01T02:38:31.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
72792024-10-01T02:38:31.494ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72802024-10-01T02:38:31.496ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
72812024-10-01T02:38:31.496ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
72822024-10-01T02:38:31.496ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
72832024-10-01T02:38:31.497ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
72842024-10-01T02:38:31.497ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
72852024-10-01T02:38:31.499ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72862024-10-01T02:38:31.501ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8f598f5c-ad31-4712-b43f-7ac75a933d07, lookup_type: ById(8f598f5c-ad31-4712-b43f-7ac75a933d07) } result = Ok(())
72872024-10-01T02:38:31.501ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
72882024-10-01T02:38:31.501ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
72892024-10-01T02:38:31.510ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 original_time_created = 2024-10-01 02:32:51.153042 UTC target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 time_created = 2024-10-01 02:32:51.153042 UTC
72902024-10-01T02:38:31.510ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 17.993221ms iteration = 33 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8f598f5c-ad31-4712-b43f-7ac75a933d07","time_created":"2024-10-01T02:32:51.153042Z"}
72912024-10-01T02:38:31.520ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
72922024-10-01T02:38:31.521ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
72932024-10-01T02:38:31.522ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 29.505475ms iteration = 33 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
72942024-10-01T02:38:34.996ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1220 local_addr = [fd00:1122:3344:101::c]:53319 method = GET remote_addr = [fd00:1122:3344:101::d]:65459 req_id = 055ea9f7-afa4-44ea-8698-bd06421ce3a5 response_code = 200 uri = /3dfd7033-71d8-4eb9-bb97-49dae3b5cd35
72952024-10-01T02:38:41.492ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 34 reason = Timeout
72962024-10-01T02:38:41.492ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 12 reason = Timeout
72972024-10-01T02:38:41.492ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
72982024-10-01T02:38:41.492ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 12 reason = Timeout
72992024-10-01T02:38:41.492ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
73002024-10-01T02:38:41.492ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
73012024-10-01T02:38:41.492ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 12 reason = Timeout
73022024-10-01T02:38:41.492ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
73032024-10-01T02:38:41.492ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 12 reason = Timeout
73042024-10-01T02:38:41.492ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 12 reason = Timeout
73052024-10-01T02:38:41.492ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
73062024-10-01T02:38:41.492ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
73072024-10-01T02:38:41.492ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 12 reason = Timeout
73082024-10-01T02:38:41.492ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 12 reason = Timeout
73092024-10-01T02:38:41.492ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
73102024-10-01T02:38:41.492ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 14 reason = Timeout
73112024-10-01T02:38:41.492ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
73122024-10-01T02:38:41.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73132024-10-01T02:38:41.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
73142024-10-01T02:38:41.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
73152024-10-01T02:38:41.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
73162024-10-01T02:38:41.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
73172024-10-01T02:38:41.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
73182024-10-01T02:38:41.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
73192024-10-01T02:38:41.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
73202024-10-01T02:38:41.493ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 34 reason = Timeout
73212024-10-01T02:38:41.493ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 12 reason = Timeout
73222024-10-01T02:38:41.493ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
73232024-10-01T02:38:41.493ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
73242024-10-01T02:38:41.493ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 12 reason = Timeout
73252024-10-01T02:38:41.493ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
73262024-10-01T02:38:41.493ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 12 reason = Timeout
73272024-10-01T02:38:41.493ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
73282024-10-01T02:38:41.493ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
73292024-10-01T02:38:41.493ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 12 reason = Timeout
73302024-10-01T02:38:41.493ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
73312024-10-01T02:38:41.493ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 13 reason = Timeout
73322024-10-01T02:38:41.493ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
73332024-10-01T02:38:41.493ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 12 reason = Timeout
73342024-10-01T02:38:41.493ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
73352024-10-01T02:38:41.493ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 12 reason = Timeout
73362024-10-01T02:38:41.493ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
73372024-10-01T02:38:41.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
73382024-10-01T02:38:41.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
73392024-10-01T02:38:41.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
73402024-10-01T02:38:41.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
73412024-10-01T02:38:41.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
73422024-10-01T02:38:41.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
73432024-10-01T02:38:41.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
73442024-10-01T02:38:41.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
73452024-10-01T02:38:41.494ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73462024-10-01T02:38:41.494ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73472024-10-01T02:38:41.495ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.211194ms iteration = 12 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
73482024-10-01T02:38:41.495ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73492024-10-01T02:38:41.496ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1574, tv_nsec: 937512696 } })
73502024-10-01T02:38:41.497ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1051
73512024-10-01T02:38:41.498ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
73522024-10-01T02:38:41.498ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
73532024-10-01T02:38:41.498ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73542024-10-01T02:38:41.498ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
73552024-10-01T02:38:41.498ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73562024-10-01T02:38:41.498ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
73572024-10-01T02:38:41.499ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
73582024-10-01T02:38:41.499ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
73592024-10-01T02:38:41.499ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
73602024-10-01T02:38:41.500ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1574, tv_nsec: 941096716 } })
73612024-10-01T02:38:41.500ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1051
73622024-10-01T02:38:41.500ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73632024-10-01T02:38:41.502ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
73642024-10-01T02:38:41.502ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
73652024-10-01T02:38:41.502ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
73662024-10-01T02:38:41.504ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73672024-10-01T02:38:41.504ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73682024-10-01T02:38:41.506ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
73692024-10-01T02:38:41.506ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
73702024-10-01T02:38:41.506ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
73712024-10-01T02:38:41.506ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
73722024-10-01T02:38:41.506ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
73732024-10-01T02:38:41.506ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
73742024-10-01T02:38:41.506ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
73752024-10-01T02:38:41.506ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
73762024-10-01T02:38:41.508ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73772024-10-01T02:38:41.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73782024-10-01T02:38:41.512ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1574, tv_nsec: 952953225 } })
73792024-10-01T02:38:41.512ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1051 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd
73802024-10-01T02:38:41.516ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73812024-10-01T02:38:41.517ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
73822024-10-01T02:38:41.517ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
73832024-10-01T02:38:41.519ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73842024-10-01T02:38:41.521ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8f598f5c-ad31-4712-b43f-7ac75a933d07, lookup_type: ById(8f598f5c-ad31-4712-b43f-7ac75a933d07) } result = Ok(())
73852024-10-01T02:38:41.521ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73862024-10-01T02:38:41.521ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73872024-10-01T02:38:41.521ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
73882024-10-01T02:38:41.521ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
73892024-10-01T02:38:41.522ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
73902024-10-01T02:38:41.537ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 original_time_created = 2024-10-01 02:32:51.153042 UTC target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 time_created = 2024-10-01 02:32:51.153042 UTC
73912024-10-01T02:38:41.537ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 45.470192ms iteration = 34 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8f598f5c-ad31-4712-b43f-7ac75a933d07","time_created":"2024-10-01T02:32:51.153042Z"}
73922024-10-01T02:38:41.538ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 45.430931ms iteration = 12 status = {"errors":[],"records_set_to_done":[]}
73932024-10-01T02:38:41.544ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
73942024-10-01T02:38:41.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
73952024-10-01T02:38:41.545ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
73962024-10-01T02:38:41.545ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
73972024-10-01T02:38:41.545ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
73982024-10-01T02:38:41.545ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
73992024-10-01T02:38:41.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
74002024-10-01T02:38:41.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
74012024-10-01T02:38:41.548ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
74022024-10-01T02:38:41.548ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
74032024-10-01T02:38:41.549ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74042024-10-01T02:38:41.550ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
74052024-10-01T02:38:41.550ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
74062024-10-01T02:38:41.550ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
74072024-10-01T02:38:41.551ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
74082024-10-01T02:38:41.551ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
74092024-10-01T02:38:41.551ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
74102024-10-01T02:38:41.551ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
74112024-10-01T02:38:41.553ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74122024-10-01T02:38:41.553ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
74132024-10-01T02:38:41.553ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
74142024-10-01T02:38:41.554ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 61.139755ms iteration = 12 status = {"errors":[],"garbage_collect_requested":[]}
74152024-10-01T02:38:41.555ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 2a571ec0-85a3-450e-88fc-680c13ffa211, lookup_type: ById(2a571ec0-85a3-450e-88fc-680c13ffa211) } result = Ok(())
74162024-10-01T02:38:41.555ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
74172024-10-01T02:38:41.556ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
74182024-10-01T02:38:41.557ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 65.818953ms iteration = 12 status = 0
74192024-10-01T02:38:41.560ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
74202024-10-01T02:38:41.560ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 66.949462ms iteration = 12 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
74212024-10-01T02:38:41.578ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 85.980711ms iteration = 12 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
74222024-10-01T02:38:41.579ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
74232024-10-01T02:38:41.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
74242024-10-01T02:38:41.583ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 90.297943ms iteration = 34 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
74252024-10-01T02:38:41.584ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
74262024-10-01T02:38:41.584ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
74272024-10-01T02:38:41.584ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
74282024-10-01T02:38:41.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
74292024-10-01T02:38:41.590ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 96.697491ms iteration = 12 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
74302024-10-01T02:38:41.596ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1059 zone_address = fd00:1122:3344:101::2
74312024-10-01T02:38:41.596ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
74322024-10-01T02:38:41.596ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "56d2152f-69be-482c-aaec-ee1df79dce6f", "content-length": "26", "date": "Tue, 01 Oct 2024 02:38:41 GMT"} })
74332024-10-01T02:38:41.596ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1064 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
74342024-10-01T02:38:41.598ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
74352024-10-01T02:38:41.610ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
74362024-10-01T02:38:41.610ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 117.097742ms iteration = 12 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
74372024-10-01T02:38:41.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
74382024-10-01T02:38:41.611ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
74392024-10-01T02:38:41.611ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
74402024-10-01T02:38:41.611ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 118.376713ms iteration = 12 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
74412024-10-01T02:38:41.619ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
74422024-10-01T02:38:41.619ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
74432024-10-01T02:38:41.620ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74442024-10-01T02:38:41.621ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 129.49492ms iteration = 14 status = {"physical_disks_added":0}
74452024-10-01T02:38:41.622ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
74462024-10-01T02:38:41.622ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
74472024-10-01T02:38:41.622ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
74482024-10-01T02:38:41.623ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74492024-10-01T02:38:41.625ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
74502024-10-01T02:38:41.625ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
74512024-10-01T02:38:41.625ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
74522024-10-01T02:38:41.710ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 217.930962ms iteration = 12 status = {}
74532024-10-01T02:38:41.722ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1059 zone_address = fd00:1122:3344:101::2
74542024-10-01T02:38:41.722ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
74552024-10-01T02:38:41.722ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e066418a-d655-43af-ba72-6c720e8c8a61", "content-length": "26", "date": "Tue, 01 Oct 2024 02:38:41 GMT"} })
74562024-10-01T02:38:41.722ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1064 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
74572024-10-01T02:38:41.723ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
74582024-10-01T02:38:41.755ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1059 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd zone_address = fd00:1122:3344:101::2
74592024-10-01T02:38:41.755ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
74602024-10-01T02:38:41.755ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "9c9da23b-41fc-4b21-8237-dc3cb3a3cd00", "content-length": "26", "date": "Tue, 01 Oct 2024 02:38:41 GMT"} })
74612024-10-01T02:38:41.755ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1064 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
74622024-10-01T02:38:41.757ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd
74632024-10-01T02:38:41.826ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
74642024-10-01T02:38:41.826ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "5194f79a-9874-4fd3-8f20-11619022f1be", "content-length": "2", "date": "Tue, 01 Oct 2024 02:38:41 GMT"} })
74652024-10-01T02:38:41.827ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
74662024-10-01T02:38:41.828ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
74672024-10-01T02:38:41.845ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
74682024-10-01T02:38:41.846ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "6a83407e-e4dd-406f-9064-dada719c62fe", "content-length": "372", "date": "Tue, 01 Oct 2024 02:38:41 GMT"} })
74692024-10-01T02:38:41.846ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
74702024-10-01T02:38:41.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
74712024-10-01T02:38:41.848ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 355.925725ms iteration = 12 status = null
74722024-10-01T02:38:41.849ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
74732024-10-01T02:38:41.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
74742024-10-01T02:38:41.852ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
74752024-10-01T02:38:41.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
74762024-10-01T02:38:41.964ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
74772024-10-01T02:38:41.964ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "94dd01f1-560e-4d83-8a3b-c9aba194abf6", "content-length": "691", "date": "Tue, 01 Oct 2024 02:38:41 GMT"} })
74782024-10-01T02:38:41.964ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
74792024-10-01T02:38:41.964ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
74802024-10-01T02:38:41.964ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
74812024-10-01T02:38:41.965ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 473.573325ms iteration = 12 status = {}
74822024-10-01T02:38:41.967ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
74832024-10-01T02:38:41.967ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "45f4a632-5433-413e-b660-232baae9a893", "date": "Tue, 01 Oct 2024 02:38:41 GMT"} })
74842024-10-01T02:38:41.969ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 475.700651ms iteration = 13 status = {}
74852024-10-01T02:38:42.009ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
74862024-10-01T02:38:42.009ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
74872024-10-01T02:38:42.011ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 58c2bb06-eaf4-47b5-aefe-83ea06db2406, rack_id: 52547763-7759-42e1-81a9-8b833f59f5dd, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(57ef3335-befd-4872-b57f-5c2571dcca50) } rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd switch_location = Switch0
74882024-10-01T02:38:42.012ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
74892024-10-01T02:38:42.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
74902024-10-01T02:38:42.020ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
74912024-10-01T02:38:42.020ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "ff2c5e17-ef54-4fd7-90ee-d5eba9ad923b", "content-length": "121", "date": "Tue, 01 Oct 2024 02:38:41 GMT"} })
74922024-10-01T02:38:42.020ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
74932024-10-01T02:38:42.020ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 57ef3335-befd-4872-b57f-5c2571dcca50
74942024-10-01T02:38:42.020ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
74952024-10-01T02:38:42.020ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
74962024-10-01T02:38:42.020ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd routes = {}
74972024-10-01T02:38:42.020ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd routes = {}
74982024-10-01T02:38:42.020ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd
74992024-10-01T02:38:42.020ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
75002024-10-01T02:38:42.020ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
75012024-10-01T02:38:42.022ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
75022024-10-01T02:38:42.023ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "8bf7308b-3fd4-4250-a1e4-e23e8539a524", "content-length": "2", "date": "Tue, 01 Oct 2024 02:38:41 GMT"} })
75032024-10-01T02:38:42.023ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
75042024-10-01T02:38:42.023ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "8528ca18-b015-42c7-8af2-35b798601a34", "content-length": "52", "date": "Tue, 01 Oct 2024 02:38:41 GMT"} })
75052024-10-01T02:38:42.023ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd switch_location = Switch0
75062024-10-01T02:38:42.023ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
75072024-10-01T02:38:42.117ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "f3f97869-d671-4b75-a1a3-9956a017d9bb", "date": "Tue, 01 Oct 2024 02:38:41 GMT"} })
75082024-10-01T02:38:42.117ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd switch = Switch0
75092024-10-01T02:38:42.117ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
75102024-10-01T02:38:42.117ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "7488cfab-9d74-43be-9b0b-a05f2811bdab", "content-length": "667", "date": "Tue, 01 Oct 2024 02:38:41 GMT"} })
75112024-10-01T02:38:42.118ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
75122024-10-01T02:38:42.118ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
75132024-10-01T02:38:42.121ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
75142024-10-01T02:38:42.122ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
75152024-10-01T02:38:42.124ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
75162024-10-01T02:38:42.125ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
75172024-10-01T02:38:42.126ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
75182024-10-01T02:38:42.126ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
75192024-10-01T02:38:42.133ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 641.169874ms iteration = 12 status = {}
75202024-10-01T02:38:42.475ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:60878 req_id = 632b6b2b-0130-4fc1-a5ab-a4d2c6afc5fd roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
75212024-10-01T02:38:42.475ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:60878 req_id = 632b6b2b-0130-4fc1-a5ab-a4d2c6afc5fd resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
75222024-10-01T02:38:42.478ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2758 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:60878 req_id = 632b6b2b-0130-4fc1-a5ab-a4d2c6afc5fd response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
75232024-10-01T02:38:44.996ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1310 local_addr = [fd00:1122:3344:101::c]:53319 method = GET remote_addr = [fd00:1122:3344:101::d]:65459 req_id = f6ff7b06-59bf-4a1a-8387-769d2c597be9 response_code = 200 uri = /3dfd7033-71d8-4eb9-bb97-49dae3b5cd35
75242024-10-01T02:38:51.492ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 35 reason = Timeout
75252024-10-01T02:38:51.492ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
75262024-10-01T02:38:51.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
75272024-10-01T02:38:51.492ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 35 reason = Timeout
75282024-10-01T02:38:51.492ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
75292024-10-01T02:38:51.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
75302024-10-01T02:38:51.494ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75312024-10-01T02:38:51.494ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
75322024-10-01T02:38:51.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
75332024-10-01T02:38:51.496ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.045827ms iteration = 35 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
75342024-10-01T02:38:51.496ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
75352024-10-01T02:38:51.496ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
75362024-10-01T02:38:51.496ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
75372024-10-01T02:38:51.498ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
75382024-10-01T02:38:51.498ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
75392024-10-01T02:38:51.499ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75402024-10-01T02:38:51.502ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8f598f5c-ad31-4712-b43f-7ac75a933d07, lookup_type: ById(8f598f5c-ad31-4712-b43f-7ac75a933d07) } result = Ok(())
75412024-10-01T02:38:51.502ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
75422024-10-01T02:38:51.502ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
75432024-10-01T02:38:51.508ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 original_time_created = 2024-10-01 02:32:51.153042 UTC target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 time_created = 2024-10-01 02:32:51.153042 UTC
75442024-10-01T02:38:51.508ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 16.506196ms iteration = 35 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8f598f5c-ad31-4712-b43f-7ac75a933d07","time_created":"2024-10-01T02:32:51.153042Z"}
75452024-10-01T02:38:54.996ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1120 local_addr = [fd00:1122:3344:101::c]:53319 method = GET remote_addr = [fd00:1122:3344:101::d]:65459 req_id = d0ead9ea-ee2c-4ece-83db-c3de763f64e0 response_code = 200 uri = /3dfd7033-71d8-4eb9-bb97-49dae3b5cd35
75462024-10-01T02:39:01.491ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 36 reason = Timeout
75472024-10-01T02:39:01.491ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
75482024-10-01T02:39:01.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
75492024-10-01T02:39:01.492ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 36 reason = Timeout
75502024-10-01T02:39:01.492ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
75512024-10-01T02:39:01.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
75522024-10-01T02:39:01.493ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75532024-10-01T02:39:01.494ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
75542024-10-01T02:39:01.494ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
75552024-10-01T02:39:01.496ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.323026ms iteration = 36 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
75562024-10-01T02:39:01.496ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
75572024-10-01T02:39:01.496ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
75582024-10-01T02:39:01.496ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
75592024-10-01T02:39:01.498ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
75602024-10-01T02:39:01.498ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
75612024-10-01T02:39:01.499ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75622024-10-01T02:39:01.502ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8f598f5c-ad31-4712-b43f-7ac75a933d07, lookup_type: ById(8f598f5c-ad31-4712-b43f-7ac75a933d07) } result = Ok(())
75632024-10-01T02:39:01.502ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
75642024-10-01T02:39:01.502ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
75652024-10-01T02:39:01.509ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 original_time_created = 2024-10-01 02:32:51.153042 UTC target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 time_created = 2024-10-01 02:32:51.153042 UTC
75662024-10-01T02:39:01.509ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 17.226958ms iteration = 36 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8f598f5c-ad31-4712-b43f-7ac75a933d07","time_created":"2024-10-01T02:32:51.153042Z"}
75672024-10-01T02:39:04.996ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1200 local_addr = [fd00:1122:3344:101::c]:53319 method = GET remote_addr = [fd00:1122:3344:101::d]:65459 req_id = b6175894-b229-4139-b4c3-27fc2dcdf03b response_code = 200 uri = /3dfd7033-71d8-4eb9-bb97-49dae3b5cd35
75682024-10-01T02:39:11.492ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 9 reason = Timeout
75692024-10-01T02:39:11.492ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 8 reason = Timeout
75702024-10-01T02:39:11.492ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 9 reason = Timeout
75712024-10-01T02:39:11.492ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 8 reason = Timeout
75722024-10-01T02:39:11.492ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 13 reason = Timeout
75732024-10-01T02:39:11.492ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
75742024-10-01T02:39:11.492ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
75752024-10-01T02:39:11.492ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 8 reason = Timeout
75762024-10-01T02:39:11.492ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
75772024-10-01T02:39:11.492ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 8 reason = Timeout
75782024-10-01T02:39:11.492ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
75792024-10-01T02:39:11.492ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 7 reason = Timeout
75802024-10-01T02:39:11.492ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
75812024-10-01T02:39:11.492ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
75822024-10-01T02:39:11.492ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
75832024-10-01T02:39:11.492ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 13 reason = Timeout
75842024-10-01T02:39:11.492ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
75852024-10-01T02:39:11.492ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
75862024-10-01T02:39:11.492ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 13 reason = Timeout
75872024-10-01T02:39:11.492ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 37 reason = Timeout
75882024-10-01T02:39:11.492ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 7 reason = Timeout
75892024-10-01T02:39:11.492ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 8 reason = Timeout
75902024-10-01T02:39:11.492ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-10-01 02:29:11.492772400 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
75912024-10-01T02:39:11.492ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
75922024-10-01T02:39:11.492ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
75932024-10-01T02:39:11.492ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 8 reason = Timeout
75942024-10-01T02:39:11.492ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 13 reason = Timeout
75952024-10-01T02:39:11.492ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07
75962024-10-01T02:39:11.492ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
75972024-10-01T02:39:11.492ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 13 reason = Timeout
75982024-10-01T02:39:11.492ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 14.51\u{b5}s iteration = 8 status = {"enabled":false,"target_id":"8f598f5c-ad31-4712-b43f-7ac75a933d07"}
75992024-10-01T02:39:11.492ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 15 reason = Timeout
76002024-10-01T02:39:11.492ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
76012024-10-01T02:39:11.492ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 37 reason = Timeout
76022024-10-01T02:39:11.492ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
76032024-10-01T02:39:11.492ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
76042024-10-01T02:39:11.492ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 4 reason = Timeout
76052024-10-01T02:39:11.492ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 13 reason = Timeout
76062024-10-01T02:39:11.492ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 13 reason = Timeout
76072024-10-01T02:39:11.493ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
76082024-10-01T02:39:11.493ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
76092024-10-01T02:39:11.493ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
76102024-10-01T02:39:11.493ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 13 reason = Timeout
76112024-10-01T02:39:11.493ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
76122024-10-01T02:39:11.493ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 13 reason = Timeout
76132024-10-01T02:39:11.493ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
76142024-10-01T02:39:11.493ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 7 reason = Timeout
76152024-10-01T02:39:11.493ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
76162024-10-01T02:39:11.493ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 13 reason = Timeout
76172024-10-01T02:39:11.493ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
76182024-10-01T02:39:11.493ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
76192024-10-01T02:39:11.493ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 7 reason = Timeout
76202024-10-01T02:39:11.493ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
76212024-10-01T02:39:11.493ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 14 reason = Timeout
76222024-10-01T02:39:11.493ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
76232024-10-01T02:39:11.493ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 7 reason = Timeout
76242024-10-01T02:39:11.493ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
76252024-10-01T02:39:11.493ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 13 reason = Timeout
76262024-10-01T02:39:11.493ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
76272024-10-01T02:39:11.493ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 13 reason = Timeout
76282024-10-01T02:39:11.493ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
76292024-10-01T02:39:11.493ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 13 reason = Timeout
76302024-10-01T02:39:11.493ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
76312024-10-01T02:39:11.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
76322024-10-01T02:39:11.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
76332024-10-01T02:39:11.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
76342024-10-01T02:39:11.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
76352024-10-01T02:39:11.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
76362024-10-01T02:39:11.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
76372024-10-01T02:39:11.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
76382024-10-01T02:39:11.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
76392024-10-01T02:39:11.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
76402024-10-01T02:39:11.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
76412024-10-01T02:39:11.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
76422024-10-01T02:39:11.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
76432024-10-01T02:39:11.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
76442024-10-01T02:39:11.493ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
76452024-10-01T02:39:11.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
76462024-10-01T02:39:11.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
76472024-10-01T02:39:11.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
76482024-10-01T02:39:11.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
76492024-10-01T02:39:11.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
76502024-10-01T02:39:11.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
76512024-10-01T02:39:11.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
76522024-10-01T02:39:11.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
76532024-10-01T02:39:11.493ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("1af5fb25-d768-4bc6-915c-0b4c59e1f0ef.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("293e78c2-b712-4c13-b502-e2be11a76306.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("71ea2e4f-4772-4ce7-8093-48597fd7fd92.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("71ea2e4f-4772-4ce7-8093-48597fd7fd92.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1604, tv_nsec: 934069488 } })
76542024-10-01T02:39:11.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
76552024-10-01T02:39:11.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
76562024-10-01T02:39:11.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
76572024-10-01T02:39:11.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
76582024-10-01T02:39:11.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
76592024-10-01T02:39:11.493ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
76602024-10-01T02:39:11.494ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
76612024-10-01T02:39:11.494ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
76622024-10-01T02:39:11.494ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
76632024-10-01T02:39:11.494ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
76642024-10-01T02:39:11.494ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
76652024-10-01T02:39:11.494ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("0a1ed896-5078-4267-b636-10151376f015.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("eb937866-c779-4a9e-aec4-cc18302d4ce1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("eb937866-c779-4a9e-aec4-cc18302d4ce1.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1604, tv_nsec: 935192047 } })
76662024-10-01T02:39:11.495ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76672024-10-01T02:39:11.496ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
76682024-10-01T02:39:11.496ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.538849ms iteration = 13 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
76692024-10-01T02:39:11.496ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
76702024-10-01T02:39:11.496ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
76712024-10-01T02:39:11.496ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 4.070288ms iteration = 8 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
76722024-10-01T02:39:11.496ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76732024-10-01T02:39:11.496ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
76742024-10-01T02:39:11.496ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 3.964366ms iteration = 8 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
76752024-10-01T02:39:11.497ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-10-01 02:29:11.492772400 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
76762024-10-01T02:39:11.497ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 4.635908ms iteration = 7 status = {"expiration":"2024-10-01T02:29:11.492772400Z","pruned":[]}
76772024-10-01T02:39:11.498ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1604, tv_nsec: 939224115 } })
76782024-10-01T02:39:11.498ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
76792024-10-01T02:39:11.498ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
76802024-10-01T02:39:11.498ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
76812024-10-01T02:39:11.498ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
76822024-10-01T02:39:11.498ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
76832024-10-01T02:39:11.499ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
76842024-10-01T02:39:11.499ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1051
76852024-10-01T02:39:11.500ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
76862024-10-01T02:39:11.500ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
76872024-10-01T02:39:11.501ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1604, tv_nsec: 942276906 } })
76882024-10-01T02:39:11.502ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1051
76892024-10-01T02:39:11.502ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76902024-10-01T02:39:11.503ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76912024-10-01T02:39:11.504ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76922024-10-01T02:39:11.506ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
76932024-10-01T02:39:11.506ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
76942024-10-01T02:39:11.506ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
76952024-10-01T02:39:11.507ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
76962024-10-01T02:39:11.507ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
76972024-10-01T02:39:11.507ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
76982024-10-01T02:39:11.507ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
76992024-10-01T02:39:11.507ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77002024-10-01T02:39:11.508ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 15.141353ms iteration = 7 status = {"errors":[],"found_port_ok":[]}
77012024-10-01T02:39:11.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77022024-10-01T02:39:11.509ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77032024-10-01T02:39:11.510ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77042024-10-01T02:39:11.510ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
77052024-10-01T02:39:11.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
77062024-10-01T02:39:11.511ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77072024-10-01T02:39:11.512ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
77082024-10-01T02:39:11.512ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
77092024-10-01T02:39:11.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
77102024-10-01T02:39:11.513ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
77112024-10-01T02:39:11.513ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
77122024-10-01T02:39:11.513ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
77132024-10-01T02:39:11.513ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
77142024-10-01T02:39:11.513ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
77152024-10-01T02:39:11.513ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
77162024-10-01T02:39:11.518ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77172024-10-01T02:39:11.523ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
77182024-10-01T02:39:11.523ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
77192024-10-01T02:39:11.523ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
77202024-10-01T02:39:11.525ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77212024-10-01T02:39:11.528ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
77222024-10-01T02:39:11.528ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
77232024-10-01T02:39:11.528ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
77242024-10-01T02:39:11.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
77252024-10-01T02:39:11.528ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77262024-10-01T02:39:11.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
77272024-10-01T02:39:11.531ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
77282024-10-01T02:39:11.531ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
77292024-10-01T02:39:11.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
77302024-10-01T02:39:11.531ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77312024-10-01T02:39:11.534ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
77322024-10-01T02:39:11.534ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
77332024-10-01T02:39:11.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
77342024-10-01T02:39:11.537ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77352024-10-01T02:39:11.537ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
77362024-10-01T02:39:11.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
77372024-10-01T02:39:11.537ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77382024-10-01T02:39:11.537ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
77392024-10-01T02:39:11.538ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77402024-10-01T02:39:11.538ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
77412024-10-01T02:39:11.539ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1604, tv_nsec: 979838255 } })
77422024-10-01T02:39:11.540ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
77432024-10-01T02:39:11.541ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1051 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd
77442024-10-01T02:39:11.542ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77452024-10-01T02:39:11.543ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
77462024-10-01T02:39:11.543ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
77472024-10-01T02:39:11.543ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
77482024-10-01T02:39:11.543ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
77492024-10-01T02:39:11.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
77502024-10-01T02:39:11.543ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77512024-10-01T02:39:11.544ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
77522024-10-01T02:39:11.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
77532024-10-01T02:39:11.546ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
77542024-10-01T02:39:11.546ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
77552024-10-01T02:39:11.546ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
77562024-10-01T02:39:11.547ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
77572024-10-01T02:39:11.547ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
77582024-10-01T02:39:11.547ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
77592024-10-01T02:39:11.549ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77602024-10-01T02:39:11.553ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
77612024-10-01T02:39:11.553ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
77622024-10-01T02:39:11.553ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
77632024-10-01T02:39:11.555ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
77642024-10-01T02:39:11.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
77652024-10-01T02:39:11.555ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77662024-10-01T02:39:11.559ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
77672024-10-01T02:39:11.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
77682024-10-01T02:39:11.559ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 66.81718ms iteration = 37 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
77692024-10-01T02:39:11.559ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77702024-10-01T02:39:11.560ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8f598f5c-ad31-4712-b43f-7ac75a933d07, lookup_type: ById(8f598f5c-ad31-4712-b43f-7ac75a933d07) } result = Ok(())
77712024-10-01T02:39:11.560ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77722024-10-01T02:39:11.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77732024-10-01T02:39:11.561ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77742024-10-01T02:39:11.562ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
77752024-10-01T02:39:11.562ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
77762024-10-01T02:39:11.562ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
77772024-10-01T02:39:11.562ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 69.582496ms iteration = 4 status = {"nsuccess":5}
77782024-10-01T02:39:11.562ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
77792024-10-01T02:39:11.562ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
77802024-10-01T02:39:11.562ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 69.755209ms iteration = 7 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
77812024-10-01T02:39:11.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
77822024-10-01T02:39:11.564ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
77832024-10-01T02:39:11.564ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
77842024-10-01T02:39:11.564ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
77852024-10-01T02:39:11.566ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
77862024-10-01T02:39:11.566ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
77872024-10-01T02:39:11.566ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
77882024-10-01T02:39:11.566ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 73.652654ms iteration = 13 status = {"errors":[],"garbage_collect_requested":[]}
77892024-10-01T02:39:11.567ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 74.669651ms iteration = 13 status = {"errors":[],"records_set_to_done":[]}
77902024-10-01T02:39:11.568ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
77912024-10-01T02:39:11.568ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
77922024-10-01T02:39:11.570ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77932024-10-01T02:39:11.571ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
77942024-10-01T02:39:11.571ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
77952024-10-01T02:39:11.571ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
77962024-10-01T02:39:11.571ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
77972024-10-01T02:39:11.571ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
77982024-10-01T02:39:11.571ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
77992024-10-01T02:39:11.573ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
78002024-10-01T02:39:11.573ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
78012024-10-01T02:39:11.573ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
78022024-10-01T02:39:11.573ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
78032024-10-01T02:39:11.573ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 80.847855ms iteration = 7 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
78042024-10-01T02:39:11.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
78052024-10-01T02:39:11.575ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 82.067806ms iteration = 13 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
78062024-10-01T02:39:11.576ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
78072024-10-01T02:39:11.576ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
78082024-10-01T02:39:11.576ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 83.129613ms iteration = 13 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
78092024-10-01T02:39:11.577ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 original_time_created = 2024-10-01 02:32:51.153042 UTC target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 time_created = 2024-10-01 02:32:51.153042 UTC
78102024-10-01T02:39:11.577ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 84.898053ms iteration = 37 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8f598f5c-ad31-4712-b43f-7ac75a933d07","time_created":"2024-10-01T02:32:51.153042Z"}
78112024-10-01T02:39:11.577ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
78122024-10-01T02:39:11.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
78132024-10-01T02:39:11.579ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
78142024-10-01T02:39:11.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
78152024-10-01T02:39:11.579ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78162024-10-01T02:39:11.580ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
78172024-10-01T02:39:11.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
78182024-10-01T02:39:11.582ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78192024-10-01T02:39:11.582ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
78202024-10-01T02:39:11.584ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
78212024-10-01T02:39:11.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
78222024-10-01T02:39:11.585ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 2a571ec0-85a3-450e-88fc-680c13ffa211, lookup_type: ById(2a571ec0-85a3-450e-88fc-680c13ffa211) } result = Ok(())
78232024-10-01T02:39:11.585ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
78242024-10-01T02:39:11.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
78252024-10-01T02:39:11.587ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 95.024442ms iteration = 13 status = 0
78262024-10-01T02:39:11.590ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
78272024-10-01T02:39:11.590ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 97.332561ms iteration = 13 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
78282024-10-01T02:39:11.597ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 104.857787ms iteration = 13 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
78292024-10-01T02:39:11.610ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
78302024-10-01T02:39:11.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
78312024-10-01T02:39:11.614ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78322024-10-01T02:39:11.615ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
78332024-10-01T02:39:11.615ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = bc7b49a6-c38c-499f-983e-184e2c58fa04 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
78342024-10-01T02:39:11.615ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
78352024-10-01T02:39:11.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
78362024-10-01T02:39:11.616ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
78372024-10-01T02:39:11.616ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
78382024-10-01T02:39:11.616ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
78392024-10-01T02:39:11.618ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78402024-10-01T02:39:11.618ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78412024-10-01T02:39:11.621ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
78422024-10-01T02:39:11.621ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
78432024-10-01T02:39:11.621ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
78442024-10-01T02:39:11.621ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
78452024-10-01T02:39:11.621ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
78462024-10-01T02:39:11.621ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
78472024-10-01T02:39:11.626ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
78482024-10-01T02:39:11.626ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
78492024-10-01T02:39:11.626ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
78502024-10-01T02:39:11.626ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
78512024-10-01T02:39:11.626ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
78522024-10-01T02:39:11.627ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 134.504914ms iteration = 15 status = {"physical_disks_added":0}
78532024-10-01T02:39:11.629ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-10-01T02:33:09.142901Z, time_modified: 2024-10-01T02:33:09.142901Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, db_silo: Silo { identity: SiloIdentity { id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-10-01T02:33:13.712784Z, time_modified: 2024-10-01T02:33:13.712784Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "ca547a59343cd98ceb775f10ce9428d8003a71a149b5b7d33f10c1e7a9820bb1" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, db_silo: Silo { identity: SiloIdentity { id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-10-01T02:33:13.712784Z, time_modified: 2024-10-01T02:33:13.712784Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "ca547a59343cd98ceb775f10ce9428d8003a71a149b5b7d33f10c1e7a9820bb1" }] }) }
78542024-10-01T02:39:11.629ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 136.759432ms iteration = 8 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"21983b87-d6d0-47c6-a33c-5fe68fbed0c6","tls_certs":["ca547a59343cd98ceb775f10ce9428d8003a71a149b5b7d33f10c1e7a9820bb1"]}},"default_endpoint":{"silo_id":"21983b87-d6d0-47c6-a33c-5fe68fbed0c6","tls_certs":["ca547a59343cd98ceb775f10ce9428d8003a71a149b5b7d33f10c1e7a9820bb1"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
78552024-10-01T02:39:11.629ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 136.616049ms iteration = 13 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
78562024-10-01T02:39:11.632ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = bc7b49a6-c38c-499f-983e-184e2c58fa04 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
78572024-10-01T02:39:11.632ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
78582024-10-01T02:39:11.632ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-10-01 02:33:12.369795 UTC dns_group = internal generation = 1
78592024-10-01T02:39:11.632ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 140.139349ms iteration = 8 status = {"generation":1}
78602024-10-01T02:39:11.646ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
78612024-10-01T02:39:11.654ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
78622024-10-01T02:39:11.654ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 161.776241ms iteration = 7 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
78632024-10-01T02:39:11.662ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78642024-10-01T02:39:11.664ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
78652024-10-01T02:39:11.664ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
78662024-10-01T02:39:11.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
78672024-10-01T02:39:11.677ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1059 zone_address = fd00:1122:3344:101::2
78682024-10-01T02:39:11.677ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
78692024-10-01T02:39:11.678ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d2e2159e-6000-461d-bd5e-e5e54e329479", "content-length": "26", "date": "Tue, 01 Oct 2024 02:39:11 GMT"} })
78702024-10-01T02:39:11.678ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1064 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
78712024-10-01T02:39:11.680ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
78722024-10-01T02:39:11.700ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
78732024-10-01T02:39:11.700ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 3d6d7965-c160-4184-b04f-32fa0fb7b928 dns_zone_name = oxide.test found_so_far = 0 version = 2
78742024-10-01T02:39:11.700ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
78752024-10-01T02:39:11.700ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
78762024-10-01T02:39:11.728ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78772024-10-01T02:39:11.728ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1059 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd zone_address = fd00:1122:3344:101::2
78782024-10-01T02:39:11.728ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
78792024-10-01T02:39:11.730ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "49c256cb-5023-4515-ad7d-436aa2973d74", "content-length": "26", "date": "Tue, 01 Oct 2024 02:39:11 GMT"} })
78802024-10-01T02:39:11.730ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1064 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
78812024-10-01T02:39:11.731ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
78822024-10-01T02:39:11.731ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
78832024-10-01T02:39:11.731ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
78842024-10-01T02:39:11.731ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd
78852024-10-01T02:39:11.732ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 3d6d7965-c160-4184-b04f-32fa0fb7b928 dns_zone_name = oxide.test found_so_far = 1 version = 2
78862024-10-01T02:39:11.732ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
78872024-10-01T02:39:11.732ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-10-01 02:33:13.765844 UTC dns_group = external generation = 2
78882024-10-01T02:39:11.733ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 240.285727ms iteration = 8 status = {"generation":2}
78892024-10-01T02:39:11.797ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
78902024-10-01T02:39:11.819ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1059 zone_address = fd00:1122:3344:101::2
78912024-10-01T02:39:11.819ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
78922024-10-01T02:39:11.820ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a20c204a-e5c4-4838-82c6-ecd4de0b67c5", "content-length": "26", "date": "Tue, 01 Oct 2024 02:39:11 GMT"} })
78932024-10-01T02:39:11.820ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1064 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
78942024-10-01T02:39:11.823ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
78952024-10-01T02:39:11.853ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
78962024-10-01T02:39:11.853ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "51cc3bd1-e0b6-455f-868c-7920077c0fb9", "content-length": "372", "date": "Tue, 01 Oct 2024 02:39:11 GMT"} })
78972024-10-01T02:39:11.853ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
78982024-10-01T02:39:11.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
78992024-10-01T02:39:11.855ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
79002024-10-01T02:39:11.856ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
79012024-10-01T02:39:11.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
79022024-10-01T02:39:11.859ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
79032024-10-01T02:39:11.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
79042024-10-01T02:39:11.862ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
79052024-10-01T02:39:11.863ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "a655fd13-0a32-4d6b-9edf-be97eac0b7e8", "date": "Tue, 01 Oct 2024 02:39:11 GMT"} })
79062024-10-01T02:39:11.864ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 371.527276ms iteration = 14 status = {}
79072024-10-01T02:39:11.875ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
79082024-10-01T02:39:11.876ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "f7e755cf-f826-4a8b-9eb9-9f5945d051ae", "content-length": "2", "date": "Tue, 01 Oct 2024 02:39:11 GMT"} })
79092024-10-01T02:39:11.877ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
79102024-10-01T02:39:11.878ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
79112024-10-01T02:39:11.879ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 386.800792ms iteration = 13 status = null
79122024-10-01T02:39:11.893ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
79132024-10-01T02:39:11.893ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "12bf1aa2-41c7-44e1-88d4-7920bf106378", "content-length": "691", "date": "Tue, 01 Oct 2024 02:39:11 GMT"} })
79142024-10-01T02:39:11.893ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
79152024-10-01T02:39:11.893ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
79162024-10-01T02:39:11.893ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
79172024-10-01T02:39:11.895ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 402.729439ms iteration = 13 status = {}
79182024-10-01T02:39:11.983ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
79192024-10-01T02:39:11.983ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "c6e8820a-802a-4f38-95a5-f024e85f55b2", "date": "Tue, 01 Oct 2024 02:39:11 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
79202024-10-01T02:39:11.983ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
79212024-10-01T02:39:11.985ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "376e688b-d6b2-4cd6-8abb-be6a8700f026", "date": "Tue, 01 Oct 2024 02:39:11 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
79222024-10-01T02:39:11.985ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
79232024-10-01T02:39:11.987ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "4b145742-9b2b-48c2-bfd0-8c3c921b49a6", "date": "Tue, 01 Oct 2024 02:39:11 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
79242024-10-01T02:39:11.987ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
79252024-10-01T02:39:11.990ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
79262024-10-01T02:39:11.990ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 497.462896ms iteration = 9 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
79272024-10-01T02:39:12.038ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
79282024-10-01T02:39:12.038ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "6800026a-7b87-429c-b5e8-ecc9071521f9", "date": "Tue, 01 Oct 2024 02:39:11 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
79292024-10-01T02:39:12.038ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
79302024-10-01T02:39:12.040ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "12a30609-0bdb-47de-a04a-d779d0fe63a4", "date": "Tue, 01 Oct 2024 02:39:11 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
79312024-10-01T02:39:12.040ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
79322024-10-01T02:39:12.042ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
79332024-10-01T02:39:12.042ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 549.637251ms iteration = 9 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
79342024-10-01T02:39:12.053ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 560.705476ms iteration = 13 status = {}
79352024-10-01T02:39:12.070ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
79362024-10-01T02:39:12.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
79372024-10-01T02:39:12.072ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 58c2bb06-eaf4-47b5-aefe-83ea06db2406, rack_id: 52547763-7759-42e1-81a9-8b833f59f5dd, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(57ef3335-befd-4872-b57f-5c2571dcca50) } rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd switch_location = Switch0
79382024-10-01T02:39:12.072ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
79392024-10-01T02:39:12.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
79402024-10-01T02:39:12.082ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
79412024-10-01T02:39:12.082ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "cec6bb11-00e1-4289-b307-af1e2626a626", "content-length": "121", "date": "Tue, 01 Oct 2024 02:39:11 GMT"} })
79422024-10-01T02:39:12.082ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
79432024-10-01T02:39:12.082ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 57ef3335-befd-4872-b57f-5c2571dcca50
79442024-10-01T02:39:12.083ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
79452024-10-01T02:39:12.083ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
79462024-10-01T02:39:12.083ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd routes = {}
79472024-10-01T02:39:12.083ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd routes = {}
79482024-10-01T02:39:12.083ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd
79492024-10-01T02:39:12.083ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
79502024-10-01T02:39:12.083ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
79512024-10-01T02:39:12.085ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
79522024-10-01T02:39:12.085ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "d22cdfa2-ee62-443f-9bc7-ac1c59182954", "content-length": "2", "date": "Tue, 01 Oct 2024 02:39:11 GMT"} })
79532024-10-01T02:39:12.085ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
79542024-10-01T02:39:12.085ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "7d6071c5-eb2e-466a-af8a-8ab580ae9120", "content-length": "52", "date": "Tue, 01 Oct 2024 02:39:11 GMT"} })
79552024-10-01T02:39:12.085ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd switch_location = Switch0
79562024-10-01T02:39:12.085ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
79572024-10-01T02:39:12.181ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "5777ddd7-e9e8-4301-ba54-90d3ae256754", "date": "Tue, 01 Oct 2024 02:39:11 GMT"} })
79582024-10-01T02:39:12.181ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd switch = Switch0
79592024-10-01T02:39:12.181ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
79602024-10-01T02:39:12.182ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "a9fee1f9-fff2-4fd4-a1d0-98db023f1bf7", "content-length": "667", "date": "Tue, 01 Oct 2024 02:39:11 GMT"} })
79612024-10-01T02:39:12.182ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
79622024-10-01T02:39:12.182ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
79632024-10-01T02:39:12.186ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
79642024-10-01T02:39:12.186ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
79652024-10-01T02:39:12.189ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
79662024-10-01T02:39:12.190ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
79672024-10-01T02:39:12.192ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
79682024-10-01T02:39:12.192ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
79692024-10-01T02:39:12.198ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 706.054452ms iteration = 13 status = {}
79702024-10-01T02:39:12.508ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:60878 req_id = ec3d4de4-055e-43dd-ae08-32c6a3e3d7da roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
79712024-10-01T02:39:12.509ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:60878 req_id = ec3d4de4-055e-43dd-ae08-32c6a3e3d7da resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
79722024-10-01T02:39:12.531ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 22854 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:60878 req_id = ec3d4de4-055e-43dd-ae08-32c6a3e3d7da response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
79732024-10-01T02:39:14.996ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1259 local_addr = [fd00:1122:3344:101::c]:53319 method = GET remote_addr = [fd00:1122:3344:101::d]:65459 req_id = 073d3791-ad3f-47c7-85a3-02be86e1b65d response_code = 200 uri = /3dfd7033-71d8-4eb9-bb97-49dae3b5cd35
79742024-10-01T02:39:21.492ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 38 reason = Timeout
79752024-10-01T02:39:21.492ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79762024-10-01T02:39:21.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79772024-10-01T02:39:21.493ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 38 reason = Timeout
79782024-10-01T02:39:21.493ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
79792024-10-01T02:39:21.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
79802024-10-01T02:39:21.494ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79812024-10-01T02:39:21.495ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
79822024-10-01T02:39:21.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
79832024-10-01T02:39:21.497ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
79842024-10-01T02:39:21.497ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79852024-10-01T02:39:21.497ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79862024-10-01T02:39:21.499ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79872024-10-01T02:39:21.499ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79882024-10-01T02:39:21.526ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79892024-10-01T02:39:21.527ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 33.873357ms iteration = 38 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
79902024-10-01T02:39:21.529ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8f598f5c-ad31-4712-b43f-7ac75a933d07, lookup_type: ById(8f598f5c-ad31-4712-b43f-7ac75a933d07) } result = Ok(())
79912024-10-01T02:39:21.529ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79922024-10-01T02:39:21.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79932024-10-01T02:39:21.535ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 original_time_created = 2024-10-01 02:32:51.153042 UTC target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 time_created = 2024-10-01 02:32:51.153042 UTC
79942024-10-01T02:39:21.535ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 43.282015ms iteration = 38 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8f598f5c-ad31-4712-b43f-7ac75a933d07","time_created":"2024-10-01T02:32:51.153042Z"}
79952024-10-01T02:39:24.997ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1698 local_addr = [fd00:1122:3344:101::c]:53319 method = GET remote_addr = [fd00:1122:3344:101::d]:65459 req_id = ef1a80d9-4683-4c75-b468-de7c85fdb506 response_code = 200 uri = /3dfd7033-71d8-4eb9-bb97-49dae3b5cd35
79962024-10-01T02:39:31.492ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 39 reason = Timeout
79972024-10-01T02:39:31.492ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79982024-10-01T02:39:31.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79992024-10-01T02:39:31.493ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 39 reason = Timeout
80002024-10-01T02:39:31.493ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
80012024-10-01T02:39:31.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
80022024-10-01T02:39:31.494ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80032024-10-01T02:39:31.495ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
80042024-10-01T02:39:31.496ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
80052024-10-01T02:39:31.497ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
80062024-10-01T02:39:31.497ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
80072024-10-01T02:39:31.497ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
80082024-10-01T02:39:31.499ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
80092024-10-01T02:39:31.499ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
80102024-10-01T02:39:31.501ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80112024-10-01T02:39:31.503ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8f598f5c-ad31-4712-b43f-7ac75a933d07, lookup_type: ById(8f598f5c-ad31-4712-b43f-7ac75a933d07) } result = Ok(())
80122024-10-01T02:39:31.503ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
80132024-10-01T02:39:31.503ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
80142024-10-01T02:39:31.512ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 original_time_created = 2024-10-01 02:32:51.153042 UTC target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 time_created = 2024-10-01 02:32:51.153042 UTC
80152024-10-01T02:39:31.512ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.843123ms iteration = 39 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8f598f5c-ad31-4712-b43f-7ac75a933d07","time_created":"2024-10-01T02:32:51.153042Z"}
80162024-10-01T02:39:31.525ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 32.25687ms iteration = 39 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
80172024-10-01T02:39:34.996ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1160 local_addr = [fd00:1122:3344:101::c]:53319 method = GET remote_addr = [fd00:1122:3344:101::d]:65459 req_id = 96b77955-e6e1-4da1-acee-d8150756aaad response_code = 200 uri = /3dfd7033-71d8-4eb9-bb97-49dae3b5cd35
80182024-10-01T02:39:39.560ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:60878 req_id = 29f85853-b1c9-46a8-9d39-ec6b60602d9e roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
80192024-10-01T02:39:39.561ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:60878 req_id = 29f85853-b1c9-46a8-9d39-ec6b60602d9e resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
80202024-10-01T02:39:39.564ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3793 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:60878 req_id = 29f85853-b1c9-46a8-9d39-ec6b60602d9e response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
80212024-10-01T02:39:39.565ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:60878 req_id = af1a80a0-34f0-4a19-b691-52bd1088fe7b roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/14?limit=100
80222024-10-01T02:39:39.565ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:60878 req_id = af1a80a0-34f0-4a19-b691-52bd1088fe7b resource = Database result = Ok(()) uri = /nat/ipv4/changeset/14?limit=100
80232024-10-01T02:39:39.567ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2903 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:60878 req_id = af1a80a0-34f0-4a19-b691-52bd1088fe7b response_code = 200 uri = /nat/ipv4/changeset/14?limit=100
80242024-10-01T02:39:41.492ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 40 reason = Timeout
80252024-10-01T02:39:41.492ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 14 reason = Timeout
80262024-10-01T02:39:41.492ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
80272024-10-01T02:39:41.492ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 14 reason = Timeout
80282024-10-01T02:39:41.492ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
80292024-10-01T02:39:41.492ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 16 reason = Timeout
80302024-10-01T02:39:41.492ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
80312024-10-01T02:39:41.492ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
80322024-10-01T02:39:41.492ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 14 reason = Timeout
80332024-10-01T02:39:41.492ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 14 reason = Timeout
80342024-10-01T02:39:41.492ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
80352024-10-01T02:39:41.492ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 14 reason = Timeout
80362024-10-01T02:39:41.492ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
80372024-10-01T02:39:41.492ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 14 reason = Timeout
80382024-10-01T02:39:41.492ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 14 reason = Timeout
80392024-10-01T02:39:41.492ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
80402024-10-01T02:39:41.492ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
80412024-10-01T02:39:41.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
80422024-10-01T02:39:41.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
80432024-10-01T02:39:41.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
80442024-10-01T02:39:41.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
80452024-10-01T02:39:41.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
80462024-10-01T02:39:41.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
80472024-10-01T02:39:41.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
80482024-10-01T02:39:41.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
80492024-10-01T02:39:41.493ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 40 reason = Timeout
80502024-10-01T02:39:41.493ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 14 reason = Timeout
80512024-10-01T02:39:41.493ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
80522024-10-01T02:39:41.493ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
80532024-10-01T02:39:41.493ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 14 reason = Timeout
80542024-10-01T02:39:41.493ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
80552024-10-01T02:39:41.493ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 14 reason = Timeout
80562024-10-01T02:39:41.493ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
80572024-10-01T02:39:41.493ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 14 reason = Timeout
80582024-10-01T02:39:41.493ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
80592024-10-01T02:39:41.493ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 14 reason = Timeout
80602024-10-01T02:39:41.493ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
80612024-10-01T02:39:41.493ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 15 reason = Timeout
80622024-10-01T02:39:41.493ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 14 reason = Timeout
80632024-10-01T02:39:41.493ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
80642024-10-01T02:39:41.493ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
80652024-10-01T02:39:41.493ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
80662024-10-01T02:39:41.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
80672024-10-01T02:39:41.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
80682024-10-01T02:39:41.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
80692024-10-01T02:39:41.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
80702024-10-01T02:39:41.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
80712024-10-01T02:39:41.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
80722024-10-01T02:39:41.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
80732024-10-01T02:39:41.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
80742024-10-01T02:39:41.495ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80752024-10-01T02:39:41.495ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1634, tv_nsec: 935694316 } })
80762024-10-01T02:39:41.496ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80772024-10-01T02:39:41.496ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.774993ms iteration = 14 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
80782024-10-01T02:39:41.497ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80792024-10-01T02:39:41.497ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1051
80802024-10-01T02:39:41.497ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1634, tv_nsec: 938051245 } })
80812024-10-01T02:39:41.498ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1051
80822024-10-01T02:39:41.498ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
80832024-10-01T02:39:41.498ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
80842024-10-01T02:39:41.498ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
80852024-10-01T02:39:41.499ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
80862024-10-01T02:39:41.500ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
80872024-10-01T02:39:41.500ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
80882024-10-01T02:39:41.501ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
80892024-10-01T02:39:41.501ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
80902024-10-01T02:39:41.502ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
80912024-10-01T02:39:41.506ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
80922024-10-01T02:39:41.507ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
80932024-10-01T02:39:41.507ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
80942024-10-01T02:39:41.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
80952024-10-01T02:39:41.508ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
80962024-10-01T02:39:41.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
80972024-10-01T02:39:41.511ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
80982024-10-01T02:39:41.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
80992024-10-01T02:39:41.539ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
81002024-10-01T02:39:41.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
81012024-10-01T02:39:41.540ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
81022024-10-01T02:39:41.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
81032024-10-01T02:39:41.542ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81042024-10-01T02:39:41.542ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
81052024-10-01T02:39:41.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
81062024-10-01T02:39:41.544ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
81072024-10-01T02:39:41.544ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
81082024-10-01T02:39:41.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
81092024-10-01T02:39:41.549ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 55.680593ms iteration = 14 status = {"errors":[],"records_set_to_done":[]}
81102024-10-01T02:39:41.550ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
81112024-10-01T02:39:41.551ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1634, tv_nsec: 991212396 } })
81122024-10-01T02:39:41.551ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
81132024-10-01T02:39:41.552ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
81142024-10-01T02:39:41.552ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
81152024-10-01T02:39:41.552ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
81162024-10-01T02:39:41.552ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
81172024-10-01T02:39:41.552ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
81182024-10-01T02:39:41.552ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1051 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd
81192024-10-01T02:39:41.552ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
81202024-10-01T02:39:41.553ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 60.089947ms iteration = 14 status = {"errors":[],"garbage_collect_requested":[]}
81212024-10-01T02:39:41.555ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 62.66539ms iteration = 14 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
81222024-10-01T02:39:41.556ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81232024-10-01T02:39:41.559ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8f598f5c-ad31-4712-b43f-7ac75a933d07, lookup_type: ById(8f598f5c-ad31-4712-b43f-7ac75a933d07) } result = Ok(())
81242024-10-01T02:39:41.559ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
81252024-10-01T02:39:41.559ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81262024-10-01T02:39:41.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
81272024-10-01T02:39:41.561ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81282024-10-01T02:39:41.562ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
81292024-10-01T02:39:41.562ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
81302024-10-01T02:39:41.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
81312024-10-01T02:39:41.564ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
81322024-10-01T02:39:41.564ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
81332024-10-01T02:39:41.564ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
81342024-10-01T02:39:41.567ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 74.405746ms iteration = 40 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
81352024-10-01T02:39:41.577ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 original_time_created = 2024-10-01 02:32:51.153042 UTC target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 time_created = 2024-10-01 02:32:51.153042 UTC
81362024-10-01T02:39:41.577ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 84.974274ms iteration = 40 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8f598f5c-ad31-4712-b43f-7ac75a933d07","time_created":"2024-10-01T02:32:51.153042Z"}
81372024-10-01T02:39:41.577ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81382024-10-01T02:39:41.578ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1059 zone_address = fd00:1122:3344:101::2
81392024-10-01T02:39:41.578ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
81402024-10-01T02:39:41.579ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "5888c113-6a43-4eb4-86f6-065327fe8335", "content-length": "26", "date": "Tue, 01 Oct 2024 02:39:41 GMT"} })
81412024-10-01T02:39:41.579ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1064 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
81422024-10-01T02:39:41.579ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
81432024-10-01T02:39:41.579ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
81442024-10-01T02:39:41.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
81452024-10-01T02:39:41.581ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
81462024-10-01T02:39:41.588ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1059 zone_address = fd00:1122:3344:101::2
81472024-10-01T02:39:41.589ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
81482024-10-01T02:39:41.589ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d59f4a5c-777f-467a-950e-11bda102e6f9", "content-length": "26", "date": "Tue, 01 Oct 2024 02:39:41 GMT"} })
81492024-10-01T02:39:41.589ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1064 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
81502024-10-01T02:39:41.589ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
81512024-10-01T02:39:41.590ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
81522024-10-01T02:39:41.591ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
81532024-10-01T02:39:41.592ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81542024-10-01T02:39:41.592ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 99.357785ms iteration = 14 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
81552024-10-01T02:39:41.595ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 2a571ec0-85a3-450e-88fc-680c13ffa211, lookup_type: ById(2a571ec0-85a3-450e-88fc-680c13ffa211) } result = Ok(())
81562024-10-01T02:39:41.595ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
81572024-10-01T02:39:41.595ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
81582024-10-01T02:39:41.595ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 102.254544ms iteration = 14 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
81592024-10-01T02:39:41.597ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 105.140991ms iteration = 14 status = 0
81602024-10-01T02:39:41.597ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
81612024-10-01T02:39:41.598ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
81622024-10-01T02:39:41.598ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
81632024-10-01T02:39:41.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
81642024-10-01T02:39:41.599ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81652024-10-01T02:39:41.601ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
81662024-10-01T02:39:41.601ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
81672024-10-01T02:39:41.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
81682024-10-01T02:39:41.624ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 131.850599ms iteration = 16 status = {"physical_disks_added":0}
81692024-10-01T02:39:41.634ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
81702024-10-01T02:39:41.634ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
81712024-10-01T02:39:41.634ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 140.501564ms iteration = 14 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
81722024-10-01T02:39:41.637ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
81732024-10-01T02:39:41.638ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
81742024-10-01T02:39:41.658ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1059 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd zone_address = fd00:1122:3344:101::2
81752024-10-01T02:39:41.658ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
81762024-10-01T02:39:41.658ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2228fe58-ff3c-4a6a-bfb7-a5e42b5b8a59", "content-length": "26", "date": "Tue, 01 Oct 2024 02:39:41 GMT"} })
81772024-10-01T02:39:41.658ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1064 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
81782024-10-01T02:39:41.661ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd
81792024-10-01T02:39:41.675ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
81802024-10-01T02:39:41.675ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
81812024-10-01T02:39:41.677ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81822024-10-01T02:39:41.679ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
81832024-10-01T02:39:41.679ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
81842024-10-01T02:39:41.680ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
81852024-10-01T02:39:41.716ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
81862024-10-01T02:39:41.717ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "b8a66000-1bbd-4729-88ce-41691a8adb07", "content-length": "2", "date": "Tue, 01 Oct 2024 02:39:40 GMT"} })
81872024-10-01T02:39:41.718ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
81882024-10-01T02:39:41.718ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
81892024-10-01T02:39:41.807ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = instance_watcher body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vmms/031b6427-1460-4676-a469-9de2f0f9317d/state
81902024-10-01T02:39:41.824ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 332.598904ms iteration = 14 status = {}
81912024-10-01T02:39:41.834ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
81922024-10-01T02:39:41.835ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "2407231d-6bf1-4902-863b-f738a33263ef", "content-length": "585", "date": "Tue, 01 Oct 2024 02:39:41 GMT"} })
81932024-10-01T02:39:41.835ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
81942024-10-01T02:39:41.836ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
81952024-10-01T02:39:41.840ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 347.834059ms iteration = 14 status = null
81962024-10-01T02:39:41.841ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
81972024-10-01T02:39:41.842ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
81982024-10-01T02:39:41.847ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
81992024-10-01T02:39:41.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
82002024-10-01T02:39:41.859ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
82012024-10-01T02:39:41.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
82022024-10-01T02:39:41.869ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
82032024-10-01T02:39:41.870ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
82042024-10-01T02:39:41.878ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
82052024-10-01T02:39:41.878ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
82062024-10-01T02:39:41.882ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82072024-10-01T02:39:41.884ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
82082024-10-01T02:39:41.885ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "91a6f594-b510-45f4-9864-3a6d4ace98cc", "date": "Tue, 01 Oct 2024 02:39:41 GMT"} })
82092024-10-01T02:39:41.887ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
82102024-10-01T02:39:41.887ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
82112024-10-01T02:39:41.887ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
82122024-10-01T02:39:41.887ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 394.294747ms iteration = 15 status = {}
82132024-10-01T02:39:41.946ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
82142024-10-01T02:39:41.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
82152024-10-01T02:39:41.950ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 58c2bb06-eaf4-47b5-aefe-83ea06db2406, rack_id: 52547763-7759-42e1-81a9-8b833f59f5dd, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(57ef3335-befd-4872-b57f-5c2571dcca50) } rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd switch_location = Switch0
82162024-10-01T02:39:41.950ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
82172024-10-01T02:39:41.950ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
82182024-10-01T02:39:41.962ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
82192024-10-01T02:39:41.962ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "d696cccc-2f2a-4161-8d5d-5e0d269b42e3", "content-length": "121", "date": "Tue, 01 Oct 2024 02:39:41 GMT"} })
82202024-10-01T02:39:41.962ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
82212024-10-01T02:39:41.962ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 57ef3335-befd-4872-b57f-5c2571dcca50
82222024-10-01T02:39:41.963ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
82232024-10-01T02:39:41.963ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
82242024-10-01T02:39:41.963ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd routes = {}
82252024-10-01T02:39:41.963ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd routes = {}
82262024-10-01T02:39:41.963ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd
82272024-10-01T02:39:41.963ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
82282024-10-01T02:39:41.963ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
82292024-10-01T02:39:41.966ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
82302024-10-01T02:39:41.966ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "0b77ba34-9593-4981-a561-00495edc9859", "content-length": "2", "date": "Tue, 01 Oct 2024 02:39:41 GMT"} })
82312024-10-01T02:39:41.966ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
82322024-10-01T02:39:41.967ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "ddfa7f14-b0ab-443e-a56e-e5f3c0b4becd", "content-length": "52", "date": "Tue, 01 Oct 2024 02:39:41 GMT"} })
82332024-10-01T02:39:41.967ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd switch_location = Switch0
82342024-10-01T02:39:41.967ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
82352024-10-01T02:39:42.005ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
82362024-10-01T02:39:42.104ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "45b9cc65-0fbf-44df-bc2b-99772defe88d", "date": "Tue, 01 Oct 2024 02:39:41 GMT"} })
82372024-10-01T02:39:42.104ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd switch = Switch0
82382024-10-01T02:39:42.104ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
82392024-10-01T02:39:42.108ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "a11b94c0-223a-49a7-b8b2-07549822efb0", "content-length": "667", "date": "Tue, 01 Oct 2024 02:39:41 GMT"} })
82402024-10-01T02:39:42.108ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
82412024-10-01T02:39:42.109ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
82422024-10-01T02:39:42.109ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "889a2eb6-0ce4-4bdd-8453-e70d7465ae18", "content-length": "811", "date": "Tue, 01 Oct 2024 02:39:41 GMT"} })
82432024-10-01T02:39:42.109ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {VirtualNetworkInterfaceHost { physical_host_ip: fd00:1122:3344:101::1, virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), vni: Vni(12861255) }} sled = buskin
82442024-10-01T02:39:42.109ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
82452024-10-01T02:39:42.109ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
82462024-10-01T02:39:42.110ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 618.192799ms iteration = 14 status = {}
82472024-10-01T02:39:42.114ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
82482024-10-01T02:39:42.115ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
82492024-10-01T02:39:42.120ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
82502024-10-01T02:39:42.120ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
82512024-10-01T02:39:42.123ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
82522024-10-01T02:39:42.123ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
82532024-10-01T02:39:42.133ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 640.759948ms iteration = 14 status = {}
82542024-10-01T02:39:44.997ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1469 local_addr = [fd00:1122:3344:101::c]:53319 method = GET remote_addr = [fd00:1122:3344:101::d]:65459 req_id = de138d72-636a-4b55-b2f0-b4778749859b response_code = 200 uri = /3dfd7033-71d8-4eb9-bb97-49dae3b5cd35
82552024-10-01T02:39:47.980ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = instance_watcher result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vmms/031b6427-1460-4676-a469-9de2f0f9317d/state", status: 200, headers: {"content-type": "application/json", "x-request-id": "80213540-6b7f-41d6-b15f-6f042f60267e", "content-length": "131", "date": "Tue, 01 Oct 2024 02:39:47 GMT"} })
82562024-10-01T02:39:47.980ZDEBGnexus (BackgroundTasks): updating instance state background_task = instance_watcher instance_id = 155a6d94-b6d1-469e-afb5-9a278b60eab5 sled_id = 2a571ec0-85a3-450e-88fc-680c13ffa211 state = SledVmmState { vmm_state: VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-10-01T02:39:39.578732322Z }, migration_in: None, migration_out: None } vmm_id = 031b6427-1460-4676-a469-9de2f0f9317d
82572024-10-01T02:39:47.980ZINFOnexus (BackgroundTasks): received new VMM runtime state from sled agent background_task = instance_watcher file = nexus/src/app/instance.rs:2043 instance_id = 155a6d94-b6d1-469e-afb5-9a278b60eab5 migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 031b6427-1460-4676-a469-9de2f0f9317d sled_id = 2a571ec0-85a3-450e-88fc-680c13ffa211 vmm_id = 031b6427-1460-4676-a469-9de2f0f9317d vmm_state = VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-10-01T02:39:39.578732322Z }
82582024-10-01T02:39:47.980ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher instance_id = 155a6d94-b6d1-469e-afb5-9a278b60eab5 roles = RoleSet { roles: {} } sled_id = 2a571ec0-85a3-450e-88fc-680c13ffa211 vmm_id = 031b6427-1460-4676-a469-9de2f0f9317d
82592024-10-01T02:39:47.981ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher instance_id = 155a6d94-b6d1-469e-afb5-9a278b60eab5 resource = Database result = Ok(()) sled_id = 2a571ec0-85a3-450e-88fc-680c13ffa211 vmm_id = 031b6427-1460-4676-a469-9de2f0f9317d
82602024-10-01T02:39:47.988ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 1 total_failed = 0 total_incomplete = 0 total_instances = 1 update_sagas_queued = 0
82612024-10-01T02:39:47.989ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 6.496403711s iteration = 14 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{"starting":1},"pruned_instances":0,"total_instances":1,"update_sagas_queued":0}
82622024-10-01T02:39:48.017ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1:0]:34679
82632024-10-01T02:39:48.017ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:34679 req_id = e7905290-a7a4-4842-b847-6cd63102d2bb roles = RoleSet { roles: {} } uri = /metrics/producers
82642024-10-01T02:39:48.017ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:34679 req_id = e7905290-a7a4-4842-b847-6cd63102d2bb resource = Database result = Ok(()) uri = /metrics/producers
82652024-10-01T02:39:48.050ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 41f2943e-6041-44c9-a47a-3cf5fb012644
82662024-10-01T02:39:48.050ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:34679 req_id = e7905290-a7a4-4842-b847-6cd63102d2bb roles = RoleSet { roles: {} } uri = /metrics/producers
82672024-10-01T02:39:48.050ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:34679 req_id = e7905290-a7a4-4842-b847-6cd63102d2bb resource = Database result = Ok(()) uri = /metrics/producers
82682024-10-01T02:39:48.083ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 41f2943e-6041-44c9-a47a-3cf5fb012644 uri = http://[fd00:1122:3344:101::d]:12223/producers
82692024-10-01T02:39:48.084ZDEBGnexus: client response oximeter-collector = 41f2943e-6041-44c9-a47a-3cf5fb012644 result = Ok(Response { url: "http://[fd00:1122:3344:101::d]:12223/producers", status: 204, headers: {"x-request-id": "00b4dc9b-9d13-40be-8f58-9f7631a00b78", "date": "Tue, 01 Oct 2024 02:39:48 GMT"} })
82702024-10-01T02:39:48.084ZINFOnexus: assigned collector to new producer collector_id = 41f2943e-6041-44c9-a47a-3cf5fb012644 file = nexus/src/app/oximeter.rs:125 producer_id = 155a6d94-b6d1-469e-afb5-9a278b60eab5
82712024-10-01T02:39:48.085ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 68147 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:34679 req_id = e7905290-a7a4-4842-b847-6cd63102d2bb response_code = 201 uri = /metrics/producers
82722024-10-01T02:39:51.492ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 41 reason = Timeout
82732024-10-01T02:39:51.492ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82742024-10-01T02:39:51.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82752024-10-01T02:39:51.493ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 41 reason = Timeout
82762024-10-01T02:39:51.493ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
82772024-10-01T02:39:51.494ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
82782024-10-01T02:39:51.495ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82792024-10-01T02:39:51.497ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
82802024-10-01T02:39:51.497ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82812024-10-01T02:39:51.497ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82822024-10-01T02:39:51.499ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82832024-10-01T02:39:51.500ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82842024-10-01T02:39:51.501ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82852024-10-01T02:39:51.504ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8f598f5c-ad31-4712-b43f-7ac75a933d07, lookup_type: ById(8f598f5c-ad31-4712-b43f-7ac75a933d07) } result = Ok(())
82862024-10-01T02:39:51.504ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82872024-10-01T02:39:51.504ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82882024-10-01T02:39:51.511ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 original_time_created = 2024-10-01 02:32:51.153042 UTC target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 time_created = 2024-10-01 02:32:51.153042 UTC
82892024-10-01T02:39:51.511ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.041129ms iteration = 41 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8f598f5c-ad31-4712-b43f-7ac75a933d07","time_created":"2024-10-01T02:32:51.153042Z"}
82902024-10-01T02:39:51.521ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
82912024-10-01T02:39:51.521ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
82922024-10-01T02:39:51.545ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 52.027342ms iteration = 41 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
82932024-10-01T02:39:54.998ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1879 local_addr = [fd00:1122:3344:101::c]:53319 method = GET remote_addr = [fd00:1122:3344:101::d]:65459 req_id = a7809a0a-3114-4617-bc59-4f43e1bbcc53 response_code = 200 uri = /3dfd7033-71d8-4eb9-bb97-49dae3b5cd35
82942024-10-01T02:39:57.586ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:60878 req_id = 588f8433-ec69-45c7-b0af-a3fe32c0e609 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/14?limit=100
82952024-10-01T02:39:57.587ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:60878 req_id = 588f8433-ec69-45c7-b0af-a3fe32c0e609 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/14?limit=100
82962024-10-01T02:39:57.590ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3556 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:60878 req_id = 588f8433-ec69-45c7-b0af-a3fe32c0e609 response_code = 200 uri = /nat/ipv4/changeset/14?limit=100
82972024-10-01T02:39:57.590ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:60878 req_id = c214aed6-3284-4606-9267-7022b8bbe63b roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/16?limit=100
82982024-10-01T02:39:57.591ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:60878 req_id = c214aed6-3284-4606-9267-7022b8bbe63b resource = Database result = Ok(()) uri = /nat/ipv4/changeset/16?limit=100
82992024-10-01T02:39:57.594ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3389 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:60878 req_id = c214aed6-3284-4606-9267-7022b8bbe63b response_code = 200 uri = /nat/ipv4/changeset/16?limit=100
83002024-10-01T02:39:58.595ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:60878 req_id = bdb260bc-f1ea-41e6-8bb1-885d7e85c176 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/16?limit=100
83012024-10-01T02:39:58.595ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:60878 req_id = bdb260bc-f1ea-41e6-8bb1-885d7e85c176 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/16?limit=100
83022024-10-01T02:39:58.599ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3852 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:60878 req_id = bdb260bc-f1ea-41e6-8bb1-885d7e85c176 response_code = 200 uri = /nat/ipv4/changeset/16?limit=100
83032024-10-01T02:39:59.600ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:60878 req_id = 89d0be18-8715-4b58-beec-bd4de26fc49f roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/16?limit=100
83042024-10-01T02:39:59.600ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:60878 req_id = 89d0be18-8715-4b58-beec-bd4de26fc49f resource = Database result = Ok(()) uri = /nat/ipv4/changeset/16?limit=100
83052024-10-01T02:39:59.603ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2849 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:60878 req_id = 89d0be18-8715-4b58-beec-bd4de26fc49f response_code = 200 uri = /nat/ipv4/changeset/16?limit=100
83062024-10-01T02:40:00.604ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:60878 req_id = 7f474340-9d36-47e3-a3cb-9eff21ad7300 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/16?limit=100
83072024-10-01T02:40:00.604ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:60878 req_id = 7f474340-9d36-47e3-a3cb-9eff21ad7300 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/16?limit=100
83082024-10-01T02:40:00.610ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 6652 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:60878 req_id = 7f474340-9d36-47e3-a3cb-9eff21ad7300 response_code = 200 uri = /nat/ipv4/changeset/16?limit=100
83092024-10-01T02:40:01.492ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 42 reason = Timeout
83102024-10-01T02:40:01.493ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
83112024-10-01T02:40:01.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
83122024-10-01T02:40:01.493ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 42 reason = Timeout
83132024-10-01T02:40:01.493ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
83142024-10-01T02:40:01.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
83152024-10-01T02:40:01.495ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83162024-10-01T02:40:01.498ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
83172024-10-01T02:40:01.498ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
83182024-10-01T02:40:01.498ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
83192024-10-01T02:40:01.499ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
83202024-10-01T02:40:01.500ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
83212024-10-01T02:40:01.502ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83222024-10-01T02:40:01.504ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8f598f5c-ad31-4712-b43f-7ac75a933d07, lookup_type: ById(8f598f5c-ad31-4712-b43f-7ac75a933d07) } result = Ok(())
83232024-10-01T02:40:01.504ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
83242024-10-01T02:40:01.504ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
83252024-10-01T02:40:01.513ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 original_time_created = 2024-10-01 02:32:51.153042 UTC target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 time_created = 2024-10-01 02:32:51.153042 UTC
83262024-10-01T02:40:01.513ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.382272ms iteration = 42 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8f598f5c-ad31-4712-b43f-7ac75a933d07","time_created":"2024-10-01T02:32:51.153042Z"}
83272024-10-01T02:40:01.522ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
83282024-10-01T02:40:01.522ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
83292024-10-01T02:40:01.524ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.498952ms iteration = 42 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
83302024-10-01T02:40:04.996ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1122 local_addr = [fd00:1122:3344:101::c]:53319 method = GET remote_addr = [fd00:1122:3344:101::d]:65459 req_id = b6b78f8a-253f-4c4d-886f-e53f6b3cc997 response_code = 200 uri = /3dfd7033-71d8-4eb9-bb97-49dae3b5cd35
83312024-10-01T02:40:11.493ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 10 reason = Timeout
83322024-10-01T02:40:11.493ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 9 reason = Timeout
83332024-10-01T02:40:11.493ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 10 reason = Timeout
83342024-10-01T02:40:11.493ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 15 reason = Timeout
83352024-10-01T02:40:11.493ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 43 reason = Timeout
83362024-10-01T02:40:11.493ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
83372024-10-01T02:40:11.493ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
83382024-10-01T02:40:11.493ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 8 reason = Timeout
83392024-10-01T02:40:11.493ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-10-01 02:30:11.493381709 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
83402024-10-01T02:40:11.493ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 15 reason = Timeout
83412024-10-01T02:40:11.493ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 8 reason = Timeout
83422024-10-01T02:40:11.493ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
83432024-10-01T02:40:11.493ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
83442024-10-01T02:40:11.493ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 9 reason = Timeout
83452024-10-01T02:40:11.493ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
83462024-10-01T02:40:11.493ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 15 reason = Timeout
83472024-10-01T02:40:11.493ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 17 reason = Timeout
83482024-10-01T02:40:11.493ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
83492024-10-01T02:40:11.493ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 15 reason = Timeout
83502024-10-01T02:40:11.493ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
83512024-10-01T02:40:11.493ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
83522024-10-01T02:40:11.493ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 15 reason = Timeout
83532024-10-01T02:40:11.493ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
83542024-10-01T02:40:11.493ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 15 reason = Timeout
83552024-10-01T02:40:11.493ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
83562024-10-01T02:40:11.493ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 9 reason = Timeout
83572024-10-01T02:40:11.493ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07
83582024-10-01T02:40:11.493ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 13.32\u{b5}s iteration = 9 status = {"enabled":false,"target_id":"8f598f5c-ad31-4712-b43f-7ac75a933d07"}
83592024-10-01T02:40:11.493ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 9 reason = Timeout
83602024-10-01T02:40:11.493ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 9 reason = Timeout
83612024-10-01T02:40:11.493ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
83622024-10-01T02:40:11.493ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 15 reason = Timeout
83632024-10-01T02:40:11.493ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
83642024-10-01T02:40:11.493ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
83652024-10-01T02:40:11.493ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
83662024-10-01T02:40:11.493ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 9 reason = Timeout
83672024-10-01T02:40:11.493ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
83682024-10-01T02:40:11.493ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
83692024-10-01T02:40:11.493ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 43 reason = Timeout
83702024-10-01T02:40:11.493ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
83712024-10-01T02:40:11.493ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 15 reason = Timeout
83722024-10-01T02:40:11.493ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
83732024-10-01T02:40:11.493ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 8 reason = Timeout
83742024-10-01T02:40:11.493ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
83752024-10-01T02:40:11.493ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 15 reason = Timeout
83762024-10-01T02:40:11.493ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
83772024-10-01T02:40:11.493ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 15 reason = Timeout
83782024-10-01T02:40:11.493ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
83792024-10-01T02:40:11.493ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 15 reason = Timeout
83802024-10-01T02:40:11.493ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
83812024-10-01T02:40:11.493ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
83822024-10-01T02:40:11.493ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 15 reason = Timeout
83832024-10-01T02:40:11.493ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 16 reason = Timeout
83842024-10-01T02:40:11.493ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
83852024-10-01T02:40:11.493ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
83862024-10-01T02:40:11.493ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 8 reason = Timeout
83872024-10-01T02:40:11.493ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
83882024-10-01T02:40:11.493ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 15 reason = Timeout
83892024-10-01T02:40:11.493ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
83902024-10-01T02:40:11.493ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 8 reason = Timeout
83912024-10-01T02:40:11.493ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
83922024-10-01T02:40:11.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
83932024-10-01T02:40:11.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
83942024-10-01T02:40:11.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
83952024-10-01T02:40:11.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
83962024-10-01T02:40:11.494ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
83972024-10-01T02:40:11.494ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
83982024-10-01T02:40:11.494ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
83992024-10-01T02:40:11.494ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
84002024-10-01T02:40:11.494ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
84012024-10-01T02:40:11.494ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
84022024-10-01T02:40:11.494ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
84032024-10-01T02:40:11.494ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
84042024-10-01T02:40:11.494ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
84052024-10-01T02:40:11.494ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
84062024-10-01T02:40:11.494ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
84072024-10-01T02:40:11.494ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
84082024-10-01T02:40:11.494ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
84092024-10-01T02:40:11.494ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
84102024-10-01T02:40:11.494ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
84112024-10-01T02:40:11.494ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
84122024-10-01T02:40:11.494ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
84132024-10-01T02:40:11.494ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
84142024-10-01T02:40:11.494ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
84152024-10-01T02:40:11.494ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
84162024-10-01T02:40:11.495ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("1af5fb25-d768-4bc6-915c-0b4c59e1f0ef.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("293e78c2-b712-4c13-b502-e2be11a76306.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("71ea2e4f-4772-4ce7-8093-48597fd7fd92.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("71ea2e4f-4772-4ce7-8093-48597fd7fd92.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1664, tv_nsec: 935172207 } })
84172024-10-01T02:40:11.495ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("0a1ed896-5078-4267-b636-10151376f015.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("eb937866-c779-4a9e-aec4-cc18302d4ce1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("eb937866-c779-4a9e-aec4-cc18302d4ce1.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1664, tv_nsec: 935346800 } })
84182024-10-01T02:40:11.496ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84192024-10-01T02:40:11.497ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.975217ms iteration = 15 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
84202024-10-01T02:40:11.498ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84212024-10-01T02:40:11.498ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
84222024-10-01T02:40:11.498ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1664, tv_nsec: 938732557 } })
84232024-10-01T02:40:11.499ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 5.674995ms iteration = 9 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
84242024-10-01T02:40:11.499ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
84252024-10-01T02:40:11.499ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 5.569123ms iteration = 9 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
84262024-10-01T02:40:11.499ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
84272024-10-01T02:40:11.499ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
84282024-10-01T02:40:11.500ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
84292024-10-01T02:40:11.500ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1051
84302024-10-01T02:40:11.501ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
84312024-10-01T02:40:11.501ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
84322024-10-01T02:40:11.502ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
84332024-10-01T02:40:11.503ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
84342024-10-01T02:40:11.503ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-10-01 02:30:11.493381709 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
84352024-10-01T02:40:11.503ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 10.13551ms iteration = 8 status = {"expiration":"2024-10-01T02:30:11.493381709Z","pruned":[]}
84362024-10-01T02:40:11.503ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
84372024-10-01T02:40:11.503ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84382024-10-01T02:40:11.503ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84392024-10-01T02:40:11.504ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
84402024-10-01T02:40:11.505ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
84412024-10-01T02:40:11.506ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
84422024-10-01T02:40:11.506ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
84432024-10-01T02:40:11.507ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
84442024-10-01T02:40:11.508ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
84452024-10-01T02:40:11.508ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
84462024-10-01T02:40:11.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
84472024-10-01T02:40:11.512ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1664, tv_nsec: 951937528 } })
84482024-10-01T02:40:11.512ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84492024-10-01T02:40:11.513ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 19.817752ms iteration = 8 status = {"errors":[],"found_port_ok":[]}
84502024-10-01T02:40:11.513ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1051
84512024-10-01T02:40:11.515ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
84522024-10-01T02:40:11.515ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
84532024-10-01T02:40:11.515ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
84542024-10-01T02:40:11.520ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
84552024-10-01T02:40:11.520ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
84562024-10-01T02:40:11.524ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
84572024-10-01T02:40:11.524ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
84582024-10-01T02:40:11.525ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84592024-10-01T02:40:11.525ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
84602024-10-01T02:40:11.525ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
84612024-10-01T02:40:11.529ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
84622024-10-01T02:40:11.536ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84632024-10-01T02:40:11.537ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
84642024-10-01T02:40:11.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
84652024-10-01T02:40:11.539ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
84662024-10-01T02:40:11.539ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
84672024-10-01T02:40:11.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
84682024-10-01T02:40:11.541ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84692024-10-01T02:40:11.543ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84702024-10-01T02:40:11.545ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8f598f5c-ad31-4712-b43f-7ac75a933d07, lookup_type: ById(8f598f5c-ad31-4712-b43f-7ac75a933d07) } result = Ok(())
84712024-10-01T02:40:11.545ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
84722024-10-01T02:40:11.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
84732024-10-01T02:40:11.545ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 52.104944ms iteration = 15 status = {"errors":[],"garbage_collect_requested":[]}
84742024-10-01T02:40:11.547ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
84752024-10-01T02:40:11.547ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
84762024-10-01T02:40:11.547ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
84772024-10-01T02:40:11.547ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84782024-10-01T02:40:11.549ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
84792024-10-01T02:40:11.549ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
84802024-10-01T02:40:11.551ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
84812024-10-01T02:40:11.551ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
84822024-10-01T02:40:11.551ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
84832024-10-01T02:40:11.552ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84842024-10-01T02:40:11.552ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
84852024-10-01T02:40:11.552ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
84862024-10-01T02:40:11.552ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
84872024-10-01T02:40:11.553ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
84882024-10-01T02:40:11.554ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
84892024-10-01T02:40:11.554ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
84902024-10-01T02:40:11.554ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
84912024-10-01T02:40:11.558ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 65.03831ms iteration = 15 status = {"errors":[],"records_set_to_done":[]}
84922024-10-01T02:40:11.558ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 original_time_created = 2024-10-01 02:32:51.153042 UTC target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 time_created = 2024-10-01 02:32:51.153042 UTC
84932024-10-01T02:40:11.558ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 65.548898ms iteration = 43 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8f598f5c-ad31-4712-b43f-7ac75a933d07","time_created":"2024-10-01T02:32:51.153042Z"}
84942024-10-01T02:40:11.563ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1665, tv_nsec: 2813931 } })
84952024-10-01T02:40:11.563ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1051 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd
84962024-10-01T02:40:11.563ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
84972024-10-01T02:40:11.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
84982024-10-01T02:40:11.564ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
84992024-10-01T02:40:11.565ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
85002024-10-01T02:40:11.565ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
85012024-10-01T02:40:11.565ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
85022024-10-01T02:40:11.565ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
85032024-10-01T02:40:11.566ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
85042024-10-01T02:40:11.566ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 72.549405ms iteration = 15 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
85052024-10-01T02:40:11.566ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85062024-10-01T02:40:11.566ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
85072024-10-01T02:40:11.566ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
85082024-10-01T02:40:11.566ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 72.999044ms iteration = 8 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
85092024-10-01T02:40:11.567ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85102024-10-01T02:40:11.570ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
85112024-10-01T02:40:11.570ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
85122024-10-01T02:40:11.570ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
85132024-10-01T02:40:11.570ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
85142024-10-01T02:40:11.572ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
85152024-10-01T02:40:11.572ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
85162024-10-01T02:40:11.572ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
85172024-10-01T02:40:11.572ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
85182024-10-01T02:40:11.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
85192024-10-01T02:40:11.574ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
85202024-10-01T02:40:11.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
85212024-10-01T02:40:11.576ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85222024-10-01T02:40:11.580ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
85232024-10-01T02:40:11.581ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
85242024-10-01T02:40:11.581ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
85252024-10-01T02:40:11.581ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 1 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
85262024-10-01T02:40:11.581ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 87.406055ms iteration = 15 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":1,"total_instances":0,"update_sagas_queued":0}
85272024-10-01T02:40:11.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
85282024-10-01T02:40:11.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
85292024-10-01T02:40:11.583ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85302024-10-01T02:40:11.584ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 90.992304ms iteration = 15 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
85312024-10-01T02:40:11.585ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85322024-10-01T02:40:11.587ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 2a571ec0-85a3-450e-88fc-680c13ffa211, lookup_type: ById(2a571ec0-85a3-450e-88fc-680c13ffa211) } result = Ok(())
85332024-10-01T02:40:11.587ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
85342024-10-01T02:40:11.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
85352024-10-01T02:40:11.588ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
85362024-10-01T02:40:11.588ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
85372024-10-01T02:40:11.588ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
85382024-10-01T02:40:11.588ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
85392024-10-01T02:40:11.588ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
85402024-10-01T02:40:11.588ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
85412024-10-01T02:40:11.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
85422024-10-01T02:40:11.589ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
85432024-10-01T02:40:11.590ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 96.610739ms iteration = 15 status = 0
85442024-10-01T02:40:11.591ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85452024-10-01T02:40:11.594ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
85462024-10-01T02:40:11.594ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
85472024-10-01T02:40:11.595ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
85482024-10-01T02:40:11.595ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
85492024-10-01T02:40:11.595ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
85502024-10-01T02:40:11.595ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
85512024-10-01T02:40:11.595ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
85522024-10-01T02:40:11.596ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
85532024-10-01T02:40:11.596ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
85542024-10-01T02:40:11.596ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 102.819494ms iteration = 8 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
85552024-10-01T02:40:11.599ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
85562024-10-01T02:40:11.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
85572024-10-01T02:40:11.608ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
85582024-10-01T02:40:11.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
85592024-10-01T02:40:11.609ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 116.31955ms iteration = 43 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
85602024-10-01T02:40:11.610ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85612024-10-01T02:40:11.611ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
85622024-10-01T02:40:11.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
85632024-10-01T02:40:11.612ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
85642024-10-01T02:40:11.612ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
85652024-10-01T02:40:11.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
85662024-10-01T02:40:11.623ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
85672024-10-01T02:40:11.629ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
85682024-10-01T02:40:11.629ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = bc7b49a6-c38c-499f-983e-184e2c58fa04 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
85692024-10-01T02:40:11.629ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
85702024-10-01T02:40:11.629ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
85712024-10-01T02:40:11.631ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
85722024-10-01T02:40:11.632ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
85732024-10-01T02:40:11.632ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 138.340008ms iteration = 15 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
85742024-10-01T02:40:11.632ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
85752024-10-01T02:40:11.632ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 3d6d7965-c160-4184-b04f-32fa0fb7b928 dns_zone_name = oxide.test found_so_far = 0 version = 2
85762024-10-01T02:40:11.632ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
85772024-10-01T02:40:11.632ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
85782024-10-01T02:40:11.650ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 156.650675ms iteration = 15 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
85792024-10-01T02:40:11.662ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (changed) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-10-01T02:33:09.142901Z, time_modified: 2024-10-01T02:33:09.142901Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, db_silo: Silo { identity: SiloIdentity { id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-10-01T02:33:13.712784Z, time_modified: 2024-10-01T02:33:13.712784Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "ca547a59343cd98ceb775f10ce9428d8003a71a149b5b7d33f10c1e7a9820bb1" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, db_silo: Silo { identity: SiloIdentity { id: 21983b87-d6d0-47c6-a33c-5fe68fbed0c6, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-10-01T02:33:13.712784Z, time_modified: 2024-10-01T02:33:13.712784Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "ca547a59343cd98ceb775f10ce9428d8003a71a149b5b7d33f10c1e7a9820bb1" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:94
85802024-10-01T02:40:11.662ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 169.016152ms iteration = 9 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"21983b87-d6d0-47c6-a33c-5fe68fbed0c6","tls_certs":["ca547a59343cd98ceb775f10ce9428d8003a71a149b5b7d33f10c1e7a9820bb1"]}},"default_endpoint":{"silo_id":"21983b87-d6d0-47c6-a33c-5fe68fbed0c6","tls_certs":["ca547a59343cd98ceb775f10ce9428d8003a71a149b5b7d33f10c1e7a9820bb1"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
85812024-10-01T02:40:11.665ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1059 zone_address = fd00:1122:3344:101::2
85822024-10-01T02:40:11.665ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
85832024-10-01T02:40:11.665ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "83e7ae60-77d1-4663-902f-740fa6cb34d6", "content-length": "26", "date": "Tue, 01 Oct 2024 02:40:11 GMT"} })
85842024-10-01T02:40:11.665ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1064 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
85852024-10-01T02:40:11.667ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
85862024-10-01T02:40:11.669ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
85872024-10-01T02:40:11.669ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
85882024-10-01T02:40:11.674ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 181.268918ms iteration = 17 status = {"physical_disks_added":0}
85892024-10-01T02:40:11.702ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
85902024-10-01T02:40:11.702ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 209.341198ms iteration = 8 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
85912024-10-01T02:40:11.793ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
85922024-10-01T02:40:11.795ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85932024-10-01T02:40:11.796ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85942024-10-01T02:40:11.798ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
85952024-10-01T02:40:11.798ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
85962024-10-01T02:40:11.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
85972024-10-01T02:40:11.798ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
85982024-10-01T02:40:11.798ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
85992024-10-01T02:40:11.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
86002024-10-01T02:40:11.801ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = bc7b49a6-c38c-499f-983e-184e2c58fa04 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
86012024-10-01T02:40:11.801ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
86022024-10-01T02:40:11.801ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-10-01 02:33:12.369795 UTC dns_group = internal generation = 1
86032024-10-01T02:40:11.801ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 307.869759ms iteration = 9 status = {"generation":1}
86042024-10-01T02:40:11.813ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
86052024-10-01T02:40:11.819ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
86062024-10-01T02:40:11.825ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
86072024-10-01T02:40:11.826ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86082024-10-01T02:40:11.826ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "88fe454b-9d5a-4b5b-a02f-54d9d8d3e1f7", "content-length": "2", "date": "Tue, 01 Oct 2024 02:40:11 GMT"} })
86092024-10-01T02:40:11.828ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
86102024-10-01T02:40:11.828ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
86112024-10-01T02:40:11.828ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
86122024-10-01T02:40:11.828ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
86132024-10-01T02:40:11.828ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
86142024-10-01T02:40:11.830ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 337.260571ms iteration = 15 status = null
86152024-10-01T02:40:11.833ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86162024-10-01T02:40:11.836ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
86172024-10-01T02:40:11.836ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
86182024-10-01T02:40:11.836ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
86192024-10-01T02:40:11.837ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 3d6d7965-c160-4184-b04f-32fa0fb7b928 dns_zone_name = oxide.test found_so_far = 1 version = 2
86202024-10-01T02:40:11.837ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
86212024-10-01T02:40:11.837ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-10-01 02:33:13.765844 UTC dns_group = external generation = 2
86222024-10-01T02:40:11.837ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 344.2881ms iteration = 9 status = {"generation":2}
86232024-10-01T02:40:11.865ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "95b5ef13-80da-4cda-9a68-fb18d6ddec57", "content-length": "372", "date": "Tue, 01 Oct 2024 02:40:11 GMT"} })
86242024-10-01T02:40:11.865ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
86252024-10-01T02:40:11.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
86262024-10-01T02:40:11.868ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
86272024-10-01T02:40:11.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
86282024-10-01T02:40:11.870ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
86292024-10-01T02:40:11.871ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
86302024-10-01T02:40:11.874ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
86312024-10-01T02:40:11.875ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "c40e8c40-aeb0-4433-87fe-11d15c14b83e", "date": "Tue, 01 Oct 2024 02:40:11 GMT"} })
86322024-10-01T02:40:11.877ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 383.335424ms iteration = 16 status = {}
86332024-10-01T02:40:11.878ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1059 zone_address = fd00:1122:3344:101::2
86342024-10-01T02:40:11.878ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
86352024-10-01T02:40:11.878ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f5bc3f66-1942-4e31-8566-4e090f756a14", "content-length": "26", "date": "Tue, 01 Oct 2024 02:40:11 GMT"} })
86362024-10-01T02:40:11.878ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1064 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
86372024-10-01T02:40:11.881ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
86382024-10-01T02:40:11.932ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1059 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd zone_address = fd00:1122:3344:101::2
86392024-10-01T02:40:11.932ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
86402024-10-01T02:40:11.932ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b6a88af3-e8ec-423e-ac53-6effd3dd5106", "content-length": "26", "date": "Tue, 01 Oct 2024 02:40:11 GMT"} })
86412024-10-01T02:40:11.932ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1064 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
86422024-10-01T02:40:11.933ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd
86432024-10-01T02:40:11.944ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
86442024-10-01T02:40:11.945ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "b4b2370d-0c19-4cca-af02-6f0a2fc714d5", "date": "Tue, 01 Oct 2024 02:40:11 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
86452024-10-01T02:40:11.945ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
86462024-10-01T02:40:11.946ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "e627be1a-f11e-45a2-8b11-49aac33f85f2", "date": "Tue, 01 Oct 2024 02:40:11 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
86472024-10-01T02:40:11.946ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
86482024-10-01T02:40:11.948ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "77b2a5d9-d055-422f-b08f-0e7b321c67ba", "date": "Tue, 01 Oct 2024 02:40:11 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
86492024-10-01T02:40:11.948ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
86502024-10-01T02:40:11.950ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
86512024-10-01T02:40:11.950ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 457.331194ms iteration = 10 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
86522024-10-01T02:40:12.018ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 524.616641ms iteration = 15 status = {}
86532024-10-01T02:40:12.096ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
86542024-10-01T02:40:12.096ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "0f4502e9-7ad2-453d-bb4b-e2dc1e28783a", "date": "Tue, 01 Oct 2024 02:40:11 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
86552024-10-01T02:40:12.096ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
86562024-10-01T02:40:12.098ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "05d1da68-fab1-441b-9aeb-b89e5b77d890", "date": "Tue, 01 Oct 2024 02:40:11 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
86572024-10-01T02:40:12.098ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
86582024-10-01T02:40:12.099ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
86592024-10-01T02:40:12.099ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 606.254509ms iteration = 10 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
86602024-10-01T02:40:12.107ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
86612024-10-01T02:40:12.107ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "156db17d-b158-4c37-aa6b-d3c70cf56d24", "content-length": "691", "date": "Tue, 01 Oct 2024 02:40:11 GMT"} })
86622024-10-01T02:40:12.107ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
86632024-10-01T02:40:12.107ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
86642024-10-01T02:40:12.107ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
86652024-10-01T02:40:12.110ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 616.629703ms iteration = 15 status = {}
86662024-10-01T02:40:12.149ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
86672024-10-01T02:40:12.149ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
86682024-10-01T02:40:12.150ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 58c2bb06-eaf4-47b5-aefe-83ea06db2406, rack_id: 52547763-7759-42e1-81a9-8b833f59f5dd, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(57ef3335-befd-4872-b57f-5c2571dcca50) } rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd switch_location = Switch0
86692024-10-01T02:40:12.150ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
86702024-10-01T02:40:12.151ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
86712024-10-01T02:40:12.160ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
86722024-10-01T02:40:12.160ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "79507313-1dd4-4429-ac64-d5309b78a04c", "content-length": "121", "date": "Tue, 01 Oct 2024 02:40:12 GMT"} })
86732024-10-01T02:40:12.160ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
86742024-10-01T02:40:12.160ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 57ef3335-befd-4872-b57f-5c2571dcca50
86752024-10-01T02:40:12.160ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
86762024-10-01T02:40:12.160ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
86772024-10-01T02:40:12.161ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd routes = {}
86782024-10-01T02:40:12.161ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd routes = {}
86792024-10-01T02:40:12.161ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd
86802024-10-01T02:40:12.161ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
86812024-10-01T02:40:12.161ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
86822024-10-01T02:40:12.164ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
86832024-10-01T02:40:12.164ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "ee358110-40e6-445f-8699-cba5ce7e942f", "content-length": "2", "date": "Tue, 01 Oct 2024 02:40:12 GMT"} })
86842024-10-01T02:40:12.164ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
86852024-10-01T02:40:12.164ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "7daef06b-faef-431a-bb33-eab1cf7de524", "content-length": "52", "date": "Tue, 01 Oct 2024 02:40:12 GMT"} })
86862024-10-01T02:40:12.164ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd switch_location = Switch0
86872024-10-01T02:40:12.164ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
86882024-10-01T02:40:12.255ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "ff8e9dd9-4c87-439f-a590-b02f13b4870a", "date": "Tue, 01 Oct 2024 02:40:11 GMT"} })
86892024-10-01T02:40:12.255ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd switch = Switch0
86902024-10-01T02:40:12.255ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
86912024-10-01T02:40:12.256ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "7fb40851-afd5-4f2d-859e-e9e945b70d67", "content-length": "667", "date": "Tue, 01 Oct 2024 02:40:11 GMT"} })
86922024-10-01T02:40:12.256ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
86932024-10-01T02:40:12.256ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
86942024-10-01T02:40:12.260ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
86952024-10-01T02:40:12.260ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
86962024-10-01T02:40:12.263ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
86972024-10-01T02:40:12.264ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
86982024-10-01T02:40:12.265ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
86992024-10-01T02:40:12.265ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
87002024-10-01T02:40:12.273ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 780.171054ms iteration = 15 status = {}
87012024-10-01T02:40:14.997ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1826 local_addr = [fd00:1122:3344:101::c]:53319 method = GET remote_addr = [fd00:1122:3344:101::d]:65459 req_id = bbc97137-c186-43b5-80e6-c5f18fa51348 response_code = 200 uri = /3dfd7033-71d8-4eb9-bb97-49dae3b5cd35
87022024-10-01T02:40:21.493ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 44 reason = Timeout
87032024-10-01T02:40:21.493ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87042024-10-01T02:40:21.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
87052024-10-01T02:40:21.493ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 44 reason = Timeout
87062024-10-01T02:40:21.493ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
87072024-10-01T02:40:21.494ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
87082024-10-01T02:40:21.495ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87092024-10-01T02:40:21.498ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
87102024-10-01T02:40:21.498ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87112024-10-01T02:40:21.498ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
87122024-10-01T02:40:21.500ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87132024-10-01T02:40:21.500ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
87142024-10-01T02:40:21.502ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87152024-10-01T02:40:21.504ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8f598f5c-ad31-4712-b43f-7ac75a933d07, lookup_type: ById(8f598f5c-ad31-4712-b43f-7ac75a933d07) } result = Ok(())
87162024-10-01T02:40:21.504ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87172024-10-01T02:40:21.504ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
87182024-10-01T02:40:21.516ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 original_time_created = 2024-10-01 02:32:51.153042 UTC target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 time_created = 2024-10-01 02:32:51.153042 UTC
87192024-10-01T02:40:21.516ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.560998ms iteration = 44 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8f598f5c-ad31-4712-b43f-7ac75a933d07","time_created":"2024-10-01T02:32:51.153042Z"}
87202024-10-01T02:40:21.526ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
87212024-10-01T02:40:21.526ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
87222024-10-01T02:40:21.553ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 59.7281ms iteration = 44 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
87232024-10-01T02:40:24.997ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1126 local_addr = [fd00:1122:3344:101::c]:53319 method = GET remote_addr = [fd00:1122:3344:101::d]:65459 req_id = 21de19cd-4b76-4ba7-9171-baf33b0a5d58 response_code = 200 uri = /3dfd7033-71d8-4eb9-bb97-49dae3b5cd35
87242024-10-01T02:40:29.641ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:60878 req_id = 577f6554-c248-4ba6-ad32-f22d5e6e9d20 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/16?limit=100
87252024-10-01T02:40:29.641ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:60878 req_id = 577f6554-c248-4ba6-ad32-f22d5e6e9d20 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/16?limit=100
87262024-10-01T02:40:29.644ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2836 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:60878 req_id = 577f6554-c248-4ba6-ad32-f22d5e6e9d20 response_code = 200 uri = /nat/ipv4/changeset/16?limit=100
87272024-10-01T02:40:31.493ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 45 reason = Timeout
87282024-10-01T02:40:31.493ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87292024-10-01T02:40:31.494ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
87302024-10-01T02:40:31.494ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 45 reason = Timeout
87312024-10-01T02:40:31.494ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
87322024-10-01T02:40:31.494ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
87332024-10-01T02:40:31.496ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87342024-10-01T02:40:31.498ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
87352024-10-01T02:40:31.498ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87362024-10-01T02:40:31.498ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
87372024-10-01T02:40:31.500ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87382024-10-01T02:40:31.500ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
87392024-10-01T02:40:31.502ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87402024-10-01T02:40:31.505ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8f598f5c-ad31-4712-b43f-7ac75a933d07, lookup_type: ById(8f598f5c-ad31-4712-b43f-7ac75a933d07) } result = Ok(())
87412024-10-01T02:40:31.505ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87422024-10-01T02:40:31.505ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
87432024-10-01T02:40:31.513ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 original_time_created = 2024-10-01 02:32:51.153042 UTC target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 time_created = 2024-10-01 02:32:51.153042 UTC
87442024-10-01T02:40:31.513ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.886643ms iteration = 45 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8f598f5c-ad31-4712-b43f-7ac75a933d07","time_created":"2024-10-01T02:32:51.153042Z"}
87452024-10-01T02:40:31.522ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
87462024-10-01T02:40:31.523ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
87472024-10-01T02:40:31.553ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 59.893674ms iteration = 45 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
87482024-10-01T02:40:34.997ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1406 local_addr = [fd00:1122:3344:101::c]:53319 method = GET remote_addr = [fd00:1122:3344:101::d]:65459 req_id = 49673030-c336-48b7-b38c-23d9ebd25fec response_code = 200 uri = /3dfd7033-71d8-4eb9-bb97-49dae3b5cd35
87492024-10-01T02:40:41.493ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 46 reason = Timeout
87502024-10-01T02:40:41.493ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 16 reason = Timeout
87512024-10-01T02:40:41.493ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87522024-10-01T02:40:41.493ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
87532024-10-01T02:40:41.493ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 16 reason = Timeout
87542024-10-01T02:40:41.493ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 16 reason = Timeout
87552024-10-01T02:40:41.493ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
87562024-10-01T02:40:41.493ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 16 reason = Timeout
87572024-10-01T02:40:41.493ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
87582024-10-01T02:40:41.493ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 16 reason = Timeout
87592024-10-01T02:40:41.493ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
87602024-10-01T02:40:41.493ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 18 reason = Timeout
87612024-10-01T02:40:41.494ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 16 reason = Timeout
87622024-10-01T02:40:41.494ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
87632024-10-01T02:40:41.494ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
87642024-10-01T02:40:41.494ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 16 reason = Timeout
87652024-10-01T02:40:41.494ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
87662024-10-01T02:40:41.494ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 46 reason = Timeout
87672024-10-01T02:40:41.494ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
87682024-10-01T02:40:41.494ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 16 reason = Timeout
87692024-10-01T02:40:41.494ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
87702024-10-01T02:40:41.494ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 16 reason = Timeout
87712024-10-01T02:40:41.494ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
87722024-10-01T02:40:41.494ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 16 reason = Timeout
87732024-10-01T02:40:41.494ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
87742024-10-01T02:40:41.494ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 16 reason = Timeout
87752024-10-01T02:40:41.494ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
87762024-10-01T02:40:41.494ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
87772024-10-01T02:40:41.494ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 16 reason = Timeout
87782024-10-01T02:40:41.494ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
87792024-10-01T02:40:41.494ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 16 reason = Timeout
87802024-10-01T02:40:41.494ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
87812024-10-01T02:40:41.494ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 17 reason = Timeout
87822024-10-01T02:40:41.494ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
87832024-10-01T02:40:41.494ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
87842024-10-01T02:40:41.494ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
87852024-10-01T02:40:41.494ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
87862024-10-01T02:40:41.494ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
87872024-10-01T02:40:41.494ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
87882024-10-01T02:40:41.494ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
87892024-10-01T02:40:41.494ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
87902024-10-01T02:40:41.494ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
87912024-10-01T02:40:41.494ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
87922024-10-01T02:40:41.494ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
87932024-10-01T02:40:41.494ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
87942024-10-01T02:40:41.494ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
87952024-10-01T02:40:41.494ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
87962024-10-01T02:40:41.494ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
87972024-10-01T02:40:41.494ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
87982024-10-01T02:40:41.494ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
87992024-10-01T02:40:41.497ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.454137ms iteration = 16 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
88002024-10-01T02:40:41.497ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1694, tv_nsec: 936936806 } })
88012024-10-01T02:40:41.498ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1051
88022024-10-01T02:40:41.501ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1694, tv_nsec: 940983024 } })
88032024-10-01T02:40:41.502ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1051
88042024-10-01T02:40:41.504ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88052024-10-01T02:40:41.506ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
88062024-10-01T02:40:41.506ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
88072024-10-01T02:40:41.506ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
88082024-10-01T02:40:41.545ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88092024-10-01T02:40:41.547ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 53.024749ms iteration = 16 status = {"errors":[],"records_set_to_done":[]}
88102024-10-01T02:40:41.548ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88112024-10-01T02:40:41.548ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88122024-10-01T02:40:41.548ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88132024-10-01T02:40:41.549ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
88142024-10-01T02:40:41.549ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
88152024-10-01T02:40:41.550ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
88162024-10-01T02:40:41.550ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
88172024-10-01T02:40:41.550ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
88182024-10-01T02:40:41.550ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
88192024-10-01T02:40:41.550ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
88202024-10-01T02:40:41.551ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
88212024-10-01T02:40:41.551ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
88222024-10-01T02:40:41.551ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
88232024-10-01T02:40:41.551ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
88242024-10-01T02:40:41.551ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
88252024-10-01T02:40:41.551ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
88262024-10-01T02:40:41.552ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
88272024-10-01T02:40:41.552ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
88282024-10-01T02:40:41.552ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
88292024-10-01T02:40:41.552ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
88302024-10-01T02:40:41.552ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
88312024-10-01T02:40:41.552ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
88322024-10-01T02:40:41.552ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
88332024-10-01T02:40:41.552ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
88342024-10-01T02:40:41.553ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
88352024-10-01T02:40:41.554ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
88362024-10-01T02:40:41.554ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
88372024-10-01T02:40:41.555ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88382024-10-01T02:40:41.555ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
88392024-10-01T02:40:41.555ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
88402024-10-01T02:40:41.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
88412024-10-01T02:40:41.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
88422024-10-01T02:40:41.555ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a571ec0-85a3-450e-88fc-680c13ffa211.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1694, tv_nsec: 995239694 } })
88432024-10-01T02:40:41.555ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88442024-10-01T02:40:41.556ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
88452024-10-01T02:40:41.556ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
88462024-10-01T02:40:41.557ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1051 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd
88472024-10-01T02:40:41.557ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
88482024-10-01T02:40:41.557ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
88492024-10-01T02:40:41.557ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
88502024-10-01T02:40:41.558ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 64.095474ms iteration = 16 status = {"errors":[],"garbage_collect_requested":[]}
88512024-10-01T02:40:41.558ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8f598f5c-ad31-4712-b43f-7ac75a933d07, lookup_type: ById(8f598f5c-ad31-4712-b43f-7ac75a933d07) } result = Ok(())
88522024-10-01T02:40:41.558ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
88532024-10-01T02:40:41.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
88542024-10-01T02:40:41.559ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88552024-10-01T02:40:41.561ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88562024-10-01T02:40:41.561ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
88572024-10-01T02:40:41.561ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
88582024-10-01T02:40:41.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
88592024-10-01T02:40:41.564ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
88602024-10-01T02:40:41.564ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
88612024-10-01T02:40:41.565ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
88622024-10-01T02:40:41.569ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 original_time_created = 2024-10-01 02:32:51.153042 UTC target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 time_created = 2024-10-01 02:32:51.153042 UTC
88632024-10-01T02:40:41.569ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 75.301422ms iteration = 46 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8f598f5c-ad31-4712-b43f-7ac75a933d07","time_created":"2024-10-01T02:32:51.153042Z"}
88642024-10-01T02:40:41.578ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
88652024-10-01T02:40:41.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
88662024-10-01T02:40:41.579ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 85.634025ms iteration = 16 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
88672024-10-01T02:40:41.581ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
88682024-10-01T02:40:41.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
88692024-10-01T02:40:41.582ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 88.182778ms iteration = 46 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
88702024-10-01T02:40:41.582ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
88712024-10-01T02:40:41.582ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
88722024-10-01T02:40:41.582ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
88732024-10-01T02:40:41.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
88742024-10-01T02:40:41.582ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88752024-10-01T02:40:41.583ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1059 zone_address = fd00:1122:3344:101::2
88762024-10-01T02:40:41.583ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
88772024-10-01T02:40:41.584ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d86dc897-76a4-48fa-840f-1e1461d9fd07", "content-length": "26", "date": "Tue, 01 Oct 2024 02:40:41 GMT"} })
88782024-10-01T02:40:41.584ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1064 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
88792024-10-01T02:40:41.585ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1059 zone_address = fd00:1122:3344:101::2
88802024-10-01T02:40:41.585ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
88812024-10-01T02:40:41.585ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "23ba660b-b861-4c8b-9693-83eae490ebca", "content-length": "26", "date": "Tue, 01 Oct 2024 02:40:41 GMT"} })
88822024-10-01T02:40:41.585ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1064 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
88832024-10-01T02:40:41.585ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 2a571ec0-85a3-450e-88fc-680c13ffa211, lookup_type: ById(2a571ec0-85a3-450e-88fc-680c13ffa211) } result = Ok(())
88842024-10-01T02:40:41.585ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
88852024-10-01T02:40:41.585ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
88862024-10-01T02:40:41.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
88872024-10-01T02:40:41.585ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
88882024-10-01T02:40:41.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
88892024-10-01T02:40:41.587ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
88902024-10-01T02:40:41.587ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 93.865023ms iteration = 16 status = 0
88912024-10-01T02:40:41.596ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 103.001776ms iteration = 16 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
88922024-10-01T02:40:41.598ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
88932024-10-01T02:40:41.598ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 104.41675ms iteration = 16 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
88942024-10-01T02:40:41.609ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
88952024-10-01T02:40:41.609ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
88962024-10-01T02:40:41.609ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 115.376383ms iteration = 16 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
88972024-10-01T02:40:41.613ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 119.90718ms iteration = 16 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
88982024-10-01T02:40:41.624ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
88992024-10-01T02:40:41.624ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
89002024-10-01T02:40:41.636ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1059 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd zone_address = fd00:1122:3344:101::2
89012024-10-01T02:40:41.636ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
89022024-10-01T02:40:41.636ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "25f46224-f882-4449-99ad-81ffb68c2c2c", "content-length": "26", "date": "Tue, 01 Oct 2024 02:40:41 GMT"} })
89032024-10-01T02:40:41.636ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1064 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
89042024-10-01T02:40:41.638ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd
89052024-10-01T02:40:41.648ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 154.768864ms iteration = 18 status = {"physical_disks_added":0}
89062024-10-01T02:40:41.683ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
89072024-10-01T02:40:41.683ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "ee3ec7bc-4646-498c-8689-35294c701f41", "content-length": "2", "date": "Tue, 01 Oct 2024 02:40:41 GMT"} })
89082024-10-01T02:40:41.686ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
89092024-10-01T02:40:41.686ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 193.022815ms iteration = 16 status = {}
89102024-10-01T02:40:41.686ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
89112024-10-01T02:40:41.687ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 194.053671ms iteration = 16 status = null
89122024-10-01T02:40:41.707ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
89132024-10-01T02:40:41.708ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "64a2038e-d5e1-422e-8973-b5b6c73f9362", "content-length": "372", "date": "Tue, 01 Oct 2024 02:40:41 GMT"} })
89142024-10-01T02:40:41.708ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
89152024-10-01T02:40:41.708ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
89162024-10-01T02:40:41.709ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
89172024-10-01T02:40:41.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
89182024-10-01T02:40:41.713ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
89192024-10-01T02:40:41.713ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
89202024-10-01T02:40:41.715ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
89212024-10-01T02:40:41.715ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
89222024-10-01T02:40:41.716ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
89232024-10-01T02:40:41.716ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "7d146af7-4e22-4301-8431-4720c86e86fb", "date": "Tue, 01 Oct 2024 02:40:41 GMT"} })
89242024-10-01T02:40:41.717ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89252024-10-01T02:40:41.718ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 224.167586ms iteration = 17 status = {}
89262024-10-01T02:40:41.719ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
89272024-10-01T02:40:41.719ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
89282024-10-01T02:40:41.719ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
89292024-10-01T02:40:41.720ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89302024-10-01T02:40:41.722ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
89312024-10-01T02:40:41.722ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
89322024-10-01T02:40:41.722ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
89332024-10-01T02:40:41.776ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
89342024-10-01T02:40:41.776ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
89352024-10-01T02:40:41.778ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 58c2bb06-eaf4-47b5-aefe-83ea06db2406, rack_id: 52547763-7759-42e1-81a9-8b833f59f5dd, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(57ef3335-befd-4872-b57f-5c2571dcca50) } rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd switch_location = Switch0
89362024-10-01T02:40:41.778ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
89372024-10-01T02:40:41.779ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
89382024-10-01T02:40:41.788ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
89392024-10-01T02:40:41.788ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "a2c550e2-a54f-4af1-bcf3-60739d09fc3a", "content-length": "121", "date": "Tue, 01 Oct 2024 02:40:41 GMT"} })
89402024-10-01T02:40:41.788ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
89412024-10-01T02:40:41.788ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 57ef3335-befd-4872-b57f-5c2571dcca50
89422024-10-01T02:40:41.788ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
89432024-10-01T02:40:41.788ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
89442024-10-01T02:40:41.788ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd routes = {}
89452024-10-01T02:40:41.788ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd routes = {}
89462024-10-01T02:40:41.788ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd
89472024-10-01T02:40:41.788ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
89482024-10-01T02:40:41.788ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
89492024-10-01T02:40:41.790ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
89502024-10-01T02:40:41.790ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "7ae903e7-8fff-4cea-8692-4e11fce4e9ba", "content-length": "2", "date": "Tue, 01 Oct 2024 02:40:41 GMT"} })
89512024-10-01T02:40:41.790ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
89522024-10-01T02:40:41.790ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "aaa29043-ad12-49c9-bc1a-a9620b021e6f", "content-length": "52", "date": "Tue, 01 Oct 2024 02:40:41 GMT"} })
89532024-10-01T02:40:41.791ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd switch_location = Switch0
89542024-10-01T02:40:41.791ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
89552024-10-01T02:40:41.810ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
89562024-10-01T02:40:41.888ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "10b615b1-6d62-4689-9428-d3eaffd787fb", "date": "Tue, 01 Oct 2024 02:40:41 GMT"} })
89572024-10-01T02:40:41.888ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd switch = Switch0
89582024-10-01T02:40:41.888ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
89592024-10-01T02:40:41.889ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a571ec0-85a3-450e-88fc-680c13ffa211 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "6e145a0d-c0a9-477d-8331-717884494cfa", "content-length": "691", "date": "Tue, 01 Oct 2024 02:40:41 GMT"} })
89602024-10-01T02:40:41.889ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
89612024-10-01T02:40:41.889ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
89622024-10-01T02:40:41.889ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
89632024-10-01T02:40:41.890ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 396.261911ms iteration = 16 status = {}
89642024-10-01T02:40:41.890ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 52547763-7759-42e1-81a9-8b833f59f5dd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "6bf184df-ab49-41a8-9188-66a44a6af815", "content-length": "667", "date": "Tue, 01 Oct 2024 02:40:41 GMT"} })
89652024-10-01T02:40:41.890ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
89662024-10-01T02:40:41.890ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
89672024-10-01T02:40:41.893ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
89682024-10-01T02:40:41.893ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
89692024-10-01T02:40:41.896ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
89702024-10-01T02:40:41.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
89712024-10-01T02:40:41.899ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
89722024-10-01T02:40:41.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
89732024-10-01T02:40:41.906ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 412.848308ms iteration = 16 status = {}
89742024-10-01T02:40:43.554ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:40612
89752024-10-01T02:40:43.554ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:40612 req_id = 5cc9678d-7120-4bf4-9f7a-03e3f8cd1037 roles = RoleSet { roles: {} } uri = /metrics/producers
89762024-10-01T02:40:43.555ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:40612 req_id = 5cc9678d-7120-4bf4-9f7a-03e3f8cd1037 resource = Database result = Ok(()) uri = /metrics/producers
89772024-10-01T02:40:43.588ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 41f2943e-6041-44c9-a47a-3cf5fb012644
89782024-10-01T02:40:43.588ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:40612 req_id = 5cc9678d-7120-4bf4-9f7a-03e3f8cd1037 roles = RoleSet { roles: {} } uri = /metrics/producers
89792024-10-01T02:40:43.588ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:40612 req_id = 5cc9678d-7120-4bf4-9f7a-03e3f8cd1037 resource = Database result = Ok(()) uri = /metrics/producers
89802024-10-01T02:40:43.628ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 41f2943e-6041-44c9-a47a-3cf5fb012644 uri = http://[fd00:1122:3344:101::d]:12223/producers
89812024-10-01T02:40:43.628ZDEBGnexus: client response oximeter-collector = 41f2943e-6041-44c9-a47a-3cf5fb012644 result = Ok(Response { url: "http://[fd00:1122:3344:101::d]:12223/producers", status: 204, headers: {"x-request-id": "2415fa11-58bc-4894-84bb-92ed0d39e306", "date": "Tue, 01 Oct 2024 02:40:43 GMT"} })
89822024-10-01T02:40:43.628ZINFOnexus: assigned collector to new producer collector_id = 41f2943e-6041-44c9-a47a-3cf5fb012644 file = nexus/src/app/oximeter.rs:125 producer_id = 0fb48756-e6d8-4a38-934b-d9ec5c59cf45
89832024-10-01T02:40:43.629ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 74684 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:40612 req_id = 5cc9678d-7120-4bf4-9f7a-03e3f8cd1037 response_code = 201 uri = /metrics/producers
89842024-10-01T02:40:44.997ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1192 local_addr = [fd00:1122:3344:101::c]:53319 method = GET remote_addr = [fd00:1122:3344:101::d]:65459 req_id = 53b735bc-eaf8-4d64-99da-dd8bffd6a6d4 response_code = 200 uri = /3dfd7033-71d8-4eb9-bb97-49dae3b5cd35
89852024-10-01T02:40:44.999ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
89862024-10-01T02:40:44.999ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
89872024-10-01T02:40:45.030ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
89882024-10-01T02:40:45.030ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:46489
89892024-10-01T02:40:45.030ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:46489 req_id = c9ecba4a-15b9-4013-ba24-52f70d8599b5 roles = RoleSet { roles: {} } uri = /metrics/producers
89902024-10-01T02:40:45.030ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:46489 req_id = c9ecba4a-15b9-4013-ba24-52f70d8599b5 resource = Database result = Ok(()) uri = /metrics/producers
89912024-10-01T02:40:45.063ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 41f2943e-6041-44c9-a47a-3cf5fb012644
89922024-10-01T02:40:45.063ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:46489 req_id = c9ecba4a-15b9-4013-ba24-52f70d8599b5 roles = RoleSet { roles: {} } uri = /metrics/producers
89932024-10-01T02:40:45.064ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:46489 req_id = c9ecba4a-15b9-4013-ba24-52f70d8599b5 resource = Database result = Ok(()) uri = /metrics/producers
89942024-10-01T02:40:45.097ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 41f2943e-6041-44c9-a47a-3cf5fb012644 uri = http://[fd00:1122:3344:101::d]:12223/producers
89952024-10-01T02:40:45.098ZDEBGnexus: client response oximeter-collector = 41f2943e-6041-44c9-a47a-3cf5fb012644 result = Ok(Response { url: "http://[fd00:1122:3344:101::d]:12223/producers", status: 204, headers: {"x-request-id": "66f473c3-810a-419f-9836-a0cac8b80e28", "date": "Tue, 01 Oct 2024 02:40:45 GMT"} })
89962024-10-01T02:40:45.098ZINFOnexus: assigned collector to new producer collector_id = 41f2943e-6041-44c9-a47a-3cf5fb012644 file = nexus/src/app/oximeter.rs:125 producer_id = 3dfd7033-71d8-4eb9-bb97-49dae3b5cd35
89972024-10-01T02:40:45.099ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 69151 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:46489 req_id = c9ecba4a-15b9-4013-ba24-52f70d8599b5 response_code = 201 uri = /metrics/producers
89982024-10-01T02:40:45.099ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "c9ecba4a-15b9-4013-ba24-52f70d8599b5", "content-length": "41", "date": "Tue, 01 Oct 2024 02:40:45 GMT"} })
89992024-10-01T02:40:45.100ZDEBGnexus (producer-registration-task): registered with nexus successfully
90002024-10-01T02:40:45.100ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
90012024-10-01T02:40:47.725ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:34645
90022024-10-01T02:40:47.725ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:34645 req_id = 8555e080-f04e-46c3-af24-d441ee6d5ce2 roles = RoleSet { roles: {} } uri = /metrics/producers
90032024-10-01T02:40:47.725ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:34645 req_id = 8555e080-f04e-46c3-af24-d441ee6d5ce2 resource = Database result = Ok(()) uri = /metrics/producers
90042024-10-01T02:40:47.758ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 41f2943e-6041-44c9-a47a-3cf5fb012644
90052024-10-01T02:40:47.758ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:34645 req_id = 8555e080-f04e-46c3-af24-d441ee6d5ce2 roles = RoleSet { roles: {} } uri = /metrics/producers
90062024-10-01T02:40:47.759ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:34645 req_id = 8555e080-f04e-46c3-af24-d441ee6d5ce2 resource = Database result = Ok(()) uri = /metrics/producers
90072024-10-01T02:40:47.795ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 41f2943e-6041-44c9-a47a-3cf5fb012644 uri = http://[fd00:1122:3344:101::d]:12223/producers
90082024-10-01T02:40:47.796ZDEBGnexus: client response oximeter-collector = 41f2943e-6041-44c9-a47a-3cf5fb012644 result = Ok(Response { url: "http://[fd00:1122:3344:101::d]:12223/producers", status: 204, headers: {"x-request-id": "1b4b099b-8f26-4608-9f6a-bad84dd176cd", "date": "Tue, 01 Oct 2024 02:40:47 GMT"} })
90092024-10-01T02:40:47.796ZINFOnexus: assigned collector to new producer collector_id = 41f2943e-6041-44c9-a47a-3cf5fb012644 file = nexus/src/app/oximeter.rs:125 producer_id = d6787ad6-35ff-481f-bec7-5f0d93835d2a
90102024-10-01T02:40:47.796ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 71671 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:34645 req_id = 8555e080-f04e-46c3-af24-d441ee6d5ce2 response_code = 201 uri = /metrics/producers
90112024-10-01T02:40:51.493ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 47 reason = Timeout
90122024-10-01T02:40:51.493ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
90132024-10-01T02:40:51.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
90142024-10-01T02:40:51.493ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 47 reason = Timeout
90152024-10-01T02:40:51.493ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
90162024-10-01T02:40:51.494ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
90172024-10-01T02:40:51.495ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90182024-10-01T02:40:51.496ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
90192024-10-01T02:40:51.496ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
90202024-10-01T02:40:51.498ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.117819ms iteration = 47 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
90212024-10-01T02:40:51.498ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
90222024-10-01T02:40:51.498ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
90232024-10-01T02:40:51.498ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
90242024-10-01T02:40:51.500ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
90252024-10-01T02:40:51.500ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
90262024-10-01T02:40:51.502ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90272024-10-01T02:40:51.504ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8f598f5c-ad31-4712-b43f-7ac75a933d07, lookup_type: ById(8f598f5c-ad31-4712-b43f-7ac75a933d07) } result = Ok(())
90282024-10-01T02:40:51.504ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
90292024-10-01T02:40:51.505ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
90302024-10-01T02:40:51.512ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 original_time_created = 2024-10-01 02:32:51.153042 UTC target_id = 8f598f5c-ad31-4712-b43f-7ac75a933d07 time_created = 2024-10-01 02:32:51.153042 UTC
90312024-10-01T02:40:51.512ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.447396ms iteration = 47 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8f598f5c-ad31-4712-b43f-7ac75a933d07","time_created":"2024-10-01T02:32:51.153042Z"}
90322024-10-01T02:40:52.538ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:48886
90332024-10-01T02:40:52.538ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:48886 req_id = be504a82-07f3-44ee-ac41-e7be805ddb28 roles = RoleSet { roles: {} } uri = /metrics/producers
90342024-10-01T02:40:52.539ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:48886 req_id = be504a82-07f3-44ee-ac41-e7be805ddb28 resource = Database result = Ok(()) uri = /metrics/producers
90352024-10-01T02:40:52.572ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 41f2943e-6041-44c9-a47a-3cf5fb012644
90362024-10-01T02:40:52.572ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:48886 req_id = be504a82-07f3-44ee-ac41-e7be805ddb28 roles = RoleSet { roles: {} } uri = /metrics/producers
90372024-10-01T02:40:52.572ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:48886 req_id = be504a82-07f3-44ee-ac41-e7be805ddb28 resource = Database result = Ok(()) uri = /metrics/producers
90382024-10-01T02:40:52.583ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 41f2943e-6041-44c9-a47a-3cf5fb012644 uri = http://[fd00:1122:3344:101::d]:12223/producers
90392024-10-01T02:40:52.583ZDEBGnexus: client response oximeter-collector = 41f2943e-6041-44c9-a47a-3cf5fb012644 result = Ok(Response { url: "http://[fd00:1122:3344:101::d]:12223/producers", status: 204, headers: {"x-request-id": "0fc2c6f9-34a3-4f1d-9898-802c03640e14", "date": "Tue, 01 Oct 2024 02:40:52 GMT"} })
90402024-10-01T02:40:52.583ZINFOnexus: assigned collector to new producer collector_id = 41f2943e-6041-44c9-a47a-3cf5fb012644 file = nexus/src/app/oximeter.rs:125 producer_id = 2a571ec0-85a3-450e-88fc-680c13ffa211
90412024-10-01T02:40:52.584ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 46046 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:48886 req_id = be504a82-07f3-44ee-ac41-e7be805ddb28 response_code = 201 uri = /metrics/producers
90422024-10-01T02:40:52.748ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:41704
90432024-10-01T02:40:52.748ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:41704 req_id = b4056be2-0de1-4a7a-9969-5ab6b604da8d roles = RoleSet { roles: {} } uri = /metrics/producers
90442024-10-01T02:40:52.749ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:41704 req_id = b4056be2-0de1-4a7a-9969-5ab6b604da8d resource = Database result = Ok(()) uri = /metrics/producers
90452024-10-01T02:40:52.781ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 41f2943e-6041-44c9-a47a-3cf5fb012644
90462024-10-01T02:40:52.781ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:41704 req_id = b4056be2-0de1-4a7a-9969-5ab6b604da8d roles = RoleSet { roles: {} } uri = /metrics/producers
90472024-10-01T02:40:52.782ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:41704 req_id = b4056be2-0de1-4a7a-9969-5ab6b604da8d resource = Database result = Ok(()) uri = /metrics/producers
90482024-10-01T02:40:52.792ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 41f2943e-6041-44c9-a47a-3cf5fb012644 uri = http://[fd00:1122:3344:101::d]:12223/producers
90492024-10-01T02:40:52.793ZDEBGnexus: client response oximeter-collector = 41f2943e-6041-44c9-a47a-3cf5fb012644 result = Ok(Response { url: "http://[fd00:1122:3344:101::d]:12223/producers", status: 204, headers: {"x-request-id": "881d0a01-7a87-4d7c-ba90-19d30af7227d", "date": "Tue, 01 Oct 2024 02:40:52 GMT"} })
90502024-10-01T02:40:52.793ZINFOnexus: assigned collector to new producer collector_id = 41f2943e-6041-44c9-a47a-3cf5fb012644 file = nexus/src/app/oximeter.rs:125 producer_id = 4fd91d04-882e-49df-98b0-1430a0f50382
90512024-10-01T02:40:52.794ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 45838 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:41704 req_id = b4056be2-0de1-4a7a-9969-5ab6b604da8d response_code = 201 uri = /metrics/producers
90522024-10-01T02:40:55.101ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1406 local_addr = [fd00:1122:3344:101::c]:53319 method = GET remote_addr = [fd00:1122:3344:101::d]:65459 req_id = 01dbb927-717b-4893-ba80-19daaf8afe39 response_code = 200 uri = /3dfd7033-71d8-4eb9-bb97-49dae3b5cd35
90532024-10-01T02:40:55.255ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:51801
90542024-10-01T02:40:55.255ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:51801 req_id = 042752b9-4857-4852-bed7-89c47ea8d074 roles = RoleSet { roles: {} } uri = /metrics/producers
90552024-10-01T02:40:55.255ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:51801 req_id = 042752b9-4857-4852-bed7-89c47ea8d074 resource = Database result = Ok(()) uri = /metrics/producers
90562024-10-01T02:40:55.287ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 41f2943e-6041-44c9-a47a-3cf5fb012644
90572024-10-01T02:40:55.287ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:51801 req_id = 042752b9-4857-4852-bed7-89c47ea8d074 roles = RoleSet { roles: {} } uri = /metrics/producers
90582024-10-01T02:40:55.288ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:51801 req_id = 042752b9-4857-4852-bed7-89c47ea8d074 resource = Database result = Ok(()) uri = /metrics/producers
90592024-10-01T02:40:55.325ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 41f2943e-6041-44c9-a47a-3cf5fb012644 uri = http://[fd00:1122:3344:101::d]:12223/producers
90602024-10-01T02:40:55.326ZDEBGnexus: client response oximeter-collector = 41f2943e-6041-44c9-a47a-3cf5fb012644 result = Ok(Response { url: "http://[fd00:1122:3344:101::d]:12223/producers", status: 204, headers: {"x-request-id": "02b62d95-2883-472a-a364-df2604081967", "date": "Tue, 01 Oct 2024 02:40:55 GMT"} })
90612024-10-01T02:40:55.326ZINFOnexus: assigned collector to new producer collector_id = 41f2943e-6041-44c9-a47a-3cf5fb012644 file = nexus/src/app/oximeter.rs:125 producer_id = 4de8ea2f-2b9b-467c-9e71-58559e244afd
90622024-10-01T02:40:55.328ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 72964 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:51801 req_id = 042752b9-4857-4852-bed7-89c47ea8d074 response_code = 201 uri = /metrics/producers