Max level shown:
1 [ Dec 14 03:34:46 Enabled. ]
2 [ Dec 14 03:34:46 Rereading configuration. ]
3 [ Dec 14 03:34:47 Rereading configuration. ]
4 [ Dec 14 03:34:54 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/omicron-nexus/bin/nexus /var/svc/manifest/site/nexus/config.toml &"). ]
5 [ Dec 14 03:34:54 Method "start" exited with status 0. ]
6 note: configured to log to "/dev/stdout"
72024-12-14T03:34:54.606ZDEBGnexus: registered DTrace probes
82024-12-14T03:34:54.608ZINFOnexus: setting up nexus server file = nexus/src/lib.rs:75
92024-12-14T03:34:54.621ZINFOnexus (ServerContext): registering Oso class class = Action file = nexus/auth/src/authz/oso_generic.rs:68
102024-12-14T03:34:54.621ZINFOnexus (ServerContext): registering Oso class class = AnyActor file = nexus/auth/src/authz/oso_generic.rs:68
112024-12-14T03:34:54.621ZINFOnexus (ServerContext): registering Oso class class = AuthenticatedActor file = nexus/auth/src/authz/oso_generic.rs:68
122024-12-14T03:34:54.621ZINFOnexus (ServerContext): registering Oso class class = BlueprintConfig file = nexus/auth/src/authz/oso_generic.rs:68
132024-12-14T03:34:54.621ZINFOnexus (ServerContext): registering Oso class class = Database file = nexus/auth/src/authz/oso_generic.rs:68
142024-12-14T03:34:54.621ZINFOnexus (ServerContext): registering Oso class class = DnsConfig file = nexus/auth/src/authz/oso_generic.rs:68
152024-12-14T03:34:54.621ZINFOnexus (ServerContext): registering Oso class class = Fleet file = nexus/auth/src/authz/oso_generic.rs:68
162024-12-14T03:34:54.621ZINFOnexus (ServerContext): registering Oso class class = Inventory file = nexus/auth/src/authz/oso_generic.rs:68
172024-12-14T03:34:54.621ZINFOnexus (ServerContext): registering Oso class class = IpPoolList file = nexus/auth/src/authz/oso_generic.rs:68
182024-12-14T03:34:54.621ZINFOnexus (ServerContext): registering Oso class class = ConsoleSessionList file = nexus/auth/src/authz/oso_generic.rs:68
192024-12-14T03:34:54.621ZINFOnexus (ServerContext): registering Oso class class = DeviceAuthRequestList file = nexus/auth/src/authz/oso_generic.rs:68
202024-12-14T03:34:54.621ZINFOnexus (ServerContext): registering Oso class class = SiloCertificateList file = nexus/auth/src/authz/oso_generic.rs:68
212024-12-14T03:34:54.621ZINFOnexus (ServerContext): registering Oso class class = SiloIdentityProviderList file = nexus/auth/src/authz/oso_generic.rs:68
222024-12-14T03:34:54.621ZINFOnexus (ServerContext): registering Oso class class = SiloUserList file = nexus/auth/src/authz/oso_generic.rs:68
232024-12-14T03:34:54.621ZINFOnexus (ServerContext): registering Oso class class = Project file = nexus/auth/src/authz/oso_generic.rs:68
242024-12-14T03:34:54.621ZINFOnexus (ServerContext): registering Oso class class = Disk file = nexus/auth/src/authz/oso_generic.rs:68
252024-12-14T03:34:54.621ZINFOnexus (ServerContext): registering Oso class class = Snapshot file = nexus/auth/src/authz/oso_generic.rs:68
262024-12-14T03:34:54.621ZINFOnexus (ServerContext): registering Oso class class = ProjectImage file = nexus/auth/src/authz/oso_generic.rs:68
272024-12-14T03:34:54.621ZINFOnexus (ServerContext): registering Oso class class = Instance file = nexus/auth/src/authz/oso_generic.rs:68
282024-12-14T03:34:54.621ZINFOnexus (ServerContext): registering Oso class class = IpPool file = nexus/auth/src/authz/oso_generic.rs:68
292024-12-14T03:34:54.621ZINFOnexus (ServerContext): registering Oso class class = InstanceNetworkInterface file = nexus/auth/src/authz/oso_generic.rs:68
302024-12-14T03:34:54.621ZINFOnexus (ServerContext): registering Oso class class = Vpc file = nexus/auth/src/authz/oso_generic.rs:68
312024-12-14T03:34:54.621ZINFOnexus (ServerContext): registering Oso class class = VpcRouter file = nexus/auth/src/authz/oso_generic.rs:68
322024-12-14T03:34:54.621ZINFOnexus (ServerContext): registering Oso class class = InternetGateway file = nexus/auth/src/authz/oso_generic.rs:68
332024-12-14T03:34:54.621ZINFOnexus (ServerContext): registering Oso class class = InternetGatewayIpPool file = nexus/auth/src/authz/oso_generic.rs:68
342024-12-14T03:34:54.621ZINFOnexus (ServerContext): registering Oso class class = InternetGatewayIpAddress file = nexus/auth/src/authz/oso_generic.rs:68
352024-12-14T03:34:54.621ZINFOnexus (ServerContext): registering Oso class class = RouterRoute file = nexus/auth/src/authz/oso_generic.rs:68
362024-12-14T03:34:54.621ZINFOnexus (ServerContext): registering Oso class class = VpcSubnet file = nexus/auth/src/authz/oso_generic.rs:68
372024-12-14T03:34:54.621ZINFOnexus (ServerContext): registering Oso class class = FloatingIp file = nexus/auth/src/authz/oso_generic.rs:68
382024-12-14T03:34:54.621ZINFOnexus (ServerContext): registering Oso class class = Image file = nexus/auth/src/authz/oso_generic.rs:68
392024-12-14T03:34:54.621ZINFOnexus (ServerContext): registering Oso class class = SiloImage file = nexus/auth/src/authz/oso_generic.rs:68
402024-12-14T03:34:54.621ZINFOnexus (ServerContext): registering Oso class class = AddressLot file = nexus/auth/src/authz/oso_generic.rs:68
412024-12-14T03:34:54.621ZINFOnexus (ServerContext): registering Oso class class = Blueprint file = nexus/auth/src/authz/oso_generic.rs:68
422024-12-14T03:34:54.621ZINFOnexus (ServerContext): registering Oso class class = LoopbackAddress file = nexus/auth/src/authz/oso_generic.rs:68
432024-12-14T03:34:54.621ZINFOnexus (ServerContext): registering Oso class class = Certificate file = nexus/auth/src/authz/oso_generic.rs:68
442024-12-14T03:34:54.621ZINFOnexus (ServerContext): registering Oso class class = ConsoleSession file = nexus/auth/src/authz/oso_generic.rs:68
452024-12-14T03:34:54.621ZINFOnexus (ServerContext): registering Oso class class = DeviceAuthRequest file = nexus/auth/src/authz/oso_generic.rs:68
462024-12-14T03:34:54.621ZINFOnexus (ServerContext): registering Oso class class = DeviceAccessToken file = nexus/auth/src/authz/oso_generic.rs:68
472024-12-14T03:34:54.621ZINFOnexus (ServerContext): registering Oso class class = PhysicalDisk file = nexus/auth/src/authz/oso_generic.rs:68
482024-12-14T03:34:54.621ZINFOnexus (ServerContext): registering Oso class class = Rack file = nexus/auth/src/authz/oso_generic.rs:68
492024-12-14T03:34:54.621ZINFOnexus (ServerContext): registering Oso class class = RoleBuiltin file = nexus/auth/src/authz/oso_generic.rs:68
502024-12-14T03:34:54.621ZINFOnexus (ServerContext): registering Oso class class = SshKey file = nexus/auth/src/authz/oso_generic.rs:68
512024-12-14T03:34:54.621ZINFOnexus (ServerContext): registering Oso class class = Silo file = nexus/auth/src/authz/oso_generic.rs:68
522024-12-14T03:34:54.622ZINFOnexus (ServerContext): registering Oso class class = SiloUser file = nexus/auth/src/authz/oso_generic.rs:68
532024-12-14T03:34:54.622ZINFOnexus (ServerContext): registering Oso class class = SiloGroup file = nexus/auth/src/authz/oso_generic.rs:68
542024-12-14T03:34:54.622ZINFOnexus (ServerContext): registering Oso class class = IdentityProvider file = nexus/auth/src/authz/oso_generic.rs:68
552024-12-14T03:34:54.622ZINFOnexus (ServerContext): registering Oso class class = SamlIdentityProvider file = nexus/auth/src/authz/oso_generic.rs:68
562024-12-14T03:34:54.622ZINFOnexus (ServerContext): registering Oso class class = Sled file = nexus/auth/src/authz/oso_generic.rs:68
572024-12-14T03:34:54.622ZINFOnexus (ServerContext): registering Oso class class = TufRepo file = nexus/auth/src/authz/oso_generic.rs:68
582024-12-14T03:34:54.622ZINFOnexus (ServerContext): registering Oso class class = TufArtifact file = nexus/auth/src/authz/oso_generic.rs:68
592024-12-14T03:34:54.622ZINFOnexus (ServerContext): registering Oso class class = Zpool file = nexus/auth/src/authz/oso_generic.rs:68
602024-12-14T03:34:54.622ZINFOnexus (ServerContext): registering Oso class class = Service file = nexus/auth/src/authz/oso_generic.rs:68
612024-12-14T03:34:54.622ZINFOnexus (ServerContext): registering Oso class class = UserBuiltin file = nexus/auth/src/authz/oso_generic.rs:68
622024-12-14T03:34:54.622ZINFOnexus (ServerContext): full Oso configuration config = #\n# Oso configuration for Omicron\n# This file is augmented by generated snippets.\n#\n\n#\n# ACTOR TYPES AND BASIC RULES\n#\n\n# `AnyActor` includes both authenticated and unauthenticated users.\nactor AnyActor {}\n\n# An `AuthenticatedActor` has an identity in the system. All of our operations\n# today require that an actor be authenticated.\nactor AuthenticatedActor {}\n\n# For any resource, `actor` can perform action `action` on it if they're\n# authenticated and their role(s) give them the corresponding permission on that\n# resource.\nallow(actor: AnyActor, action: Action, resource) if\n actor.authenticated and\n has_permission(actor.authn_actor.unwrap(), action.to_perm(), resource);\n\n# Define role relationships\nhas_role(actor: AuthenticatedActor, role: String, resource: Resource)\n\tif resource.has_role(actor, role);\n\n#\n# ROLES AND PERMISSIONS IN THE FLEET/SILO/PROJECT HIERARCHY\n#\n# We define the following permissions for most resources in the system:\n#\n# - "create_child": required to create child resources (of any type)\n#\n# - "list_children": required to list child resources (of all types) of a\n# resource\n#\n# - "modify": required to modify or delete a resource\n#\n# - "read": required to read a resource\n#\n# We define the following predefined roles for only a few high-level resources:\n# the Fleet (see below), Silo, Organization, and Project. The specific roles\n# are oriented around intended use-cases:\n#\n# - "admin": has all permissions on the resource\n#\n# - "collaborator": has "read", "list_children", and "create_child", plus\n# the "admin" role for child resources. The idea is that if you're an\n# Organization Collaborator, you have full control over the Projects within\n# the Organization, but you cannot modify or delete the Organization itself.\n#\n# - "viewer": has "read" and "list_children" on a resource\n#\n# Below the Project level, permissions are granted via roles at the Project\n# level. For example, for someone to be able to create, modify, or delete any\n# Instances, they must be granted project.collaborator, which means they can\n# create, modify, or delete _all_ resources in the Project.\n#\n# The complete set of predefined roles:\n#\n# - fleet.admin (superuser for the whole system)\n# - fleet.collaborator (can manage Silos)\n# - fleet.viewer (can read most non-siloed resources in the system)\n# - silo.admin (superuser for the silo)\n# - silo.collaborator (can create and own Organizations)\n# - silo.viewer (can read most resources within the Silo)\n# - organization.admin (complete control over an organization)\n# - organization.collaborator (can manage Projects)\n# - organization.viewer (can read most resources within the Organization)\n# - project.admin (complete control over a Project)\n# - project.collaborator (can manage all resources within the Project)\n# - project.viewer (can read most resources within the Project)\n#\n# Outside the Silo/Organization/Project hierarchy, we (currently) treat most\n# resources as nested under Fleet or else a synthetic resource (see below). We\n# do not yet support role assignments on anything other than Fleet, Silo,\n# Organization, or Project.\n#\n\n# "Fleet" is a global singleton representing the whole system. The name comes\n# from the idea described in RFD 24, but it's not quite right. This probably\n# should be more like "Region" or "AvailabilityZone". The precise boundaries\n# have not yet been figured out.\nresource Fleet {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\n\troles = [\n\t # Roles that can be attached by users\n\t "admin",\n\t "collaborator",\n\t "viewer",\n\n\t # Internal-only roles\n\t "external-authenticator"\n\t];\n\n\t# Roles implied by other roles on this resource\n\t"viewer" if "collaborator";\n\t"collaborator" if "admin";\n\n\t# Permissions granted directly by roles on this resource\n\t"list_children" if "viewer";\n\t"read" if "viewer";\n\t"create_child" if "collaborator";\n\t"modify" if "admin";\n}\n\n# For fleets specifically, roles can be conferred by roles on the user's Silo.\nhas_role(actor: AuthenticatedActor, role: String, _: Fleet) if\n\tsilo_role in actor.confers_fleet_role(role) and\n\thas_role(actor, silo_role, actor.silo.unwrap());\n\nresource Silo {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\troles = [ "admin", "collaborator", "viewer" ];\n\n\t# Roles implied by other roles on this resource\n\t"viewer" if "collaborator";\n\t"collaborator" if "admin";\n\n\t# Permissions granted directly by roles on this resource\n\t"list_children" if "viewer";\n\t"read" if "viewer";\n\n\t"create_child" if "collaborator";\n\t"modify" if "admin";\n\n\t# Permissions implied by roles on this resource's parent (Fleet). Fleet\n\t# privileges allow a user to see and potentially administer the Silo,\n\t# but they do not give anyone permission to look at anything inside the\n\t# Silo. To achieve this, we use permission rules here. (If we granted\n\t# Fleet administrators _roles_ on the Silo, then those would cascade\n\t# into the Silo as well.)\n\trelations = { parent_fleet: Fleet };\n\t"read" if "viewer" on "parent_fleet";\n\t"modify" if "collaborator" on "parent_fleet";\n\n\t# external authenticator has to create silo users\n\t"list_children" if "external-authenticator" on "parent_fleet";\n\t"create_child" if "external-authenticator" on "parent_fleet";\n}\n\nhas_relation(fleet: Fleet, "parent_fleet", silo: Silo)\n\tif silo.fleet = fleet;\n\n# As a special case, all authenticated users can read their own Silo. That's\n# not quite the same as having the "viewer" role. For example, they cannot list\n# Organizations in the Silo.\n#\n# One reason this is necessary is because if an unprivileged user tries to\n# create an Organization using "POST /organizations", they should get back a 403\n# (which implies they're able to see /organizations, which is essentially seeing\n# the Silo itself) rather than a 404. This behavior isn't a hard constraint\n# (i.e., you could reasonably get a 404 for an API you're not allowed to call).\n# Nor is the implementation (i.e., we could special-case this endpoint somehow).\n# But granting this permission is the simplest way to keep this endpoint's\n# behavior consistent with the rest of the API.\n#\n# This rule is also used to determine if a user can list the identity providers\n# in the Silo (which they should be able to), since that's predicated on being\n# able to read the Silo.\n#\n# It's unclear what else would break if users couldn't see their own Silo.\nhas_permission(actor: AuthenticatedActor, "read", silo: Silo)\n\tif silo in actor.silo;\n\nresource Project {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\troles = [ "admin", "collaborator", "viewer" ];\n\n\t# Roles implied by other roles on this resource\n\t"viewer" if "collaborator";\n\t"collaborator" if "admin";\n\n\t# Permissions granted directly by roles on this resource\n\t"list_children" if "viewer";\n\t"read" if "viewer";\n\t"create_child" if "collaborator";\n\t"modify" if "admin";\n\n\t# Roles implied by roles on this resource's parent (Silo)\n\trelations = { parent_silo: Silo };\n\t"admin" if "collaborator" on "parent_silo";\n\t"viewer" if "viewer" on "parent_silo";\n}\nhas_relation(silo: Silo, "parent_silo", project: Project)\n\tif project.silo = silo;\n\n#\n# GENERAL RESOURCES OUTSIDE THE SILO/PROJECT HIERARCHY\n#\n# Many resources use snippets of Polar generated by the `authz_resource!` Rust\n# macro. Some resources require custom Polar code. Those appear here.\n#\n\nresource Certificate {\n\tpermissions = [ "read", "modify" ];\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Fleet-level and silo-level roles both grant privileges on certificates.\n\t"read" if "admin" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"read" if "admin" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", certificate: Certificate)\n\tif certificate.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", certificate: Certificate)\n\tif certificate.silo.fleet = fleet;\n\nresource SiloUser {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\n\t# Fleet and Silo administrators can manage a Silo's users. This is one\n\t# of the only areas of Silo configuration that Fleet Administrators have\n\t# permissions on.\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\t"list_children" if "read" on "parent_silo";\n\t"read" if "read" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_silo";\n\t"list_children" if "read" on "parent_fleet";\n\t"read" if "read" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", user: SiloUser)\n\tif user.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", user: SiloUser)\n\tif user.silo.fleet = fleet;\n\n# authenticated actors have all permissions on themselves\nhas_permission(actor: AuthenticatedActor, _perm: String, silo_user: SiloUser)\n if actor.equals_silo_user(silo_user);\n\nhas_permission(actor: AuthenticatedActor, "read", silo_user: SiloUser)\n if silo_user.silo in actor.silo;\n\nresource SiloGroup {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\n\trelations = { parent_silo: Silo };\n\t"list_children" if "read" on "parent_silo";\n\t"read" if "read" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_silo";\n}\nhas_relation(silo: Silo, "parent_silo", group: SiloGroup)\n\tif group.silo = silo;\n\nresource SshKey {\n\tpermissions = [ "read", "modify" ];\n\trelations = { silo_user: SiloUser };\n\n\t"read" if "read" on "silo_user";\n\t"modify" if "modify" on "silo_user";\n}\nhas_relation(user: SiloUser, "silo_user", ssh_key: SshKey)\n\tif ssh_key.silo_user = user;\n\nresource IdentityProvider {\n\tpermissions = [\n\t "read",\n\t "modify",\n\t "create_child",\n\t "list_children",\n\t];\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Silo-level roles grant privileges on identity providers.\n\t"read" if "viewer" on "parent_silo";\n\t"list_children" if "viewer" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_silo";\n\n\t# Fleet-level roles also grant privileges on identity providers.\n\t"read" if "viewer" on "parent_fleet";\n\t"list_children" if "viewer" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", identity_provider: IdentityProvider)\n\tif identity_provider.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: IdentityProvider)\n\tif collection.silo.fleet = fleet;\n\nresource SamlIdentityProvider {\n\tpermissions = [\n\t "read",\n\t "modify",\n\t "create_child",\n\t "list_children",\n\t];\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Silo-level roles grant privileges on identity providers.\n\t"read" if "viewer" on "parent_silo";\n\t"list_children" if "viewer" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_silo";\n\n\t# Fleet-level roles also grant privileges on identity providers.\n\t"read" if "viewer" on "parent_fleet";\n\t"list_children" if "viewer" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", saml_identity_provider: SamlIdentityProvider)\n\tif saml_identity_provider.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: SamlIdentityProvider)\n\tif collection.silo.fleet = fleet;\n\n#\n# SYNTHETIC RESOURCES OUTSIDE THE SILO HIERARCHY\n#\n# The resources here do not correspond to anything that appears explicitly in\n# the API or is stored in the database. These are used either at the top level\n# of the API path (e.g., "/v1/system/ip-pools") or as an implementation detail of the system\n# (in the case of console sessions and "Database"). The policies are\n# either statically-defined in this file or driven by role assignments on the\n# Fleet. None of these resources defines their own roles.\n#\n\n# Describes the policy for reading and modifying DNS configuration\n# (both internal and external)\nresource DnsConfig {\n\tpermissions = [ "read", "modify" ];\n\trelations = { parent_fleet: Fleet };\n\t# "external-authenticator" requires these permissions because that's the\n\t# context that Nexus uses when creating and deleting Silos. These\n\t# operations necessarily need to read and modify DNS configuration.\n\t"read" if "external-authenticator" on "parent_fleet";\n\t"modify" if "external-authenticator" on "parent_fleet";\n\t# "admin" on the parent fleet also gets these permissions, primarily for\n\t# the test suite.\n\t"read" if "admin" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", dns_config: DnsConfig)\n\tif dns_config.fleet = fleet;\n\n# Describes the policy for accessing blueprints\nresource BlueprintConfig {\n\tpermissions = [\n\t "list_children", # list blueprints\n\t "create_child", # create blueprint\n\t "read", # read the current target\n\t "modify", # change the current target\n\t];\n\n\trelations = { parent_fleet: Fleet };\n\t"create_child" if "admin" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n\t"list_children" if "viewer" on "parent_fleet";\n\t"read" if "viewer" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", list: BlueprintConfig)\n\tif list.fleet = fleet;\n\n# Describes the policy for reading and modifying low-level inventory\nresource Inventory {\n\tpermissions = [ "read", "modify" ];\n\trelations = { parent_fleet: Fleet };\n\t"read" if "viewer" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", inventory: Inventory)\n\tif inventory.fleet = fleet;\n\n# Describes the policy for accessing "/v1/system/ip-pools" in the API\nresource IpPoolList {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "create_child",\n\t];\n\n\t# Fleet Administrators can create or modify the IP Pools list.\n\trelations = { parent_fleet: Fleet };\n\t"modify" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n\n\t# Fleet Viewers can list IP Pools\n\t"list_children" if "viewer" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", ip_pool_list: IpPoolList)\n\tif ip_pool_list.fleet = fleet;\n\n# Any authenticated user can create a child of a provided IP Pool.\n# This is necessary to use the pools when provisioning instances.\nhas_permission(actor: AuthenticatedActor, "create_child", ip_pool: IpPool)\n\tif silo in actor.silo and silo.fleet = ip_pool.fleet;\n\n# Describes the policy for creating and managing web console sessions.\nresource ConsoleSessionList {\n\tpermissions = [ "create_child" ];\n\trelations = { parent_fleet: Fleet };\n\t"create_child" if "external-authenticator" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", collection: ConsoleSessionList)\n\tif collection.fleet = fleet;\n\n# Describes the policy for creating and managing device authorization requests.\nresource DeviceAuthRequestList {\n\tpermissions = [ "create_child" ];\n\trelations = { parent_fleet: Fleet };\n\t"create_child" if "external-authenticator" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", collection: DeviceAuthRequestList)\n\tif collection.fleet = fleet;\n\n# Describes the policy for creating and managing Silo certificates\nresource SiloCertificateList {\n\tpermissions = [ "list_children", "create_child" ];\n\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Both Fleet and Silo administrators can see and modify the Silo's\n\t# certificates.\n\t"list_children" if "admin" on "parent_silo";\n\t"list_children" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", collection: SiloCertificateList)\n\tif collection.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: SiloCertificateList)\n\tif collection.silo.fleet = fleet;\n\n# Describes the policy for creating and managing Silo identity providers\nresource SiloIdentityProviderList {\n\tpermissions = [ "list_children", "create_child" ];\n\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Everyone who can read the Silo (which includes all the users in the\n\t# Silo) can see the identity providers in it.\n\t"list_children" if "read" on "parent_silo";\n\n\t# Fleet and Silo administrators can manage the Silo's identity provider\n\t# configuration. This is one of the only areas of Silo configuration\n\t# that Fleet Administrators have permissions on. This is also one of\n\t# the only cases where we need to look two levels up the hierarchy to\n\t# see if somebody has the right permission. For most other things,\n\t# permissions cascade down the hierarchy so we only need to look at the\n\t# parent.\n\t"create_child" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", collection: SiloIdentityProviderList)\n\tif collection.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: SiloIdentityProviderList)\n\tif collection.silo.fleet = fleet;\n\n# Describes the policy for creating and managing Silo users (mostly intended for\n# API-managed users)\nresource SiloUserList {\n\tpermissions = [ "list_children", "create_child" ];\n\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Everyone who can read the Silo (which includes all the users in the\n\t# Silo) can see the users in it.\n\t"list_children" if "read" on "parent_silo";\n\n\t# Fleet and Silo administrators can manage the Silo's users. This is\n\t# one of the only areas of Silo configuration that Fleet Administrators\n\t# have permissions on. This is also one of the few cases (so far) where\n\t# we need to look two levels up the hierarchy to see if somebody has the\n\t# right permission. For most other things, permissions cascade down the\n\t# hierarchy so we only need to look at the parent.\n\t"create_child" if "admin" on "parent_silo";\n\t"list_children" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", collection: SiloUserList)\n\tif collection.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: SiloUserList)\n\tif collection.silo.fleet = fleet;\n\n# These rules grants the external authenticator role the permissions it needs to\n# read silo users and modify their sessions. This is necessary for login to\n# work.\nhas_permission(actor: AuthenticatedActor, "read", silo: Silo)\n\tif has_role(actor, "external-authenticator", silo.fleet);\nhas_permission(actor: AuthenticatedActor, "read", user: SiloUser)\n\tif has_role(actor, "external-authenticator", user.silo.fleet);\nhas_permission(actor: AuthenticatedActor, "modify", user: SiloUser)\n\tif has_role(actor, "external-authenticator", user.silo.fleet);\nhas_permission(actor: AuthenticatedActor, "read", group: SiloGroup)\n\tif has_role(actor, "external-authenticator", group.silo.fleet);\nhas_permission(actor: AuthenticatedActor, "modify", group: SiloGroup)\n\tif has_role(actor, "external-authenticator", group.silo.fleet);\n\nhas_permission(actor: AuthenticatedActor, "read", session: ConsoleSession)\n\tif has_role(actor, "external-authenticator", session.fleet);\nhas_permission(actor: AuthenticatedActor, "modify", session: ConsoleSession)\n\tif has_role(actor, "external-authenticator", session.fleet);\n\n# All authenticated users can read and delete device authn requests because\n# by necessity these operations happen before we've figured out what user (or\n# even Silo) the device auth is associated with. Any user can claim a device\n# auth request with the right user code (that's how it works) -- it's the user\n# code and associated logic that prevents unauthorized access here.\nhas_permission(_actor: AuthenticatedActor, "read", _device_auth: DeviceAuthRequest);\nhas_permission(_actor: AuthenticatedActor, "modify", _device_auth: DeviceAuthRequest);\n\nhas_permission(actor: AuthenticatedActor, "read", device_token: DeviceAccessToken)\n\tif has_role(actor, "external-authenticator", device_token.fleet);\n\nhas_permission(actor: AuthenticatedActor, "read", identity_provider: IdentityProvider)\n\tif has_role(actor, "external-authenticator", identity_provider.silo.fleet);\n\nhas_permission(actor: AuthenticatedActor, "read", saml_identity_provider: SamlIdentityProvider)\n\tif has_role(actor, "external-authenticator", saml_identity_provider.silo.fleet);\n\n# Describes the policy for who can access the internal database.\nresource Database {\n\tpermissions = [\n\t # "query" is required to perform any query against the database,\n\t # whether a read or write query. This is checked when an operation\n\t # checks out a database connection from the connection pool.\n\t #\n\t # Any authenticated user gets this permission. There's generally\n\t # some other authz check involved in the database query. For\n\t # example, if you're querying the database to "read" a "Project", we\n\t # should also be checking that. So why do we do this at all? It's\n\t # a belt-and-suspenders measure so that if we somehow introduced an\n\t # unauthenticated code path that hits the database, it cannot be\n\t # used to DoS the database because we won't allow the operation to\n\t # make the query. (As long as the code path _is_ authenticated, we\n\t # can use throttling mechanisms to prevent DoS.)\n\t "query",\n\n\t # "modify" is required to populate database data that's delivered\n\t # with the system. It should also be required for schema changes,\n\t # when we support those. This is separate from "query" so that we\n\t # cannot accidentally invoke these code paths from API calls and\n\t # other general functions.\n\t "modify"\n\t];\n}\n\n# All authenticated users have the "query" permission on the database.\nhas_permission(_actor: AuthenticatedActor, "query", _resource: Database);\n\n# The "db-init" user is the only one with the "modify" permission.\nhas_permission(USER_DB_INIT: AuthenticatedActor, "modify", _resource: Database);\nhas_permission(USER_DB_INIT: AuthenticatedActor, "create_child", _resource: IpPoolList);\n# It also has "admin" on the internal silo to populate it with built-in resources.\n# TODO-completeness: actually limit to just internal silo and not all silos\nhas_role(USER_DB_INIT: AuthenticatedActor, "admin", _silo: Silo);\n\n# Allow the internal API admin permissions on all silos.\nhas_role(USER_INTERNAL_API: AuthenticatedActor, "admin", _silo: Silo);\n\n\n\n resource Disk {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: Disk)\n if child.project = parent;\n \n\n resource Snapshot {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: Snapshot)\n if child.project = parent;\n \n\n resource ProjectImage {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: ProjectImage)\n if child.project = parent;\n \n\n resource Instance {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: Instance)\n if child.project = parent;\n \n\n resource IpPool {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: IpPool)\n if child.fleet = fleet;\n \n\n resource InstanceNetworkInterface {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: Instance\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: InstanceNetworkInterface)\n if has_relation(project, "containing_project", child.instance);\n\n has_relation(parent: Instance, "parent", child: InstanceNetworkInterface)\n if child.instance = parent;\n \n\n resource Vpc {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: Vpc)\n if child.project = parent;\n \n\n resource VpcRouter {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: Vpc\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: VpcRouter)\n if has_relation(project, "containing_project", child.vpc);\n\n has_relation(parent: Vpc, "parent", child: VpcRouter)\n if child.vpc = parent;\n \n\n resource InternetGateway {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: Vpc\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: InternetGateway)\n if has_relation(project, "containing_project", child.vpc);\n\n has_relation(parent: Vpc, "parent", child: InternetGateway)\n if child.vpc = parent;\n \n\n resource InternetGatewayIpPool {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: InternetGateway\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: InternetGatewayIpPool)\n if has_relation(project, "containing_project", child.internet_gateway);\n\n has_relation(parent: InternetGateway, "parent", child: InternetGatewayIpPool)\n if child.internet_gateway = parent;\n \n\n resource InternetGatewayIpAddress {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: InternetGateway\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: InternetGatewayIpAddress)\n if has_relation(project, "containing_project", child.internet_gateway);\n\n has_relation(parent: InternetGateway, "parent", child: InternetGatewayIpAddress)\n if child.internet_gateway = parent;\n \n\n resource RouterRoute {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: VpcRouter\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: RouterRoute)\n if has_relation(project, "containing_project", child.vpc_router);\n\n has_relation(parent: VpcRouter, "parent", child: RouterRoute)\n if child.vpc_router = parent;\n \n\n resource VpcSubnet {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: Vpc\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: VpcSubnet)\n if has_relation(project, "containing_project", child.vpc);\n\n has_relation(parent: Vpc, "parent", child: VpcSubnet)\n if child.vpc = parent;\n \n\n resource FloatingIp {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: FloatingIp)\n if child.project = parent;\n \n\n resource Image {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_silo: Silo };\n "list_children" if "viewer" on "containing_silo";\n "read" if "viewer" on "containing_silo";\n "modify" if "collaborator" on "containing_silo";\n "create_child" if "collaborator" on "containing_silo";\n }\n\n has_relation(parent: Silo, "containing_silo", child: Image)\n if child.silo = parent;\n \n\n resource SiloImage {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_silo: Silo };\n "list_children" if "viewer" on "containing_silo";\n "read" if "viewer" on "containing_silo";\n "modify" if "collaborator" on "containing_silo";\n "create_child" if "collaborator" on "containing_silo";\n }\n\n has_relation(parent: Silo, "containing_silo", child: SiloImage)\n if child.silo = parent;\n \n\n resource AddressLot {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: AddressLot)\n if child.fleet = fleet;\n \n\n resource Blueprint {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Blueprint)\n if child.fleet = fleet;\n \n\n resource LoopbackAddress {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: LoopbackAddress)\n if child.fleet = fleet;\n \n\n\n resource ConsoleSession {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: ConsoleSession)\n if child.fleet = fleet;\n \n\n resource DeviceAuthRequest {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: DeviceAuthRequest)\n if child.fleet = fleet;\n \n\n resource DeviceAccessToken {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: DeviceAccessToken)\n if child.fleet = fleet;\n \n\n resource PhysicalDisk {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: PhysicalDisk)\n if child.fleet = fleet;\n \n\n resource Rack {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Rack)\n if child.fleet = fleet;\n \n\n resource RoleBuiltin {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: RoleBuiltin)\n if child.fleet = fleet;\n \n\n\n\n\n\n\n\n resource Sled {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Sled)\n if child.fleet = fleet;\n \n\n resource TufRepo {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: TufRepo)\n if child.fleet = fleet;\n \n\n resource TufArtifact {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: TufArtifact)\n if child.fleet = fleet;\n \n\n resource Zpool {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Zpool)\n if child.fleet = fleet;\n \n\n resource Service {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Service)\n if child.fleet = fleet;\n \n\n resource UserBuiltin {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: UserBuiltin)\n if child.fleet = fleet;\n file = nexus/auth/src/authz/oso_generic.rs:89
632024-12-14T03:34:54.641ZINFOnexus (ServerContext): Setting up resolver using DNS servers for subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344::, width: 48 } } file = nexus/src/context.rs:219
642024-12-14T03:34:54.644ZINFOnexus (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
652024-12-14T03:34:54.649ZINFOnexus (ServerContext): Setting up qorb database pool from DNS dns_addrs = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = nexus/src/context.rs:275
662024-12-14T03:34:54.657ZDEBGnexus (ServerContext): registered USDT probes
672024-12-14T03:34:54.752ZINFOnexus: Database schema version is up to date desired_version = 116.0.0 file = nexus/db-queries/src/db/datastore/db_metadata.rs:145 found_version = 116.0.0
682024-12-14T03:34:54.756ZINFOnexus (SEC): SEC running file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:813 sec_id = 5f2fe413-3c4a-4994-b4a0-995c1da486b1
692024-12-14T03:34:54.757ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8d70e61c-94ed-41ce-b36c-cb904f92c534.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8d70e61c-94ed-41ce-b36c-cb904f92c534.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1101, tv_nsec: 77587343 } })
702024-12-14T03:34:54.757ZINFOnexus (Nexus): Determining switch slots managed by switch zones file = nexus/src/app/mod.rs:1103
712024-12-14T03:34:54.818ZINFOnexus (Nexus): determining switch slot managed by dendrite zone file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
722024-12-14T03:34:54.818ZDEBGnexus (MgsClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
732024-12-14T03:34:54.822ZDEBGnexus (MgsClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "fb1a3b85-0146-4728-ba81-9b04b80548c3", "content-length": "26", "date": "Sat, 14 Dec 2024 03:34:53 GMT"} })
742024-12-14T03:34:54.823ZINFOnexus (Nexus): identified switch slot for dendrite zone file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
752024-12-14T03:34:54.823ZINFOnexus (Nexus): completed mapping dendrite zones to switch slots file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
762024-12-14T03:34:54.860ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8d70e61c-94ed-41ce-b36c-cb904f92c534.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8d70e61c-94ed-41ce-b36c-cb904f92c534.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1101, tv_nsec: 181461024 } })
772024-12-14T03:34:54.860ZINFOnexus (Nexus): Determining switch slots managed by switch zones file = nexus/src/app/mod.rs:1103
782024-12-14T03:34:54.899ZINFOnexus (Nexus): determining switch slot managed by dendrite zone file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
792024-12-14T03:34:54.899ZDEBGnexus (MgsClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
802024-12-14T03:34:54.899ZDEBGnexus (MgsClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "07afc6d6-f3ed-4498-b79b-d88feefc2af9", "content-length": "26", "date": "Sat, 14 Dec 2024 03:34:54 GMT"} })
812024-12-14T03:34:54.899ZINFOnexus (Nexus): identified switch slot for dendrite zone file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
822024-12-14T03:34:54.900ZINFOnexus (Nexus): completed mapping dendrite zones to switch slots file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
832024-12-14T03:34:54.982ZDEBGnexus (clickhouse-client): registered USDT probes id = e8c20943-a276-403f-8d11-3709ac3c18f6
842024-12-14T03:34:54.993ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
852024-12-14T03:34:55.016ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
862024-12-14T03:34:55.019ZDEBGnexus (DataLoader): attempting to create built-in users
872024-12-14T03:34:55.019ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
882024-12-14T03:34:55.019ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
892024-12-14T03:34:55.038ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /artifacts/{kind}/{name}/{version} versions = all
902024-12-14T03:34:55.038ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /bgtasks versions = all
912024-12-14T03:34:55.038ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /bgtasks/activate versions = all
922024-12-14T03:34:55.038ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /bgtasks/view/{bgtask_name} versions = all
932024-12-14T03:34:55.038ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /clickhouse/policy versions = all
942024-12-14T03:34:55.038ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /clickhouse/policy versions = all
952024-12-14T03:34:55.039ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /crucible/0/upstairs/{upstairs_id}/downstairs/{downstairs_id}/stop-request versions = all
962024-12-14T03:34:55.039ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /crucible/0/upstairs/{upstairs_id}/downstairs/{downstairs_id}/stopped versions = all
972024-12-14T03:34:55.039ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /crucible/0/upstairs/{upstairs_id}/repair/{repair_id}/progress versions = all
982024-12-14T03:34:55.039ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /crucible/0/upstairs/{upstairs_id}/repair-finish versions = all
992024-12-14T03:34:55.039ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /crucible/0/upstairs/{upstairs_id}/repair-start versions = all
1002024-12-14T03:34:55.039ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /demo-saga versions = all
1012024-12-14T03:34:55.039ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /demo-saga/{demo_saga_id}/complete versions = all
1022024-12-14T03:34:55.039ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /deployment/blueprints/all versions = all
1032024-12-14T03:34:55.039ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = DELETE path = /deployment/blueprints/all/{blueprint_id} versions = all
1042024-12-14T03:34:55.039ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /deployment/blueprints/all/{blueprint_id} versions = all
1052024-12-14T03:34:55.039ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /deployment/blueprints/import versions = all
1062024-12-14T03:34:55.039ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /deployment/blueprints/regenerate versions = all
1072024-12-14T03:34:55.039ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /deployment/blueprints/target versions = all
1082024-12-14T03:34:55.039ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /deployment/blueprints/target versions = all
1092024-12-14T03:34:55.039ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = PUT path = /deployment/blueprints/target/enabled versions = all
1102024-12-14T03:34:55.039ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /disk/{disk_id}/remove-read-only-parent versions = all
1112024-12-14T03:34:55.039ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = PUT path = /disks/{disk_id} versions = all
1122024-12-14T03:34:55.039ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /instances/{instance_id}/migrate versions = all
1132024-12-14T03:34:55.039ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /metrics/collectors versions = all
1142024-12-14T03:34:55.039ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /metrics/collectors/{collector_id}/producers versions = all
1152024-12-14T03:34:55.039ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /metrics/producers versions = all
1162024-12-14T03:34:55.039ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /nat/ipv4/changeset/{from_gen} versions = all
1172024-12-14T03:34:55.039ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /physical-disk/expunge versions = all
1182024-12-14T03:34:55.039ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /probes/{sled} versions = all
1192024-12-14T03:34:55.040ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = PUT path = /racks/{rack_id}/initialization-complete versions = all
1202024-12-14T03:34:55.040ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /sagas versions = all
1212024-12-14T03:34:55.040ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /sagas/{saga_id} versions = all
1222024-12-14T03:34:55.040ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /sled-agents/{sled_id} versions = all
1232024-12-14T03:34:55.040ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /sled-agents/{sled_id} versions = all
1242024-12-14T03:34:55.040ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /sled-agents/{sled_id}/firewall-rules-update versions = all
1252024-12-14T03:34:55.040ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /sleds/add versions = all
1262024-12-14T03:34:55.040ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /sleds/expunge versions = all
1272024-12-14T03:34:55.040ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /sleds/uninitialized versions = all
1282024-12-14T03:34:55.040ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = PUT path = /switch/{switch_id} versions = all
1292024-12-14T03:34:55.040ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = PUT path = /vmms/{propolis_id} versions = all
1302024-12-14T03:34:55.040ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /volume/{volume_id}/remove-read-only-parent versions = all
1312024-12-14T03:34:55.040ZINFOnexus (dropshot_internal): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::b]:12221
1322024-12-14T03:34:55.040ZDEBGnexus (dropshot_internal): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::b]:12221
1332024-12-14T03:34:55.040ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
1342024-12-14T03:34:55.040ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
1352024-12-14T03:34:55.064ZWARNnexus: Cannot look up rack: Object (of type ById(a121ca05-bbee-41bf-b9db-9e03ff035200)) not found: rack file = nexus/src/app/rack.rs:774
1362024-12-14T03:34:55.074ZINFOnexus (DataLoader): created 0 built-in users file = nexus/db-queries/src/db/datastore/silo_user.rs:394
1372024-12-14T03:34:55.075ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1382024-12-14T03:34:55.076ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1392024-12-14T03:34:55.077ZDEBGnexus (DataLoader): attempting to create built-in roles
1402024-12-14T03:34:55.077ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1412024-12-14T03:34:55.077ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1422024-12-14T03:34:55.113ZINFOnexus (DataLoader): created 0 built-in roles file = nexus/db-queries/src/db/datastore/role.rs:85
1432024-12-14T03:34:55.113ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1442024-12-14T03:34:55.114ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1452024-12-14T03:34:55.114ZDEBGnexus (DataLoader): attempting to create built-in role assignments
1462024-12-14T03:34:55.114ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1472024-12-14T03:34:55.115ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1482024-12-14T03:34:55.159ZINFOnexus (DataLoader): created 0 built-in role assignments file = nexus/db-queries/src/db/datastore/role.rs:114
1492024-12-14T03:34:55.159ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1502024-12-14T03:34:55.160ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1512024-12-14T03:34:55.160ZDEBGnexus (DataLoader): attempting to create built-in silos
1522024-12-14T03:34:55.160ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1532024-12-14T03:34:55.160ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1542024-12-14T03:34:55.245ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:53013
1552024-12-14T03:34:55.261ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:53013 req_id = 3c82daa5-d295-4d12-8a2d-08cb13586660 roles = RoleSet { roles: {} } uri = /metrics/producers
1562024-12-14T03:34:55.261ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:53013 req_id = 3c82daa5-d295-4d12-8a2d-08cb13586660 resource = Database result = Ok(()) uri = /metrics/producers
1572024-12-14T03:34:55.445ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:65187
1582024-12-14T03:34:55.461ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 00fa02ba-c8ed-4947-aea1-86e8c800fb87 roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
1592024-12-14T03:34:55.461ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 00fa02ba-c8ed-4947-aea1-86e8c800fb87 resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
1602024-12-14T03:34:55.465ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 00fa02ba-c8ed-4947-aea1-86e8c800fb87 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
1612024-12-14T03:34:55.467ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 00fa02ba-c8ed-4947-aea1-86e8c800fb87 resource = Fleet result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
1622024-12-14T03:34:55.468ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 00fa02ba-c8ed-4947-aea1-86e8c800fb87 roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
1632024-12-14T03:34:55.468ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 00fa02ba-c8ed-4947-aea1-86e8c800fb87 resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
1642024-12-14T03:34:55.521ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 00fa02ba-c8ed-4947-aea1-86e8c800fb87 roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
1652024-12-14T03:34:55.521ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 00fa02ba-c8ed-4947-aea1-86e8c800fb87 resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
1662024-12-14T03:34:55.566ZINFOnexus (dropshot_internal): set cockroachdb setting actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/cockroachdb_settings.rs:124 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 00fa02ba-c8ed-4947-aea1-86e8c800fb87 setting = cluster.preserve_downgrade_option uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete value = 22.1
1672024-12-14T03:34:55.566ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 00fa02ba-c8ed-4947-aea1-86e8c800fb87 roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
1682024-12-14T03:34:55.566ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 00fa02ba-c8ed-4947-aea1-86e8c800fb87 resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
1692024-12-14T03:34:55.570ZINFOnexus (dropshot_internal): request completed error_message_external = not found: rack with id "a121ca05-bbee-41bf-b9db-9e03ff035200" error_message_internal = not found: rack with id "a121ca05-bbee-41bf-b9db-9e03ff035200" file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 124656 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 00fa02ba-c8ed-4947-aea1-86e8c800fb87 response_code = 404 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
1702024-12-14T03:34:55.602ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::d]:56805
1712024-12-14T03:34:55.603ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:56805 req_id = d783b8e0-06d6-4663-93ee-2aee5283a5e8 roles = RoleSet { roles: {} } uri = /metrics/collectors/a321e00a-3126-4ea4-b26d-c0e3eea69166/producers?sort_by=id_ascending
1722024-12-14T03:34:55.603ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:56805 req_id = d783b8e0-06d6-4663-93ee-2aee5283a5e8 resource = Database result = Ok(()) uri = /metrics/collectors/a321e00a-3126-4ea4-b26d-c0e3eea69166/producers?sort_by=id_ascending
1732024-12-14T03:34:55.631ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 28527 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:56805 req_id = d783b8e0-06d6-4663-93ee-2aee5283a5e8 response_code = 200 uri = /metrics/collectors/a321e00a-3126-4ea4-b26d-c0e3eea69166/producers?sort_by=id_ascending
1742024-12-14T03:34:55.831ZINFOnexus: assigned collector to new producer collector_id = a321e00a-3126-4ea4-b26d-c0e3eea69166 file = nexus/src/app/oximeter.rs:76 producer_id = d278f717-338f-4586-9211-4636baa82004
1752024-12-14T03:34:55.832ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 584915 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:53013 req_id = 3c82daa5-d295-4d12-8a2d-08cb13586660 response_code = 201 uri = /metrics/producers
1762024-12-14T03:34:55.929ZINFOnexus (DataLoader): created 0 built-in silos file = nexus/db-queries/src/db/datastore/silo.rs:94
1772024-12-14T03:34:55.929ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1782024-12-14T03:34:55.929ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1792024-12-14T03:34:55.942ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1802024-12-14T03:34:55.943ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1812024-12-14T03:34:55.943ZDEBGnexus (DataLoader): attempting to create built-in projects
1822024-12-14T03:34:55.943ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1832024-12-14T03:34:55.943ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1842024-12-14T03:34:55.947ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1852024-12-14T03:34:55.947ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1862024-12-14T03:34:55.978ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1872024-12-14T03:34:55.978ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1882024-12-14T03:34:56.028ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1892024-12-14T03:34:56.030ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) } result = Ok(())
1902024-12-14T03:34:56.030ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1912024-12-14T03:34:56.031ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1922024-12-14T03:34:56.085ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1932024-12-14T03:34:56.085ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1942024-12-14T03:34:56.143ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1952024-12-14T03:34:56.145ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) } result = Ok(())
1962024-12-14T03:34:56.145ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1972024-12-14T03:34:56.145ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1982024-12-14T03:34:56.190ZINFOnexus (DataLoader): created built-in services project file = nexus/db-queries/src/db/datastore/project.rs:122
1992024-12-14T03:34:56.190ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2002024-12-14T03:34:56.191ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2012024-12-14T03:34:56.191ZDEBGnexus (DataLoader): attempting to create built-in VPCs
2022024-12-14T03:34:56.191ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2032024-12-14T03:34:56.191ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2042024-12-14T03:34:56.194ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2052024-12-14T03:34:56.194ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2062024-12-14T03:34:56.196ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2072024-12-14T03:34:56.197ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2082024-12-14T03:34:56.198ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2092024-12-14T03:34:56.198ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2102024-12-14T03:34:56.200ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2112024-12-14T03:34:56.200ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2122024-12-14T03:34:56.201ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2132024-12-14T03:34:56.203ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) } result = Ok(())
2142024-12-14T03:34:56.203ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2152024-12-14T03:34:56.203ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2162024-12-14T03:34:56.206ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2172024-12-14T03:34:56.206ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2182024-12-14T03:34:56.213ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2192024-12-14T03:34:56.213ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2202024-12-14T03:34:56.215ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2212024-12-14T03:34:56.217ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) } result = Ok(())
2222024-12-14T03:34:56.217ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2232024-12-14T03:34:56.217ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2242024-12-14T03:34:56.260ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2252024-12-14T03:34:56.261ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2262024-12-14T03:34:56.262ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2272024-12-14T03:34:56.262ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2282024-12-14T03:34:56.263ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2292024-12-14T03:34:56.264ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2302024-12-14T03:34:56.265ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2312024-12-14T03:34:56.268ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") } result = Ok(())
2322024-12-14T03:34:56.268ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2332024-12-14T03:34:56.268ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2342024-12-14T03:34:56.284ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2352024-12-14T03:34:56.284ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2362024-12-14T03:34:56.286ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2372024-12-14T03:34:56.286ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2382024-12-14T03:34:56.287ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2392024-12-14T03:34:56.288ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2402024-12-14T03:34:56.289ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2412024-12-14T03:34:56.289ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2422024-12-14T03:34:56.290ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2432024-12-14T03:34:56.293ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") } result = Ok(())
2442024-12-14T03:34:56.293ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2452024-12-14T03:34:56.293ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2462024-12-14T03:34:56.341ZERROnexus (DataLoader): gave up trying to populate built-in PopulateBuiltinVpcs error_message = InternalError { internal_message: "Unknown diesel error creating VpcRouter called \\"system\\": Record not found" } file = nexus/src/populate.rs:126
2472024-12-14T03:34:56.341ZERROnexus: populate failed file = nexus/src/app/mod.rs:530
2482024-12-14T03:34:56.341ZINFOnexus: activating background tasks file = nexus/src/app/mod.rs:536
2492024-12-14T03:34:56.344ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 1 reason = Timeout
2502024-12-14T03:34:56.344ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 1 reason = Timeout
2512024-12-14T03:34:56.344ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 1 reason = Timeout
2522024-12-14T03:34:56.344ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 1 reason = Timeout
2532024-12-14T03:34:56.344ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 1 reason = Timeout
2542024-12-14T03:34:56.344ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 1 reason = Timeout
2552024-12-14T03:34:56.344ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 1 reason = Timeout
2562024-12-14T03:34:56.344ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 1 reason = Timeout
2572024-12-14T03:34:56.344ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 1 reason = Timeout
2582024-12-14T03:34:56.344ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 1 reason = Timeout
2592024-12-14T03:34:56.344ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 1 reason = Timeout
2602024-12-14T03:34:56.344ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
2612024-12-14T03:34:56.344ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
2622024-12-14T03:34:56.344ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
2632024-12-14T03:34:56.344ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
2642024-12-14T03:34:56.344ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
2652024-12-14T03:34:56.347ZWARNnexus (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:61 reason = no config nor servers
2662024-12-14T03:34:56.347ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
2672024-12-14T03:34:56.347ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 1 reason = Timeout
2682024-12-14T03:34:56.347ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 1 reason = Timeout
2692024-12-14T03:34:56.347ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 1 reason = Timeout
2702024-12-14T03:34:56.347ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 1 reason = Timeout
2712024-12-14T03:34:56.347ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 1 reason = Timeout
2722024-12-14T03:34:56.347ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 1 reason = Timeout
2732024-12-14T03:34:56.347ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 1 reason = Timeout
2742024-12-14T03:34:56.347ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
2752024-12-14T03:34:56.347ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
2762024-12-14T03:34:56.347ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 1 reason = Timeout
2772024-12-14T03:34:56.347ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
2782024-12-14T03:34:56.347ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 1 reason = Timeout
2792024-12-14T03:34:56.347ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 1 reason = Timeout
2802024-12-14T03:34:56.347ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 1 reason = Timeout
2812024-12-14T03:34:56.347ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 1 reason = Timeout
2822024-12-14T03:34:56.347ZWARNnexus (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:61 reason = no config nor servers
2832024-12-14T03:34:56.347ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 1 reason = Timeout
2842024-12-14T03:34:56.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
2852024-12-14T03:34:56.347ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 1 reason = Timeout
2862024-12-14T03:34:56.347ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 1 reason = Timeout
2872024-12-14T03:34:56.347ZDEBGnexus (BackgroundTasks): activating background_task = saga_recovery iteration = 1 reason = Timeout
2882024-12-14T03:34:56.347ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 1 reason = Timeout
2892024-12-14T03:34:56.347ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 1 reason = Timeout
2902024-12-14T03:34:56.347ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 1 reason = Timeout
2912024-12-14T03:34:56.347ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 1 reason = Timeout
2922024-12-14T03:34:56.347ZDEBGnexus (BackgroundTasks): activating background_task = inventory_collection iteration = 1 reason = Timeout
2932024-12-14T03:34:56.347ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 1 reason = Timeout
2942024-12-14T03:34:56.347ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 1 reason = Timeout
2952024-12-14T03:34:56.347ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2962024-12-14T03:34:56.347ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
2972024-12-14T03:34:56.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
2982024-12-14T03:34:56.347ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
2992024-12-14T03:34:56.347ZDEBGnexus (SagaRecoverer): listing candidate sagas for recovery
3002024-12-14T03:34:56.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
3012024-12-14T03:34:56.347ZDEBGnexus (SagaRecoverer): roles roles = RoleSet { roles: {} }
3022024-12-14T03:34:56.347ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
3032024-12-14T03:34:56.347ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3042024-12-14T03:34:56.347ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
3052024-12-14T03:34:56.347ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = crdb_node_id_collector file = nexus/src/app/background/tasks/crdb_node_id_collector.rs:78 reason = no blueprint
3062024-12-14T03:34:56.347ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
3072024-12-14T03:34:56.347ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
3082024-12-14T03:34:56.347ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
3092024-12-14T03:34:56.347ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-14 03:24:56.347677091 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
3102024-12-14T03:34:56.347ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
3112024-12-14T03:34:56.348ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
3122024-12-14T03:34:56.348ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
3132024-12-14T03:34:56.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
3142024-12-14T03:34:56.348ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
3152024-12-14T03:34:56.348ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
3162024-12-14T03:34:56.348ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
3172024-12-14T03:34:56.348ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
3182024-12-14T03:34:56.348ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
3192024-12-14T03:34:56.348ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
3202024-12-14T03:34:56.348ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
3212024-12-14T03:34:56.348ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:74 reason = no blueprint
3222024-12-14T03:34:56.348ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
3232024-12-14T03:34:56.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
3242024-12-14T03:34:56.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
3252024-12-14T03:34:56.348ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 3.325076ms iteration = 1 status = {"error":"no config nor servers"}
3262024-12-14T03:34:56.348ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 3.238765ms iteration = 1 status = {"error":"no blueprint"}
3272024-12-14T03:34:56.348ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 3.296166ms iteration = 1 status = {"error":"no config nor servers"}
3282024-12-14T03:34:56.348ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 3.111553ms iteration = 1 status = {"error":"no blueprint"}
3292024-12-14T03:34:56.348ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
3302024-12-14T03:34:56.349ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
3312024-12-14T03:34:56.349ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
3322024-12-14T03:34:56.349ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("3db8556d-0ae0-4824-8953-f38d8eef7409.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7b672843-049d-4d9c-b0a2-21d7b6323621.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("db39fe07-65c4-451a-a2bd-78fcdfc10040.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("db39fe07-65c4-451a-a2bd-78fcdfc10040.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1102, tv_nsec: 670690930 } })
3332024-12-14T03:34:56.349ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("28f528f1-3159-4fbc-9304-37b7e4a50ae8.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7274e15f-a5f6-4975-bcdd-a2ef890c0230.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("7274e15f-a5f6-4975-bcdd-a2ef890c0230.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1102, tv_nsec: 670936754 } })
3342024-12-14T03:34:56.350ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3352024-12-14T03:34:56.350ZINFOnexus (BackgroundTasks): found DNS servers (initial) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal dns_group = internal file = nexus/src/app/background/tasks/dns_servers.rs:113
3362024-12-14T03:34:56.350ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 5.682324ms iteration = 1 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
3372024-12-14T03:34:56.350ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 2 reason = Dependency
3382024-12-14T03:34:56.350ZINFOnexus (BackgroundTasks): found DNS servers (initial) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external dns_group = external file = nexus/src/app/background/tasks/dns_servers.rs:113
3392024-12-14T03:34:56.350ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 5.721614ms iteration = 1 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
3402024-12-14T03:34:56.350ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 2 reason = Dependency
3412024-12-14T03:34:56.350ZWARNnexus (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:69 reason = no config
3422024-12-14T03:34:56.350ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 3.77\u{b5}s iteration = 2 status = {"error":"no config"}
3432024-12-14T03:34:56.350ZWARNnexus (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:69 reason = no config
3442024-12-14T03:34:56.350ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 299.966\u{b5}s iteration = 2 status = {"error":"no config"}
3452024-12-14T03:34:56.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
3462024-12-14T03:34:56.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
3472024-12-14T03:34:56.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
3482024-12-14T03:34:56.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
3492024-12-14T03:34:56.351ZDEBGnexus (SagaRecoverer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000003a8a, .. }) resource = Database result = Ok(())
3502024-12-14T03:34:56.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
3512024-12-14T03:34:56.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
3522024-12-14T03:34:56.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3532024-12-14T03:34:56.352ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
3542024-12-14T03:34:56.352ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
3552024-12-14T03:34:56.352ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
3562024-12-14T03:34:56.352ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
3572024-12-14T03:34:56.352ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
3582024-12-14T03:34:56.352ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
3592024-12-14T03:34:56.352ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
3602024-12-14T03:34:56.352ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
3612024-12-14T03:34:56.352ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
3622024-12-14T03:34:56.352ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
3632024-12-14T03:34:56.352ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
3642024-12-14T03:34:56.352ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
3652024-12-14T03:34:56.352ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
3662024-12-14T03:34:56.354ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
3672024-12-14T03:34:56.354ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
3682024-12-14T03:34:56.354ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
3692024-12-14T03:34:56.374ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8d70e61c-94ed-41ce-b36c-cb904f92c534.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8d70e61c-94ed-41ce-b36c-cb904f92c534.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1102, tv_nsec: 695700781 } })
3702024-12-14T03:34:56.375ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
3712024-12-14T03:34:56.377ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
3722024-12-14T03:34:56.378ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
3732024-12-14T03:34:56.379ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3742024-12-14T03:34:56.381ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-14 03:24:56.347677091 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
3752024-12-14T03:34:56.382ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 36.871319ms iteration = 1 status = {"expiration":"2024-12-14T03:24:56.347677091Z","pruned":[]}
3762024-12-14T03:34:56.383ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
3772024-12-14T03:34:56.383ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3782024-12-14T03:34:56.383ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3792024-12-14T03:34:56.384ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
3802024-12-14T03:34:56.385ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
3812024-12-14T03:34:56.392ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
3822024-12-14T03:34:56.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
3832024-12-14T03:34:56.417ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3842024-12-14T03:34:56.418ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 73.34057ms iteration = 1 status = {"errors":[],"found_port_ok":[]}
3852024-12-14T03:34:56.420ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
3862024-12-14T03:34:56.420ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
3872024-12-14T03:34:56.420ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
3882024-12-14T03:34:56.421ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
3892024-12-14T03:34:56.421ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
3902024-12-14T03:34:56.421ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
3912024-12-14T03:34:56.421ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
3922024-12-14T03:34:56.423ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3932024-12-14T03:34:56.423ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
3942024-12-14T03:34:56.423ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
3952024-12-14T03:34:56.424ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "66c297de-4c74-4b43-9bc6-80f3a2f53a5c", "content-length": "26", "date": "Sat, 14 Dec 2024 03:34:56 GMT"} })
3962024-12-14T03:34:56.424ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
3972024-12-14T03:34:56.425ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
3982024-12-14T03:34:56.425ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
3992024-12-14T03:34:56.425ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4002024-12-14T03:34:56.425ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4012024-12-14T03:34:56.426ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4022024-12-14T03:34:56.429ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
4032024-12-14T03:34:56.429ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
4042024-12-14T03:34:56.429ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
4052024-12-14T03:34:56.431ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4062024-12-14T03:34:56.431ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4072024-12-14T03:34:56.434ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
4082024-12-14T03:34:56.434ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
4092024-12-14T03:34:56.434ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
4102024-12-14T03:34:56.435ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4112024-12-14T03:34:56.436ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
4122024-12-14T03:34:56.438ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
4132024-12-14T03:34:56.438ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
4142024-12-14T03:34:56.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
4152024-12-14T03:34:56.440ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4162024-12-14T03:34:56.440ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4172024-12-14T03:34:56.441ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
4182024-12-14T03:34:56.441ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 96.544753ms iteration = 1 status = {"errors":[],"records_set_to_done":[]}
4192024-12-14T03:34:56.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
4202024-12-14T03:34:56.443ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 98.992523ms iteration = 1 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
4212024-12-14T03:34:56.443ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
4222024-12-14T03:34:56.444ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
4232024-12-14T03:34:56.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
4242024-12-14T03:34:56.444ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
4252024-12-14T03:34:56.444ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4262024-12-14T03:34:56.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
4272024-12-14T03:34:56.445ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4282024-12-14T03:34:56.446ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
4292024-12-14T03:34:56.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
4302024-12-14T03:34:56.447ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
4312024-12-14T03:34:56.447ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
4322024-12-14T03:34:56.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
4332024-12-14T03:34:56.448ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 103.647376ms iteration = 1 status = {"errors":[],"garbage_collect_requested":[]}
4342024-12-14T03:34:56.456ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
4352024-12-14T03:34:56.456ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
4362024-12-14T03:34:56.458ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 113.289749ms iteration = 1 status = {}
4372024-12-14T03:34:56.458ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
4382024-12-14T03:34:56.458ZINFOnexus (BackgroundTasks): Physical Disk Adoption: Rack not yet initialized background_task = physical_disk_adoption file = nexus/src/app/background/tasks/physical_disk_adoption.rs:80 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200
4392024-12-14T03:34:56.458ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 113.455663ms iteration = 1 status = {"error":"rack not yet initialized: a121ca05-bbee-41bf-b9db-9e03ff035200"}
4402024-12-14T03:34:56.458ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
4412024-12-14T03:34:56.460ZINFOnexus (SagaRecoverer): listed in-progress sagas count = 0 file = nexus/src/app/background/tasks/saga_recovery.rs:438
4422024-12-14T03:34:56.460ZDEBGnexus (BackgroundTasks): activation complete background_task = saga_recovery elapsed = 115.390881ms iteration = 1 status = {"last_pass":{"Success":{"nfailed":0,"nfound":0,"nrecovered":0,"nremoved":0,"nskipped":0}},"ntotal_failures":0,"ntotal_finished":0,"ntotal_recovered":0,"ntotal_sec_errors_bad_state":0,"ntotal_sec_errors_missing":0,"ntotal_started":0,"recent_failures":[],"recent_recoveries":[]}
4432024-12-14T03:34:56.460ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
4442024-12-14T03:34:56.461ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
4452024-12-14T03:34:56.464ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8d70e61c-94ed-41ce-b36c-cb904f92c534.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8d70e61c-94ed-41ce-b36c-cb904f92c534.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1102, tv_nsec: 785135601 } })
4462024-12-14T03:34:56.464ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
4472024-12-14T03:34:56.469ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
4482024-12-14T03:34:56.472ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "5ae9d329-5bb4-42c2-9afb-ec8b220b7c82", "content-length": "1", "date": "Sat, 14 Dec 2024 03:34:56 GMT"} })
4492024-12-14T03:34:56.473ZWARNnexus (BackgroundTasks): failed to read target blueprint background_task = blueprint_loader error = Internal Error: no target blueprint set file = nexus/src/app/background/tasks/blueprint_load.rs:69
4502024-12-14T03:34:56.473ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 128.683037ms iteration = 1 status = {"error":"failed to read target blueprint: Internal Error: no target blueprint set"}
4512024-12-14T03:34:56.474ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
4522024-12-14T03:34:56.475ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
4532024-12-14T03:34:56.487ZWARNnexus (BackgroundTasks): inventory collection is None background_task = service_zone_nat_tracker file = nexus/src/app/background/tasks/sync_service_zone_nat.rs:95
4542024-12-14T03:34:56.487ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 143.121126ms iteration = 1 status = {"error":"inventory collection is None"}
4552024-12-14T03:34:56.491ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
4562024-12-14T03:34:56.491ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
4572024-12-14T03:34:56.491ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 146.616267ms iteration = 1 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
4582024-12-14T03:34:56.498ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
4592024-12-14T03:34:56.498ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
4602024-12-14T03:34:56.499ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
4612024-12-14T03:34:56.499ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
4622024-12-14T03:34:56.501ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 156.543316ms iteration = 1 status = null
4632024-12-14T03:34:56.503ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4642024-12-14T03:34:56.507ZDEBGnexus (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = []
4652024-12-14T03:34:56.507ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
4662024-12-14T03:34:56.507ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
4672024-12-14T03:34:56.507ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
4682024-12-14T03:34:56.507ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-8d70e61c-94ed-41ce-b36c-cb904f92c534.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8d70e61c-94ed-41ce-b36c-cb904f92c534.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1102, tv_nsec: 828651883 } })
4692024-12-14T03:34:56.508ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
4702024-12-14T03:34:56.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
4712024-12-14T03:34:56.509ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4722024-12-14T03:34:56.510ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
4732024-12-14T03:34:56.510ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
4742024-12-14T03:34:56.511ZWARNnexus (BackgroundTasks): failed to read DNS config background_task = dns_config_external dns_group = external error = Internal Error: expected exactly one latest version for DNS group External, found 0 file = nexus/src/app/background/tasks/dns_config.rs:72
4752024-12-14T03:34:56.511ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 166.236019ms iteration = 1 status = {"error":"failed to read DNS config: Internal Error: expected exactly one latest version for DNS group External, found 0"}
4762024-12-14T03:34:56.511ZWARNnexus (BackgroundTasks): failed to read DNS config background_task = dns_config_internal dns_group = internal error = Internal Error: expected exactly one latest version for DNS group Internal, found 0 file = nexus/src/app/background/tasks/dns_config.rs:72
4772024-12-14T03:34:56.511ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 166.627567ms iteration = 1 status = {"error":"failed to read DNS config: Internal Error: expected exactly one latest version for DNS group Internal, found 0"}
4782024-12-14T03:34:56.511ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
4792024-12-14T03:34:56.511ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4802024-12-14T03:34:56.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
4812024-12-14T03:34:56.512ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4822024-12-14T03:34:56.512ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
4832024-12-14T03:34:56.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
4842024-12-14T03:34:56.512ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
4852024-12-14T03:34:56.513ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
4862024-12-14T03:34:56.516ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
4872024-12-14T03:34:56.516ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
4882024-12-14T03:34:56.516ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
4892024-12-14T03:34:56.518ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
4902024-12-14T03:34:56.518ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
4912024-12-14T03:34:56.518ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
4922024-12-14T03:34:56.518ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
4932024-12-14T03:34:56.521ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
4942024-12-14T03:34:56.521ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
4952024-12-14T03:34:56.521ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "9cb1a6ba-238c-42f6-b096-567af6933c54", "content-length": "26", "date": "Sat, 14 Dec 2024 03:34:56 GMT"} })
4962024-12-14T03:34:56.521ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
4972024-12-14T03:34:56.522ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
4982024-12-14T03:34:56.524ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4992024-12-14T03:34:56.528ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
5002024-12-14T03:34:56.528ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
5012024-12-14T03:34:56.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
5022024-12-14T03:34:56.539ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
5032024-12-14T03:34:56.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
5042024-12-14T03:34:56.541ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
5052024-12-14T03:34:56.541ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
5062024-12-14T03:34:56.541ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 196.845242ms iteration = 1 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
5072024-12-14T03:34:56.545ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5082024-12-14T03:34:56.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5092024-12-14T03:34:56.547ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5102024-12-14T03:34:56.548ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5112024-12-14T03:34:56.549ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5122024-12-14T03:34:56.550ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5132024-12-14T03:34:56.551ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5142024-12-14T03:34:56.551ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5152024-12-14T03:34:56.553ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5162024-12-14T03:34:56.553ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5172024-12-14T03:34:56.553ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 209.219911ms iteration = 1 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
5182024-12-14T03:34:56.554ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5192024-12-14T03:34:56.554ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5202024-12-14T03:34:56.556ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5212024-12-14T03:34:56.559ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
5222024-12-14T03:34:56.559ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 214.916485ms iteration = 1 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
5232024-12-14T03:34:56.562ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 217.971346ms iteration = 1 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
5242024-12-14T03:34:56.565ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
5252024-12-14T03:34:56.565ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 220.600299ms iteration = 1 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
5262024-12-14T03:34:56.570ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 226.060978ms iteration = 1 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
5272024-12-14T03:34:56.579ZDEBGnexus (BackgroundTasks): begin collection background_task = inventory_collection
5282024-12-14T03:34:56.579ZDEBGnexus (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[fd00:1122:3344:101::2]:12225
5292024-12-14T03:34:56.579ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/ignition
5302024-12-14T03:34:56.581ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "33d0c54e-1679-4e6a-8429-a48957bf4874", "content-length": "476", "date": "Sat, 14 Dec 2024 03:34:56 GMT"} })
5312024-12-14T03:34:56.581ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0
5322024-12-14T03:34:56.581ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "cf003a48-3adb-432a-a735-2e0a4badd0a9", "content-length": "734", "date": "Sat, 14 Dec 2024 03:34:56 GMT"} })
5332024-12-14T03:34:56.582ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0
5342024-12-14T03:34:56.582ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "841d8683-a6dc-44c6-8df8-8791bb1d972b", "content-length": "111", "date": "Sat, 14 Dec 2024 03:34:56 GMT"} })
5352024-12-14T03:34:56.583ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1
5362024-12-14T03:34:56.583ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "1028f960-946c-451a-bc58-e730bbd0b647", "content-length": "111", "date": "Sat, 14 Dec 2024 03:34:56 GMT"} })
5372024-12-14T03:34:56.583ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0
5382024-12-14T03:34:56.584ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "33f6d6bc-7897-4cc9-979a-976818147a9b", "content-length": "167", "date": "Sat, 14 Dec 2024 03:34:56 GMT"} })
5392024-12-14T03:34:56.584ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1
5402024-12-14T03:34:56.584ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "bf25baee-f5ec-478f-b447-2e999575145c", "content-length": "167", "date": "Sat, 14 Dec 2024 03:34:56 GMT"} })
5412024-12-14T03:34:56.584ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0
5422024-12-14T03:34:56.584ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {} subnet_networks = {} vpc_interfaces = {}
5432024-12-14T03:34:56.584ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "bad9916e-49f2-4154-844c-c96d849d83d9", "content-length": "175", "date": "Sat, 14 Dec 2024 03:34:56 GMT"} })
5442024-12-14T03:34:56.584ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1
5452024-12-14T03:34:56.585ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5462024-12-14T03:34:56.585ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "ca72f724-7071-41fe-a75e-073be002813f", "content-length": "175", "date": "Sat, 14 Dec 2024 03:34:56 GMT"} })
5472024-12-14T03:34:56.585ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa
5482024-12-14T03:34:56.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5492024-12-14T03:34:56.587ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5502024-12-14T03:34:56.588ZWARNnexus (BackgroundTasks): failed to read Silo/DNS/TLS configuration background_task = external_endpoints error = Internal Error: expected at least one external DNS zone file = nexus/src/app/background/tasks/external_endpoints.rs:48
5512024-12-14T03:34:56.588ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 243.673841ms iteration = 1 status = {"error":"failed to read Silo/DNS/TLS configuration: Internal Error: expected at least one external DNS zone"}
5522024-12-14T03:34:56.589ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "bed80ba3-d4bf-4c73-8042-1a77b741da15", "content-length": "702", "date": "Sat, 14 Dec 2024 03:34:56 GMT"} })
5532024-12-14T03:34:56.589ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
5542024-12-14T03:34:56.589ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
5552024-12-14T03:34:56.589ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5562024-12-14T03:34:56.589ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5572024-12-14T03:34:56.591ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "af7518b4-b6bb-416f-987a-7d507f61a973", "content-length": "727", "date": "Sat, 14 Dec 2024 03:34:56 GMT"} })
5582024-12-14T03:34:56.591ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
5592024-12-14T03:34:56.591ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "fba63115-2182-45bb-8cd5-2c85b62687e8", "content-length": "729", "date": "Sat, 14 Dec 2024 03:34:56 GMT"} })
5602024-12-14T03:34:56.592ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
5612024-12-14T03:34:56.592ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "a735d521-3351-4c30-934e-a622ec2e7235", "content-length": "728", "date": "Sat, 14 Dec 2024 03:34:56 GMT"} })
5622024-12-14T03:34:56.592ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0
5632024-12-14T03:34:56.592ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "3251c2b7-afe0-4906-b585-927bccb591a1", "content-length": "722", "date": "Sat, 14 Dec 2024 03:34:56 GMT"} })
5642024-12-14T03:34:56.592ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0
5652024-12-14T03:34:56.592ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "a720842f-f8e0-4fed-96be-53e334558d62", "content-length": "109", "date": "Sat, 14 Dec 2024 03:34:56 GMT"} })
5662024-12-14T03:34:56.592ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1
5672024-12-14T03:34:56.593ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "3efbb25e-19de-4424-a9c1-ca7186caf763", "content-length": "109", "date": "Sat, 14 Dec 2024 03:34:56 GMT"} })
5682024-12-14T03:34:56.593ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0
5692024-12-14T03:34:56.593ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "39fe0923-59bf-4324-b6b9-c8f2dd0a1422", "content-length": "169", "date": "Sat, 14 Dec 2024 03:34:56 GMT"} })
5702024-12-14T03:34:56.593ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1
5712024-12-14T03:34:56.593ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "477d3a65-7fac-4e5b-bd55-bc8e6299acab", "content-length": "169", "date": "Sat, 14 Dec 2024 03:34:56 GMT"} })
5722024-12-14T03:34:56.593ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0
5732024-12-14T03:34:56.594ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "bb67417f-7b2c-4deb-bb8a-7314f0e214e7", "content-length": "178", "date": "Sat, 14 Dec 2024 03:34:56 GMT"} })
5742024-12-14T03:34:56.594ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1
5752024-12-14T03:34:56.594ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "b05703c4-8d29-4312-8d94-d539a9c6829a", "content-length": "178", "date": "Sat, 14 Dec 2024 03:34:56 GMT"} })
5762024-12-14T03:34:56.594ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa
5772024-12-14T03:34:56.594ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "6121a6f9-9eca-457f-8cb2-591b7c072d9e", "content-length": "702", "date": "Sat, 14 Dec 2024 03:34:56 GMT"} })
5782024-12-14T03:34:56.594ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
5792024-12-14T03:34:56.594ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "8deef948-30dd-4bad-91ee-cb286b6ef706", "content-length": "727", "date": "Sat, 14 Dec 2024 03:34:56 GMT"} })
5802024-12-14T03:34:56.594ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
5812024-12-14T03:34:56.594ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "5e0288aa-0613-4137-a337-7de300e905d4", "content-length": "729", "date": "Sat, 14 Dec 2024 03:34:56 GMT"} })
5822024-12-14T03:34:56.594ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
5832024-12-14T03:34:56.595ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "fe9ecdc3-c008-4faa-90eb-1ab45c188dea", "content-length": "728", "date": "Sat, 14 Dec 2024 03:34:56 GMT"} })
5842024-12-14T03:34:56.595ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
5852024-12-14T03:34:56.595ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
5862024-12-14T03:34:56.597ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5872024-12-14T03:34:56.599ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
5882024-12-14T03:34:56.599ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
5892024-12-14T03:34:56.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
5902024-12-14T03:34:56.600ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 255.477747ms iteration = 1 status = {}
5912024-12-14T03:34:56.601ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5922024-12-14T03:34:56.602ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
5932024-12-14T03:34:56.602ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = []
5942024-12-14T03:34:56.602ZDEBGnexus (service-firewall-rule-progator): resolved 0 rules for sleds background_task = service_firewall_rule_propagation
5952024-12-14T03:34:56.603ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
5962024-12-14T03:34:56.603ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
5972024-12-14T03:34:56.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
5982024-12-14T03:34:56.612ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
5992024-12-14T03:34:56.612ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
6002024-12-14T03:34:56.612ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 267.697392ms iteration = 1 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
6012024-12-14T03:34:56.618ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 273.07753ms iteration = 1 status = {}
6022024-12-14T03:34:56.624ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
6032024-12-14T03:34:56.624ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
6042024-12-14T03:34:56.644ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
6052024-12-14T03:34:56.644ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 299.777945ms iteration = 1 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
6062024-12-14T03:34:56.726ZDEBGnexus (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
6072024-12-14T03:34:56.726ZDEBGnexus (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
6082024-12-14T03:34:56.726ZDEBGnexus (BackgroundTasks): finished collection background_task = inventory_collection
6092024-12-14T03:34:56.728ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
6102024-12-14T03:34:56.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
6112024-12-14T03:34:56.758ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6122024-12-14T03:34:56.760ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
6132024-12-14T03:34:56.760ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
6142024-12-14T03:34:56.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
6152024-12-14T03:34:56.769ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
6162024-12-14T03:34:56.769ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
6172024-12-14T03:34:56.798ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6182024-12-14T03:34:56.801ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
6192024-12-14T03:34:56.801ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
6202024-12-14T03:34:56.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
6212024-12-14T03:34:56.802ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6222024-12-14T03:34:56.803ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b5337da0-6c2f-41ce-9b5f-d860d6a59ba5 roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
6232024-12-14T03:34:56.803ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b5337da0-6c2f-41ce-9b5f-d860d6a59ba5 resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
6242024-12-14T03:34:56.806ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
6252024-12-14T03:34:56.806ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
6262024-12-14T03:34:56.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
6272024-12-14T03:34:56.812ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 466.967564ms iteration = 1 status = {}
6282024-12-14T03:34:56.836ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b5337da0-6c2f-41ce-9b5f-d860d6a59ba5 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
6292024-12-14T03:34:56.837ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b5337da0-6c2f-41ce-9b5f-d860d6a59ba5 resource = Fleet result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
6302024-12-14T03:34:56.837ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b5337da0-6c2f-41ce-9b5f-d860d6a59ba5 roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
6312024-12-14T03:34:56.838ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b5337da0-6c2f-41ce-9b5f-d860d6a59ba5 resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
6322024-12-14T03:34:56.840ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b5337da0-6c2f-41ce-9b5f-d860d6a59ba5 roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
6332024-12-14T03:34:56.840ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b5337da0-6c2f-41ce-9b5f-d860d6a59ba5 resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
6342024-12-14T03:34:56.842ZINFOnexus (dropshot_internal): request completed error_message_external = not found: rack with id "a121ca05-bbee-41bf-b9db-9e03ff035200" error_message_internal = not found: rack with id "a121ca05-bbee-41bf-b9db-9e03ff035200" file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 40135 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b5337da0-6c2f-41ce-9b5f-d860d6a59ba5 response_code = 404 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
6352024-12-14T03:34:56.948ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = []
6362024-12-14T03:34:56.948ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
6372024-12-14T03:34:56.948ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 0 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
6382024-12-14T03:34:56.948ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 600.50328ms
6392024-12-14T03:34:56.948ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 603.589692ms iteration = 1 status = {}
6402024-12-14T03:34:57.066ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
6412024-12-14T03:34:57.066ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
6422024-12-14T03:34:57.068ZWARNnexus: Cannot look up rack: Object (of type ById(a121ca05-bbee-41bf-b9db-9e03ff035200)) not found: rack file = nexus/src/app/rack.rs:774
6432024-12-14T03:34:57.095ZINFOnexus (BackgroundTasks): inserted inventory collection background_task = inventory_collection collection_id = 31a9a568-b3f8-4460-96ea-3ad6407a415a file = nexus/db-queries/src/db/datastore/inventory.rs:1010
6442024-12-14T03:34:57.095ZDEBGnexus (BackgroundTasks): inventory collection complete background_task = inventory_collection collection_id = 31a9a568-b3f8-4460-96ea-3ad6407a415a time_started = 2024-12-14 03:34:56.578477 UTC
6452024-12-14T03:34:57.095ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 750.493075ms iteration = 1 status = {"collection_id":"31a9a568-b3f8-4460-96ea-3ad6407a415a","time_done":"2024-12-14 03:34:56.726621 UTC","time_started":"2024-12-14 03:34:56.578477 UTC"}
6462024-12-14T03:34:57.095ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 2 reason = Dependency
6472024-12-14T03:34:57.095ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
6482024-12-14T03:34:57.095ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
6492024-12-14T03:34:57.097ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6502024-12-14T03:34:57.099ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
6512024-12-14T03:34:57.099ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
6522024-12-14T03:34:57.099ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
6532024-12-14T03:34:57.101ZINFOnexus (BackgroundTasks): Physical Disk Adoption: Rack not yet initialized background_task = physical_disk_adoption file = nexus/src/app/background/tasks/physical_disk_adoption.rs:80 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200
6542024-12-14T03:34:57.101ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 5.690354ms iteration = 2 status = {"error":"rack not yet initialized: a121ca05-bbee-41bf-b9db-9e03ff035200"}
6552024-12-14T03:34:57.734ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 13aa55bd-b0ee-4043-adb5-5b89499de379 roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
6562024-12-14T03:34:57.734ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 13aa55bd-b0ee-4043-adb5-5b89499de379 resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
6572024-12-14T03:34:57.736ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 13aa55bd-b0ee-4043-adb5-5b89499de379 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
6582024-12-14T03:34:57.738ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 13aa55bd-b0ee-4043-adb5-5b89499de379 resource = Fleet result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
6592024-12-14T03:34:57.738ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 13aa55bd-b0ee-4043-adb5-5b89499de379 roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
6602024-12-14T03:34:57.738ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 13aa55bd-b0ee-4043-adb5-5b89499de379 resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
6612024-12-14T03:34:57.767ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 13aa55bd-b0ee-4043-adb5-5b89499de379 roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
6622024-12-14T03:34:57.767ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 13aa55bd-b0ee-4043-adb5-5b89499de379 resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
6632024-12-14T03:34:57.768ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 13aa55bd-b0ee-4043-adb5-5b89499de379 roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
6642024-12-14T03:34:57.769ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 13aa55bd-b0ee-4043-adb5-5b89499de379 resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
6652024-12-14T03:34:57.770ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 13aa55bd-b0ee-4043-adb5-5b89499de379 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
6662024-12-14T03:34:57.773ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 13aa55bd-b0ee-4043-adb5-5b89499de379 resource = Rack { parent: Fleet, key: a121ca05-bbee-41bf-b9db-9e03ff035200, lookup_type: ById(a121ca05-bbee-41bf-b9db-9e03ff035200) } result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
6672024-12-14T03:34:57.773ZDEBGnexus (dropshot_internal): updating rack subnet for rack a121ca05-bbee-41bf-b9db-9e03ff035200 to Some( V6( Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56, }, ), ) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 13aa55bd-b0ee-4043-adb5-5b89499de379 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
6682024-12-14T03:34:57.773ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 13aa55bd-b0ee-4043-adb5-5b89499de379 roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
6692024-12-14T03:34:57.773ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 13aa55bd-b0ee-4043-adb5-5b89499de379 resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
6702024-12-14T03:34:57.779ZINFOnexus (dropshot_internal): Using automatic external switchport discovery actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:324 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 13aa55bd-b0ee-4043-adb5-5b89499de379 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
6712024-12-14T03:34:57.814ZDEBGnexus (DpdClient): client request actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true body = None local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 13aa55bd-b0ee-4043-adb5-5b89499de379 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
6722024-12-14T03:34:57.816ZDEBGnexus (DpdClient): client response actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 13aa55bd-b0ee-4043-adb5-5b89499de379 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/ports", status: 200, headers: {"content-type": "application/json", "x-request-id": "3c6e197a-4293-4700-9da5-54cb1cba35a2", "content-length": "24", "date": "Sat, 14 Dec 2024 03:34:57 GMT"} }) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
6732024-12-14T03:34:57.818ZINFOnexus (dropshot_internal): discovered ports for switch0: [ Internal( Internal( "int0", ), ), Rear( Rear( "rear0", ), ), Qsfp( Qsfp( "qsfp0", ), ), ] actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:344 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 13aa55bd-b0ee-4043-adb5-5b89499de379 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
6742024-12-14T03:34:57.818ZINFOnexus (dropshot_internal): populating ports for switch0: [ Name( "qsfp0", ), ] actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:354 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 13aa55bd-b0ee-4043-adb5-5b89499de379 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
6752024-12-14T03:34:57.818ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 13aa55bd-b0ee-4043-adb5-5b89499de379 roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
6762024-12-14T03:34:57.818ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 13aa55bd-b0ee-4043-adb5-5b89499de379 resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
6772024-12-14T03:34:57.838ZINFOnexus (dropshot_internal): Recording Rack Network Configuration actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:389 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 13aa55bd-b0ee-4043-adb5-5b89499de379 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
6782024-12-14T03:34:57.838ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 13aa55bd-b0ee-4043-adb5-5b89499de379 roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
6792024-12-14T03:34:57.839ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 13aa55bd-b0ee-4043-adb5-5b89499de379 resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
6802024-12-14T03:34:57.920ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 13aa55bd-b0ee-4043-adb5-5b89499de379 roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
6812024-12-14T03:34:57.920ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 13aa55bd-b0ee-4043-adb5-5b89499de379 resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
6822024-12-14T03:34:58.117ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 13aa55bd-b0ee-4043-adb5-5b89499de379 roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
6832024-12-14T03:34:58.117ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 13aa55bd-b0ee-4043-adb5-5b89499de379 resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
6842024-12-14T03:34:58.126ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 13aa55bd-b0ee-4043-adb5-5b89499de379 roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
6852024-12-14T03:34:58.126ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 13aa55bd-b0ee-4043-adb5-5b89499de379 resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
6862024-12-14T03:34:58.134ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 13aa55bd-b0ee-4043-adb5-5b89499de379 roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
6872024-12-14T03:34:58.135ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 13aa55bd-b0ee-4043-adb5-5b89499de379 resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
6882024-12-14T03:34:58.160ZDEBGnexus (dropshot_internal): failed to check if bgp peer exists in switch port settings actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true error = NotFound local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 13aa55bd-b0ee-4043-adb5-5b89499de379 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
6892024-12-14T03:34:58.167ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 13aa55bd-b0ee-4043-adb5-5b89499de379 roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
6902024-12-14T03:34:58.167ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 13aa55bd-b0ee-4043-adb5-5b89499de379 resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
6912024-12-14T03:34:58.169ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 13aa55bd-b0ee-4043-adb5-5b89499de379 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
6922024-12-14T03:34:58.170ZDEBGnexus (dropshot_internal): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 13aa55bd-b0ee-4043-adb5-5b89499de379 resource = Fleet result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
6932024-12-14T03:34:58.170ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 13aa55bd-b0ee-4043-adb5-5b89499de379 roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
6942024-12-14T03:34:58.170ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 13aa55bd-b0ee-4043-adb5-5b89499de379 resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
6952024-12-14T03:34:58.178ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 13aa55bd-b0ee-4043-adb5-5b89499de379 roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
6962024-12-14T03:34:58.178ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 13aa55bd-b0ee-4043-adb5-5b89499de379 resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
6972024-12-14T03:34:58.180ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 13aa55bd-b0ee-4043-adb5-5b89499de379 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
6982024-12-14T03:34:58.182ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 13aa55bd-b0ee-4043-adb5-5b89499de379 resource = IpPool { parent: Fleet, key: bdf4635b-d53e-4acb-8b1c-1769f4520d05, lookup_type: ByName("oxide-service-pool") } result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
6992024-12-14T03:34:58.182ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 13aa55bd-b0ee-4043-adb5-5b89499de379 roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
7002024-12-14T03:34:58.183ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 13aa55bd-b0ee-4043-adb5-5b89499de379 resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
7012024-12-14T03:34:58.184ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 13aa55bd-b0ee-4043-adb5-5b89499de379 roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
7022024-12-14T03:34:58.184ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 13aa55bd-b0ee-4043-adb5-5b89499de379 resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
7032024-12-14T03:34:58.188ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 13aa55bd-b0ee-4043-adb5-5b89499de379 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
7042024-12-14T03:34:58.190ZDEBGnexus (dropshot_internal): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 13aa55bd-b0ee-4043-adb5-5b89499de379 resource = IpPool { parent: Fleet, key: bdf4635b-d53e-4acb-8b1c-1769f4520d05, lookup_type: ByName("oxide-service-pool") } result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
7052024-12-14T03:34:58.223ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 13aa55bd-b0ee-4043-adb5-5b89499de379 roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
7062024-12-14T03:34:58.223ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 13aa55bd-b0ee-4043-adb5-5b89499de379 resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
7072024-12-14T03:34:58.224ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 13aa55bd-b0ee-4043-adb5-5b89499de379 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
7082024-12-14T03:34:58.226ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 13aa55bd-b0ee-4043-adb5-5b89499de379 resource = BlueprintConfig result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
7092024-12-14T03:34:58.386ZINFOnexus (dropshot_internal): inserted blueprint actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true blueprint_id = eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1 file = nexus/db-queries/src/db/datastore/deployment.rs:456 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 13aa55bd-b0ee-4043-adb5-5b89499de379 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
7102024-12-14T03:34:58.386ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 13aa55bd-b0ee-4043-adb5-5b89499de379 roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
7112024-12-14T03:34:58.386ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 13aa55bd-b0ee-4043-adb5-5b89499de379 resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
7122024-12-14T03:34:58.388ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 13aa55bd-b0ee-4043-adb5-5b89499de379 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
7132024-12-14T03:34:58.389ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 13aa55bd-b0ee-4043-adb5-5b89499de379 resource = BlueprintConfig result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
7142024-12-14T03:34:58.408ZINFOnexus (dropshot_internal): No networking records needed for internal_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 13aa55bd-b0ee-4043-adb5-5b89499de379 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
7152024-12-14T03:34:58.408ZINFOnexus (dropshot_internal): No networking records needed for internal_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 13aa55bd-b0ee-4043-adb5-5b89499de379 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
7162024-12-14T03:34:58.408ZINFOnexus (dropshot_internal): No networking records needed for internal_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 13aa55bd-b0ee-4043-adb5-5b89499de379 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
7172024-12-14T03:34:58.408ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 13aa55bd-b0ee-4043-adb5-5b89499de379 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
7182024-12-14T03:34:58.408ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 13aa55bd-b0ee-4043-adb5-5b89499de379 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
7192024-12-14T03:34:58.408ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 13aa55bd-b0ee-4043-adb5-5b89499de379 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
7202024-12-14T03:34:58.408ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 13aa55bd-b0ee-4043-adb5-5b89499de379 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
7212024-12-14T03:34:58.408ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 13aa55bd-b0ee-4043-adb5-5b89499de379 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
7222024-12-14T03:34:58.505ZINFOnexus (dropshot_internal): Inserted networking records for external_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 13aa55bd-b0ee-4043-adb5-5b89499de379 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
7232024-12-14T03:34:58.530ZINFOnexus (dropshot_internal): Inserted networking records for external_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 13aa55bd-b0ee-4043-adb5-5b89499de379 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
7242024-12-14T03:34:58.555ZINFOnexus (dropshot_internal): Inserted networking records for nexus service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 13aa55bd-b0ee-4043-adb5-5b89499de379 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
7252024-12-14T03:34:58.576ZINFOnexus (dropshot_internal): Inserted networking records for nexus service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 13aa55bd-b0ee-4043-adb5-5b89499de379 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
7262024-12-14T03:34:58.598ZINFOnexus (dropshot_internal): Inserted networking records for nexus service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 13aa55bd-b0ee-4043-adb5-5b89499de379 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
7272024-12-14T03:34:58.599ZINFOnexus (dropshot_internal): No networking records needed for oximeter service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 13aa55bd-b0ee-4043-adb5-5b89499de379 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
7282024-12-14T03:34:58.599ZINFOnexus (dropshot_internal): No networking records needed for clickhouse service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 13aa55bd-b0ee-4043-adb5-5b89499de379 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
7292024-12-14T03:34:58.599ZINFOnexus (dropshot_internal): No networking records needed for crucible_pantry service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 13aa55bd-b0ee-4043-adb5-5b89499de379 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
7302024-12-14T03:34:58.599ZINFOnexus (dropshot_internal): No networking records needed for crucible_pantry service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 13aa55bd-b0ee-4043-adb5-5b89499de379 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
7312024-12-14T03:34:58.599ZINFOnexus (dropshot_internal): No networking records needed for crucible_pantry service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 13aa55bd-b0ee-4043-adb5-5b89499de379 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
7322024-12-14T03:34:58.599ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 13aa55bd-b0ee-4043-adb5-5b89499de379 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
7332024-12-14T03:34:58.599ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 13aa55bd-b0ee-4043-adb5-5b89499de379 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
7342024-12-14T03:34:58.599ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 13aa55bd-b0ee-4043-adb5-5b89499de379 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
7352024-12-14T03:34:58.599ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 13aa55bd-b0ee-4043-adb5-5b89499de379 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
7362024-12-14T03:34:58.599ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 13aa55bd-b0ee-4043-adb5-5b89499de379 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
7372024-12-14T03:34:58.599ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 13aa55bd-b0ee-4043-adb5-5b89499de379 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
7382024-12-14T03:34:58.599ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 13aa55bd-b0ee-4043-adb5-5b89499de379 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
7392024-12-14T03:34:58.599ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 13aa55bd-b0ee-4043-adb5-5b89499de379 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
7402024-12-14T03:34:58.599ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 13aa55bd-b0ee-4043-adb5-5b89499de379 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
7412024-12-14T03:34:58.625ZINFOnexus (dropshot_internal): Inserted networking records for boundary_ntp service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 13aa55bd-b0ee-4043-adb5-5b89499de379 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
7422024-12-14T03:34:58.625ZINFOnexus (dropshot_internal): Inserted service networking records actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:809 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 13aa55bd-b0ee-4043-adb5-5b89499de379 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
7432024-12-14T03:34:58.625ZINFOnexus (dropshot_internal): physical disk upsert in handoff: PhysicalDisk { identity: PhysicalDiskIdentity { id: b81997dc-4390-4d6b-b937-ec142d15ce9e (physical_disk), time_created: 2024-12-14T03:34:57.738147517Z, time_modified: 2024-12-14T03:34:57.738147517Z, }, time_deleted: None, rcgen: Generation( Generation( 1, ), ), vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-U2", variant: U2, sled_id: 8d70e61c-94ed-41ce-b36c-cb904f92c534, disk_policy: InService, disk_state: Active, } actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:812 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 13aa55bd-b0ee-4043-adb5-5b89499de379 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
7442024-12-14T03:34:58.625ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 13aa55bd-b0ee-4043-adb5-5b89499de379 roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
7452024-12-14T03:34:58.625ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 13aa55bd-b0ee-4043-adb5-5b89499de379 resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
7462024-12-14T03:34:58.627ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 13aa55bd-b0ee-4043-adb5-5b89499de379 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
7472024-12-14T03:34:58.629ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 13aa55bd-b0ee-4043-adb5-5b89499de379 resource = Fleet result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
7482024-12-14T03:34:58.650ZERROnexus (dropshot_internal): Failed to upsert physical disk actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true err = Custom transaction error: Object (of type ById(8d70e61c-94ed-41ce-b36c-cb904f92c534)) not found: sled file = nexus/db-queries/src/db/datastore/rack.rs:816 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 13aa55bd-b0ee-4043-adb5-5b89499de379 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
7492024-12-14T03:34:58.657ZINFOnexus (dropshot_internal): request completed error_message_external = not found: sled with id "8d70e61c-94ed-41ce-b36c-cb904f92c534" error_message_internal = not found: sled with id "8d70e61c-94ed-41ce-b36c-cb904f92c534" file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 923300 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 13aa55bd-b0ee-4043-adb5-5b89499de379 response_code = 404 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
7502024-12-14T03:34:59.068ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
7512024-12-14T03:34:59.069ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
7522024-12-14T03:34:59.070ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
7532024-12-14T03:34:59.070ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
7542024-12-14T03:34:59.073ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7552024-12-14T03:34:59.075ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: a121ca05-bbee-41bf-b9db-9e03ff035200, lookup_type: ById(a121ca05-bbee-41bf-b9db-9e03ff035200) } result = Ok(())
7562024-12-14T03:34:59.075ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: a121ca05-bbee-41bf-b9db-9e03ff035200, time_created: 2024-12-14T03:34:57.145875Z, time_modified: 2024-12-14T03:34:57.145875Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
7572024-12-14T03:34:59.968ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 46fa4837-d8a5-4db6-a8d3-9e6c865c6eeb roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
7582024-12-14T03:34:59.968ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 46fa4837-d8a5-4db6-a8d3-9e6c865c6eeb resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
7592024-12-14T03:34:59.970ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 46fa4837-d8a5-4db6-a8d3-9e6c865c6eeb roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
7602024-12-14T03:34:59.971ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 46fa4837-d8a5-4db6-a8d3-9e6c865c6eeb resource = Fleet result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
7612024-12-14T03:34:59.971ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 46fa4837-d8a5-4db6-a8d3-9e6c865c6eeb roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
7622024-12-14T03:34:59.972ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 46fa4837-d8a5-4db6-a8d3-9e6c865c6eeb resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
7632024-12-14T03:34:59.989ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 46fa4837-d8a5-4db6-a8d3-9e6c865c6eeb roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
7642024-12-14T03:34:59.989ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 46fa4837-d8a5-4db6-a8d3-9e6c865c6eeb resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
7652024-12-14T03:34:59.991ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 46fa4837-d8a5-4db6-a8d3-9e6c865c6eeb roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
7662024-12-14T03:34:59.991ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 46fa4837-d8a5-4db6-a8d3-9e6c865c6eeb resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
7672024-12-14T03:34:59.993ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 46fa4837-d8a5-4db6-a8d3-9e6c865c6eeb roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
7682024-12-14T03:34:59.995ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 46fa4837-d8a5-4db6-a8d3-9e6c865c6eeb resource = Rack { parent: Fleet, key: a121ca05-bbee-41bf-b9db-9e03ff035200, lookup_type: ById(a121ca05-bbee-41bf-b9db-9e03ff035200) } result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
7692024-12-14T03:34:59.995ZDEBGnexus (dropshot_internal): updating rack subnet for rack a121ca05-bbee-41bf-b9db-9e03ff035200 to Some( V6( Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56, }, ), ) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 46fa4837-d8a5-4db6-a8d3-9e6c865c6eeb uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
7702024-12-14T03:34:59.995ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 46fa4837-d8a5-4db6-a8d3-9e6c865c6eeb roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
7712024-12-14T03:34:59.996ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 46fa4837-d8a5-4db6-a8d3-9e6c865c6eeb resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
7722024-12-14T03:35:00.002ZINFOnexus (dropshot_internal): Using automatic external switchport discovery actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:324 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 46fa4837-d8a5-4db6-a8d3-9e6c865c6eeb uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
7732024-12-14T03:35:00.035ZDEBGnexus (DpdClient): client request actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true body = None local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 46fa4837-d8a5-4db6-a8d3-9e6c865c6eeb uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
7742024-12-14T03:35:00.035ZDEBGnexus (DpdClient): client response actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 46fa4837-d8a5-4db6-a8d3-9e6c865c6eeb result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/ports", status: 200, headers: {"content-type": "application/json", "x-request-id": "71e3fa68-d191-41b8-8ea2-1952163131db", "content-length": "24", "date": "Sat, 14 Dec 2024 03:34:59 GMT"} }) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
7752024-12-14T03:35:00.035ZINFOnexus (dropshot_internal): discovered ports for switch0: [ Internal( Internal( "int0", ), ), Rear( Rear( "rear0", ), ), Qsfp( Qsfp( "qsfp0", ), ), ] actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:344 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 46fa4837-d8a5-4db6-a8d3-9e6c865c6eeb uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
7762024-12-14T03:35:00.035ZINFOnexus (dropshot_internal): populating ports for switch0: [ Name( "qsfp0", ), ] actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:354 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 46fa4837-d8a5-4db6-a8d3-9e6c865c6eeb uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
7772024-12-14T03:35:00.035ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 46fa4837-d8a5-4db6-a8d3-9e6c865c6eeb roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
7782024-12-14T03:35:00.036ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 46fa4837-d8a5-4db6-a8d3-9e6c865c6eeb resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
7792024-12-14T03:35:00.059ZINFOnexus (dropshot_internal): Recording Rack Network Configuration actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:389 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 46fa4837-d8a5-4db6-a8d3-9e6c865c6eeb uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
7802024-12-14T03:35:00.059ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 46fa4837-d8a5-4db6-a8d3-9e6c865c6eeb roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
7812024-12-14T03:35:00.060ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 46fa4837-d8a5-4db6-a8d3-9e6c865c6eeb resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
7822024-12-14T03:35:00.063ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 46fa4837-d8a5-4db6-a8d3-9e6c865c6eeb roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
7832024-12-14T03:35:00.063ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 46fa4837-d8a5-4db6-a8d3-9e6c865c6eeb resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
7842024-12-14T03:35:00.071ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 46fa4837-d8a5-4db6-a8d3-9e6c865c6eeb roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
7852024-12-14T03:35:00.072ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 46fa4837-d8a5-4db6-a8d3-9e6c865c6eeb resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
7862024-12-14T03:35:00.079ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 46fa4837-d8a5-4db6-a8d3-9e6c865c6eeb roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
7872024-12-14T03:35:00.079ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 46fa4837-d8a5-4db6-a8d3-9e6c865c6eeb resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
7882024-12-14T03:35:00.081ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 46fa4837-d8a5-4db6-a8d3-9e6c865c6eeb roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
7892024-12-14T03:35:00.081ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 46fa4837-d8a5-4db6-a8d3-9e6c865c6eeb resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
7902024-12-14T03:35:00.100ZDEBGnexus (dropshot_internal): failed to check if bgp peer exists in switch port settings actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true error = NotFound local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 46fa4837-d8a5-4db6-a8d3-9e6c865c6eeb uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
7912024-12-14T03:35:00.101ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 46fa4837-d8a5-4db6-a8d3-9e6c865c6eeb roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
7922024-12-14T03:35:00.101ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 46fa4837-d8a5-4db6-a8d3-9e6c865c6eeb resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
7932024-12-14T03:35:00.103ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 46fa4837-d8a5-4db6-a8d3-9e6c865c6eeb roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
7942024-12-14T03:35:00.104ZDEBGnexus (dropshot_internal): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 46fa4837-d8a5-4db6-a8d3-9e6c865c6eeb resource = Fleet result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
7952024-12-14T03:35:00.104ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 46fa4837-d8a5-4db6-a8d3-9e6c865c6eeb roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
7962024-12-14T03:35:00.104ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 46fa4837-d8a5-4db6-a8d3-9e6c865c6eeb resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
7972024-12-14T03:35:00.116ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 46fa4837-d8a5-4db6-a8d3-9e6c865c6eeb roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
7982024-12-14T03:35:00.116ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 46fa4837-d8a5-4db6-a8d3-9e6c865c6eeb resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
7992024-12-14T03:35:00.118ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 46fa4837-d8a5-4db6-a8d3-9e6c865c6eeb roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
8002024-12-14T03:35:00.121ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 46fa4837-d8a5-4db6-a8d3-9e6c865c6eeb resource = IpPool { parent: Fleet, key: bdf4635b-d53e-4acb-8b1c-1769f4520d05, lookup_type: ByName("oxide-service-pool") } result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
8012024-12-14T03:35:00.121ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 46fa4837-d8a5-4db6-a8d3-9e6c865c6eeb roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
8022024-12-14T03:35:00.121ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 46fa4837-d8a5-4db6-a8d3-9e6c865c6eeb resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
8032024-12-14T03:35:00.122ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 46fa4837-d8a5-4db6-a8d3-9e6c865c6eeb roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
8042024-12-14T03:35:00.123ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 46fa4837-d8a5-4db6-a8d3-9e6c865c6eeb resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
8052024-12-14T03:35:00.124ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 46fa4837-d8a5-4db6-a8d3-9e6c865c6eeb roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
8062024-12-14T03:35:00.126ZDEBGnexus (dropshot_internal): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 46fa4837-d8a5-4db6-a8d3-9e6c865c6eeb resource = IpPool { parent: Fleet, key: bdf4635b-d53e-4acb-8b1c-1769f4520d05, lookup_type: ByName("oxide-service-pool") } result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
8072024-12-14T03:35:00.154ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 46fa4837-d8a5-4db6-a8d3-9e6c865c6eeb roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
8082024-12-14T03:35:00.154ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 46fa4837-d8a5-4db6-a8d3-9e6c865c6eeb resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
8092024-12-14T03:35:00.155ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 46fa4837-d8a5-4db6-a8d3-9e6c865c6eeb roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
8102024-12-14T03:35:00.157ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 46fa4837-d8a5-4db6-a8d3-9e6c865c6eeb resource = BlueprintConfig result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
8112024-12-14T03:35:00.294ZINFOnexus (dropshot_internal): inserted blueprint actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true blueprint_id = eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1 file = nexus/db-queries/src/db/datastore/deployment.rs:456 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 46fa4837-d8a5-4db6-a8d3-9e6c865c6eeb uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
8122024-12-14T03:35:00.294ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 46fa4837-d8a5-4db6-a8d3-9e6c865c6eeb roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
8132024-12-14T03:35:00.294ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 46fa4837-d8a5-4db6-a8d3-9e6c865c6eeb resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
8142024-12-14T03:35:00.296ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 46fa4837-d8a5-4db6-a8d3-9e6c865c6eeb roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
8152024-12-14T03:35:00.298ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 46fa4837-d8a5-4db6-a8d3-9e6c865c6eeb resource = BlueprintConfig result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
8162024-12-14T03:35:00.309ZINFOnexus (dropshot_internal): No networking records needed for internal_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 46fa4837-d8a5-4db6-a8d3-9e6c865c6eeb uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
8172024-12-14T03:35:00.309ZINFOnexus (dropshot_internal): No networking records needed for internal_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 46fa4837-d8a5-4db6-a8d3-9e6c865c6eeb uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
8182024-12-14T03:35:00.309ZINFOnexus (dropshot_internal): No networking records needed for internal_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 46fa4837-d8a5-4db6-a8d3-9e6c865c6eeb uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
8192024-12-14T03:35:00.309ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 46fa4837-d8a5-4db6-a8d3-9e6c865c6eeb uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
8202024-12-14T03:35:00.309ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 46fa4837-d8a5-4db6-a8d3-9e6c865c6eeb uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
8212024-12-14T03:35:00.309ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 46fa4837-d8a5-4db6-a8d3-9e6c865c6eeb uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
8222024-12-14T03:35:00.309ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 46fa4837-d8a5-4db6-a8d3-9e6c865c6eeb uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
8232024-12-14T03:35:00.309ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 46fa4837-d8a5-4db6-a8d3-9e6c865c6eeb uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
8242024-12-14T03:35:00.404ZINFOnexus (dropshot_internal): Inserted networking records for external_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 46fa4837-d8a5-4db6-a8d3-9e6c865c6eeb uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
8252024-12-14T03:35:00.434ZINFOnexus (dropshot_internal): Inserted networking records for external_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 46fa4837-d8a5-4db6-a8d3-9e6c865c6eeb uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
8262024-12-14T03:35:00.455ZINFOnexus (dropshot_internal): Inserted networking records for nexus service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 46fa4837-d8a5-4db6-a8d3-9e6c865c6eeb uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
8272024-12-14T03:35:00.477ZINFOnexus (dropshot_internal): Inserted networking records for nexus service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 46fa4837-d8a5-4db6-a8d3-9e6c865c6eeb uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
8282024-12-14T03:35:00.498ZINFOnexus (dropshot_internal): Inserted networking records for nexus service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 46fa4837-d8a5-4db6-a8d3-9e6c865c6eeb uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
8292024-12-14T03:35:00.498ZINFOnexus (dropshot_internal): No networking records needed for oximeter service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 46fa4837-d8a5-4db6-a8d3-9e6c865c6eeb uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
8302024-12-14T03:35:00.498ZINFOnexus (dropshot_internal): No networking records needed for clickhouse service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 46fa4837-d8a5-4db6-a8d3-9e6c865c6eeb uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
8312024-12-14T03:35:00.498ZINFOnexus (dropshot_internal): No networking records needed for crucible_pantry service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 46fa4837-d8a5-4db6-a8d3-9e6c865c6eeb uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
8322024-12-14T03:35:00.498ZINFOnexus (dropshot_internal): No networking records needed for crucible_pantry service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 46fa4837-d8a5-4db6-a8d3-9e6c865c6eeb uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
8332024-12-14T03:35:00.498ZINFOnexus (dropshot_internal): No networking records needed for crucible_pantry service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 46fa4837-d8a5-4db6-a8d3-9e6c865c6eeb uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
8342024-12-14T03:35:00.498ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 46fa4837-d8a5-4db6-a8d3-9e6c865c6eeb uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
8352024-12-14T03:35:00.498ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 46fa4837-d8a5-4db6-a8d3-9e6c865c6eeb uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
8362024-12-14T03:35:00.498ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 46fa4837-d8a5-4db6-a8d3-9e6c865c6eeb uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
8372024-12-14T03:35:00.498ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 46fa4837-d8a5-4db6-a8d3-9e6c865c6eeb uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
8382024-12-14T03:35:00.498ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 46fa4837-d8a5-4db6-a8d3-9e6c865c6eeb uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
8392024-12-14T03:35:00.498ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 46fa4837-d8a5-4db6-a8d3-9e6c865c6eeb uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
8402024-12-14T03:35:00.498ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 46fa4837-d8a5-4db6-a8d3-9e6c865c6eeb uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
8412024-12-14T03:35:00.498ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 46fa4837-d8a5-4db6-a8d3-9e6c865c6eeb uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
8422024-12-14T03:35:00.498ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 46fa4837-d8a5-4db6-a8d3-9e6c865c6eeb uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
8432024-12-14T03:35:00.519ZINFOnexus (dropshot_internal): Inserted networking records for boundary_ntp service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 46fa4837-d8a5-4db6-a8d3-9e6c865c6eeb uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
8442024-12-14T03:35:00.519ZINFOnexus (dropshot_internal): Inserted service networking records actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:809 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 46fa4837-d8a5-4db6-a8d3-9e6c865c6eeb uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
8452024-12-14T03:35:00.519ZINFOnexus (dropshot_internal): physical disk upsert in handoff: PhysicalDisk { identity: PhysicalDiskIdentity { id: b81997dc-4390-4d6b-b937-ec142d15ce9e (physical_disk), time_created: 2024-12-14T03:34:59.971783516Z, time_modified: 2024-12-14T03:34:59.971783516Z, }, time_deleted: None, rcgen: Generation( Generation( 1, ), ), vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-U2", variant: U2, sled_id: 8d70e61c-94ed-41ce-b36c-cb904f92c534, disk_policy: InService, disk_state: Active, } actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:812 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 46fa4837-d8a5-4db6-a8d3-9e6c865c6eeb uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
8462024-12-14T03:35:00.519ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 46fa4837-d8a5-4db6-a8d3-9e6c865c6eeb roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
8472024-12-14T03:35:00.519ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 46fa4837-d8a5-4db6-a8d3-9e6c865c6eeb resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
8482024-12-14T03:35:00.521ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 46fa4837-d8a5-4db6-a8d3-9e6c865c6eeb roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
8492024-12-14T03:35:00.522ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 46fa4837-d8a5-4db6-a8d3-9e6c865c6eeb resource = Fleet result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
8502024-12-14T03:35:00.546ZERROnexus (dropshot_internal): Failed to upsert physical disk actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true err = Custom transaction error: Object (of type ById(8d70e61c-94ed-41ce-b36c-cb904f92c534)) not found: sled file = nexus/db-queries/src/db/datastore/rack.rs:816 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 46fa4837-d8a5-4db6-a8d3-9e6c865c6eeb uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
8512024-12-14T03:35:00.553ZINFOnexus (dropshot_internal): request completed error_message_external = not found: sled with id "8d70e61c-94ed-41ce-b36c-cb904f92c534" error_message_internal = not found: sled with id "8d70e61c-94ed-41ce-b36c-cb904f92c534" file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 585828 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 46fa4837-d8a5-4db6-a8d3-9e6c865c6eeb response_code = 404 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
8522024-12-14T03:35:01.076ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
8532024-12-14T03:35:01.077ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
8542024-12-14T03:35:01.078ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
8552024-12-14T03:35:01.078ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
8562024-12-14T03:35:01.080ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8572024-12-14T03:35:01.082ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: a121ca05-bbee-41bf-b9db-9e03ff035200, lookup_type: ById(a121ca05-bbee-41bf-b9db-9e03ff035200) } result = Ok(())
8582024-12-14T03:35:01.082ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: a121ca05-bbee-41bf-b9db-9e03ff035200, time_created: 2024-12-14T03:34:57.145875Z, time_modified: 2024-12-14T03:34:57.145875Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
8592024-12-14T03:35:01.527ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 00c6d885-7333-4437-ae29-670e04d474af roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
8602024-12-14T03:35:01.528ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 00c6d885-7333-4437-ae29-670e04d474af resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
8612024-12-14T03:35:01.529ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 00c6d885-7333-4437-ae29-670e04d474af roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
8622024-12-14T03:35:01.530ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 00c6d885-7333-4437-ae29-670e04d474af resource = Fleet result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
8632024-12-14T03:35:01.530ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 00c6d885-7333-4437-ae29-670e04d474af roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
8642024-12-14T03:35:01.531ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 00c6d885-7333-4437-ae29-670e04d474af resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
8652024-12-14T03:35:01.568ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 00c6d885-7333-4437-ae29-670e04d474af roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
8662024-12-14T03:35:01.568ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 00c6d885-7333-4437-ae29-670e04d474af resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
8672024-12-14T03:35:01.570ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 00c6d885-7333-4437-ae29-670e04d474af roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
8682024-12-14T03:35:01.570ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 00c6d885-7333-4437-ae29-670e04d474af resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
8692024-12-14T03:35:01.571ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 00c6d885-7333-4437-ae29-670e04d474af roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
8702024-12-14T03:35:01.574ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 00c6d885-7333-4437-ae29-670e04d474af resource = Rack { parent: Fleet, key: a121ca05-bbee-41bf-b9db-9e03ff035200, lookup_type: ById(a121ca05-bbee-41bf-b9db-9e03ff035200) } result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
8712024-12-14T03:35:01.574ZDEBGnexus (dropshot_internal): updating rack subnet for rack a121ca05-bbee-41bf-b9db-9e03ff035200 to Some( V6( Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56, }, ), ) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 00c6d885-7333-4437-ae29-670e04d474af uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
8722024-12-14T03:35:01.574ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 00c6d885-7333-4437-ae29-670e04d474af roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
8732024-12-14T03:35:01.574ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 00c6d885-7333-4437-ae29-670e04d474af resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
8742024-12-14T03:35:01.581ZINFOnexus (dropshot_internal): Using automatic external switchport discovery actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:324 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 00c6d885-7333-4437-ae29-670e04d474af uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
8752024-12-14T03:35:01.613ZDEBGnexus (DpdClient): client request actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true body = None local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 00c6d885-7333-4437-ae29-670e04d474af uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
8762024-12-14T03:35:01.613ZDEBGnexus (DpdClient): client response actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 00c6d885-7333-4437-ae29-670e04d474af result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/ports", status: 200, headers: {"content-type": "application/json", "x-request-id": "56d3b8e1-4ec9-4650-801a-f5097c200dcf", "content-length": "24", "date": "Sat, 14 Dec 2024 03:35:01 GMT"} }) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
8772024-12-14T03:35:01.613ZINFOnexus (dropshot_internal): discovered ports for switch0: [ Internal( Internal( "int0", ), ), Rear( Rear( "rear0", ), ), Qsfp( Qsfp( "qsfp0", ), ), ] actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:344 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 00c6d885-7333-4437-ae29-670e04d474af uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
8782024-12-14T03:35:01.613ZINFOnexus (dropshot_internal): populating ports for switch0: [ Name( "qsfp0", ), ] actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:354 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 00c6d885-7333-4437-ae29-670e04d474af uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
8792024-12-14T03:35:01.613ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 00c6d885-7333-4437-ae29-670e04d474af roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
8802024-12-14T03:35:01.613ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 00c6d885-7333-4437-ae29-670e04d474af resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
8812024-12-14T03:35:01.622ZINFOnexus (dropshot_internal): Recording Rack Network Configuration actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:389 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 00c6d885-7333-4437-ae29-670e04d474af uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
8822024-12-14T03:35:01.622ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 00c6d885-7333-4437-ae29-670e04d474af roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
8832024-12-14T03:35:01.622ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 00c6d885-7333-4437-ae29-670e04d474af resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
8842024-12-14T03:35:01.640ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 00c6d885-7333-4437-ae29-670e04d474af roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
8852024-12-14T03:35:01.641ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 00c6d885-7333-4437-ae29-670e04d474af resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
8862024-12-14T03:35:01.644ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 00c6d885-7333-4437-ae29-670e04d474af roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
8872024-12-14T03:35:01.644ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 00c6d885-7333-4437-ae29-670e04d474af resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
8882024-12-14T03:35:01.655ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 00c6d885-7333-4437-ae29-670e04d474af roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
8892024-12-14T03:35:01.656ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 00c6d885-7333-4437-ae29-670e04d474af resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
8902024-12-14T03:35:01.658ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 00c6d885-7333-4437-ae29-670e04d474af roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
8912024-12-14T03:35:01.658ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 00c6d885-7333-4437-ae29-670e04d474af resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
8922024-12-14T03:35:01.661ZDEBGnexus (dropshot_internal): failed to check if bgp peer exists in switch port settings actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true error = NotFound local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 00c6d885-7333-4437-ae29-670e04d474af uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
8932024-12-14T03:35:01.662ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 00c6d885-7333-4437-ae29-670e04d474af roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
8942024-12-14T03:35:01.663ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 00c6d885-7333-4437-ae29-670e04d474af resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
8952024-12-14T03:35:01.664ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 00c6d885-7333-4437-ae29-670e04d474af roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
8962024-12-14T03:35:01.666ZDEBGnexus (dropshot_internal): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 00c6d885-7333-4437-ae29-670e04d474af resource = Fleet result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
8972024-12-14T03:35:01.666ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 00c6d885-7333-4437-ae29-670e04d474af roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
8982024-12-14T03:35:01.666ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 00c6d885-7333-4437-ae29-670e04d474af resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
8992024-12-14T03:35:01.668ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 00c6d885-7333-4437-ae29-670e04d474af roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
9002024-12-14T03:35:01.668ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 00c6d885-7333-4437-ae29-670e04d474af resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
9012024-12-14T03:35:01.670ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 00c6d885-7333-4437-ae29-670e04d474af roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
9022024-12-14T03:35:01.673ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 00c6d885-7333-4437-ae29-670e04d474af resource = IpPool { parent: Fleet, key: bdf4635b-d53e-4acb-8b1c-1769f4520d05, lookup_type: ByName("oxide-service-pool") } result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
9032024-12-14T03:35:01.673ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 00c6d885-7333-4437-ae29-670e04d474af roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
9042024-12-14T03:35:01.673ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 00c6d885-7333-4437-ae29-670e04d474af resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
9052024-12-14T03:35:01.674ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 00c6d885-7333-4437-ae29-670e04d474af roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
9062024-12-14T03:35:01.674ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 00c6d885-7333-4437-ae29-670e04d474af resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
9072024-12-14T03:35:01.676ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 00c6d885-7333-4437-ae29-670e04d474af roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
9082024-12-14T03:35:01.677ZDEBGnexus (dropshot_internal): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 00c6d885-7333-4437-ae29-670e04d474af resource = IpPool { parent: Fleet, key: bdf4635b-d53e-4acb-8b1c-1769f4520d05, lookup_type: ByName("oxide-service-pool") } result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
9092024-12-14T03:35:01.705ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 00c6d885-7333-4437-ae29-670e04d474af roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
9102024-12-14T03:35:01.706ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 00c6d885-7333-4437-ae29-670e04d474af resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
9112024-12-14T03:35:01.707ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 00c6d885-7333-4437-ae29-670e04d474af roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
9122024-12-14T03:35:01.709ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 00c6d885-7333-4437-ae29-670e04d474af resource = BlueprintConfig result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
9132024-12-14T03:35:01.876ZINFOnexus (dropshot_internal): inserted blueprint actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true blueprint_id = eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1 file = nexus/db-queries/src/db/datastore/deployment.rs:456 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 00c6d885-7333-4437-ae29-670e04d474af uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
9142024-12-14T03:35:01.876ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 00c6d885-7333-4437-ae29-670e04d474af roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
9152024-12-14T03:35:01.876ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 00c6d885-7333-4437-ae29-670e04d474af resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
9162024-12-14T03:35:01.878ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 00c6d885-7333-4437-ae29-670e04d474af roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
9172024-12-14T03:35:01.879ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 00c6d885-7333-4437-ae29-670e04d474af resource = BlueprintConfig result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
9182024-12-14T03:35:01.891ZINFOnexus (dropshot_internal): No networking records needed for internal_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 00c6d885-7333-4437-ae29-670e04d474af uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
9192024-12-14T03:35:01.891ZINFOnexus (dropshot_internal): No networking records needed for internal_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 00c6d885-7333-4437-ae29-670e04d474af uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
9202024-12-14T03:35:01.891ZINFOnexus (dropshot_internal): No networking records needed for internal_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 00c6d885-7333-4437-ae29-670e04d474af uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
9212024-12-14T03:35:01.891ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 00c6d885-7333-4437-ae29-670e04d474af uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
9222024-12-14T03:35:01.891ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 00c6d885-7333-4437-ae29-670e04d474af uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
9232024-12-14T03:35:01.891ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 00c6d885-7333-4437-ae29-670e04d474af uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
9242024-12-14T03:35:01.891ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 00c6d885-7333-4437-ae29-670e04d474af uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
9252024-12-14T03:35:01.891ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 00c6d885-7333-4437-ae29-670e04d474af uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
9262024-12-14T03:35:01.975ZINFOnexus (dropshot_internal): Inserted networking records for external_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 00c6d885-7333-4437-ae29-670e04d474af uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
9272024-12-14T03:35:02.003ZINFOnexus (dropshot_internal): Inserted networking records for external_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 00c6d885-7333-4437-ae29-670e04d474af uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
9282024-12-14T03:35:02.025ZINFOnexus (dropshot_internal): Inserted networking records for nexus service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 00c6d885-7333-4437-ae29-670e04d474af uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
9292024-12-14T03:35:02.049ZINFOnexus (dropshot_internal): Inserted networking records for nexus service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 00c6d885-7333-4437-ae29-670e04d474af uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
9302024-12-14T03:35:02.071ZINFOnexus (dropshot_internal): Inserted networking records for nexus service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 00c6d885-7333-4437-ae29-670e04d474af uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
9312024-12-14T03:35:02.071ZINFOnexus (dropshot_internal): No networking records needed for oximeter service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 00c6d885-7333-4437-ae29-670e04d474af uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
9322024-12-14T03:35:02.071ZINFOnexus (dropshot_internal): No networking records needed for clickhouse service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 00c6d885-7333-4437-ae29-670e04d474af uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
9332024-12-14T03:35:02.071ZINFOnexus (dropshot_internal): No networking records needed for crucible_pantry service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 00c6d885-7333-4437-ae29-670e04d474af uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
9342024-12-14T03:35:02.071ZINFOnexus (dropshot_internal): No networking records needed for crucible_pantry service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 00c6d885-7333-4437-ae29-670e04d474af uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
9352024-12-14T03:35:02.071ZINFOnexus (dropshot_internal): No networking records needed for crucible_pantry service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 00c6d885-7333-4437-ae29-670e04d474af uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
9362024-12-14T03:35:02.071ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 00c6d885-7333-4437-ae29-670e04d474af uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
9372024-12-14T03:35:02.071ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 00c6d885-7333-4437-ae29-670e04d474af uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
9382024-12-14T03:35:02.071ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 00c6d885-7333-4437-ae29-670e04d474af uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
9392024-12-14T03:35:02.071ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 00c6d885-7333-4437-ae29-670e04d474af uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
9402024-12-14T03:35:02.071ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 00c6d885-7333-4437-ae29-670e04d474af uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
9412024-12-14T03:35:02.071ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 00c6d885-7333-4437-ae29-670e04d474af uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
9422024-12-14T03:35:02.071ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 00c6d885-7333-4437-ae29-670e04d474af uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
9432024-12-14T03:35:02.071ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 00c6d885-7333-4437-ae29-670e04d474af uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
9442024-12-14T03:35:02.071ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 00c6d885-7333-4437-ae29-670e04d474af uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
9452024-12-14T03:35:02.102ZINFOnexus (dropshot_internal): Inserted networking records for boundary_ntp service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 00c6d885-7333-4437-ae29-670e04d474af uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
9462024-12-14T03:35:02.102ZINFOnexus (dropshot_internal): Inserted service networking records actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:809 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 00c6d885-7333-4437-ae29-670e04d474af uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
9472024-12-14T03:35:02.102ZINFOnexus (dropshot_internal): physical disk upsert in handoff: PhysicalDisk { identity: PhysicalDiskIdentity { id: b81997dc-4390-4d6b-b937-ec142d15ce9e (physical_disk), time_created: 2024-12-14T03:35:01.530823570Z, time_modified: 2024-12-14T03:35:01.530823570Z, }, time_deleted: None, rcgen: Generation( Generation( 1, ), ), vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-U2", variant: U2, sled_id: 8d70e61c-94ed-41ce-b36c-cb904f92c534, disk_policy: InService, disk_state: Active, } actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:812 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 00c6d885-7333-4437-ae29-670e04d474af uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
9482024-12-14T03:35:02.102ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 00c6d885-7333-4437-ae29-670e04d474af roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
9492024-12-14T03:35:02.102ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 00c6d885-7333-4437-ae29-670e04d474af resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
9502024-12-14T03:35:02.104ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 00c6d885-7333-4437-ae29-670e04d474af roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
9512024-12-14T03:35:02.106ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 00c6d885-7333-4437-ae29-670e04d474af resource = Fleet result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
9522024-12-14T03:35:02.121ZERROnexus (dropshot_internal): Failed to upsert physical disk actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true err = Custom transaction error: Object (of type ById(8d70e61c-94ed-41ce-b36c-cb904f92c534)) not found: sled file = nexus/db-queries/src/db/datastore/rack.rs:816 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 00c6d885-7333-4437-ae29-670e04d474af uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
9532024-12-14T03:35:02.126ZINFOnexus (dropshot_internal): request completed error_message_external = not found: sled with id "8d70e61c-94ed-41ce-b36c-cb904f92c534" error_message_internal = not found: sled with id "8d70e61c-94ed-41ce-b36c-cb904f92c534" file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 599641 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 00c6d885-7333-4437-ae29-670e04d474af response_code = 404 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
9542024-12-14T03:35:03.084ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
9552024-12-14T03:35:03.084ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
9562024-12-14T03:35:03.086ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
9572024-12-14T03:35:03.086ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
9582024-12-14T03:35:03.087ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9592024-12-14T03:35:03.090ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: a121ca05-bbee-41bf-b9db-9e03ff035200, lookup_type: ById(a121ca05-bbee-41bf-b9db-9e03ff035200) } result = Ok(())
9602024-12-14T03:35:03.090ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: a121ca05-bbee-41bf-b9db-9e03ff035200, time_created: 2024-12-14T03:34:57.145875Z, time_modified: 2024-12-14T03:34:57.145875Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
9612024-12-14T03:35:04.049ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 65d2c580-6aac-47db-a2ca-c97db997201b roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
9622024-12-14T03:35:04.050ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 65d2c580-6aac-47db-a2ca-c97db997201b resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
9632024-12-14T03:35:04.052ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 65d2c580-6aac-47db-a2ca-c97db997201b roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
9642024-12-14T03:35:04.053ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 65d2c580-6aac-47db-a2ca-c97db997201b resource = Fleet result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
9652024-12-14T03:35:04.053ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 65d2c580-6aac-47db-a2ca-c97db997201b roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
9662024-12-14T03:35:04.053ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 65d2c580-6aac-47db-a2ca-c97db997201b resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
9672024-12-14T03:35:04.056ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 65d2c580-6aac-47db-a2ca-c97db997201b roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
9682024-12-14T03:35:04.056ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 65d2c580-6aac-47db-a2ca-c97db997201b resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
9692024-12-14T03:35:04.058ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 65d2c580-6aac-47db-a2ca-c97db997201b roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
9702024-12-14T03:35:04.058ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 65d2c580-6aac-47db-a2ca-c97db997201b resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
9712024-12-14T03:35:04.060ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 65d2c580-6aac-47db-a2ca-c97db997201b roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
9722024-12-14T03:35:04.062ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 65d2c580-6aac-47db-a2ca-c97db997201b resource = Rack { parent: Fleet, key: a121ca05-bbee-41bf-b9db-9e03ff035200, lookup_type: ById(a121ca05-bbee-41bf-b9db-9e03ff035200) } result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
9732024-12-14T03:35:04.062ZDEBGnexus (dropshot_internal): updating rack subnet for rack a121ca05-bbee-41bf-b9db-9e03ff035200 to Some( V6( Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56, }, ), ) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 65d2c580-6aac-47db-a2ca-c97db997201b uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
9742024-12-14T03:35:04.062ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 65d2c580-6aac-47db-a2ca-c97db997201b roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
9752024-12-14T03:35:04.062ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 65d2c580-6aac-47db-a2ca-c97db997201b resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
9762024-12-14T03:35:04.067ZINFOnexus (dropshot_internal): Using automatic external switchport discovery actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:324 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 65d2c580-6aac-47db-a2ca-c97db997201b uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
9772024-12-14T03:35:04.097ZDEBGnexus (DpdClient): client request actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true body = None local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 65d2c580-6aac-47db-a2ca-c97db997201b uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
9782024-12-14T03:35:04.097ZDEBGnexus (DpdClient): client response actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 65d2c580-6aac-47db-a2ca-c97db997201b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/ports", status: 200, headers: {"content-type": "application/json", "x-request-id": "419f19c7-299e-43ef-bbd2-8ba16e04da56", "content-length": "24", "date": "Sat, 14 Dec 2024 03:35:03 GMT"} }) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
9792024-12-14T03:35:04.097ZINFOnexus (dropshot_internal): discovered ports for switch0: [ Internal( Internal( "int0", ), ), Rear( Rear( "rear0", ), ), Qsfp( Qsfp( "qsfp0", ), ), ] actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:344 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 65d2c580-6aac-47db-a2ca-c97db997201b uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
9802024-12-14T03:35:04.097ZINFOnexus (dropshot_internal): populating ports for switch0: [ Name( "qsfp0", ), ] actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:354 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 65d2c580-6aac-47db-a2ca-c97db997201b uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
9812024-12-14T03:35:04.097ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 65d2c580-6aac-47db-a2ca-c97db997201b roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
9822024-12-14T03:35:04.098ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 65d2c580-6aac-47db-a2ca-c97db997201b resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
9832024-12-14T03:35:04.120ZINFOnexus (dropshot_internal): Recording Rack Network Configuration actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:389 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 65d2c580-6aac-47db-a2ca-c97db997201b uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
9842024-12-14T03:35:04.120ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 65d2c580-6aac-47db-a2ca-c97db997201b roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
9852024-12-14T03:35:04.121ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 65d2c580-6aac-47db-a2ca-c97db997201b resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
9862024-12-14T03:35:04.137ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 65d2c580-6aac-47db-a2ca-c97db997201b roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
9872024-12-14T03:35:04.137ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 65d2c580-6aac-47db-a2ca-c97db997201b resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
9882024-12-14T03:35:04.145ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 65d2c580-6aac-47db-a2ca-c97db997201b roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
9892024-12-14T03:35:04.146ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 65d2c580-6aac-47db-a2ca-c97db997201b resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
9902024-12-14T03:35:04.155ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 65d2c580-6aac-47db-a2ca-c97db997201b roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
9912024-12-14T03:35:04.156ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 65d2c580-6aac-47db-a2ca-c97db997201b resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
9922024-12-14T03:35:04.157ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 65d2c580-6aac-47db-a2ca-c97db997201b roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
9932024-12-14T03:35:04.157ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 65d2c580-6aac-47db-a2ca-c97db997201b resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
9942024-12-14T03:35:04.173ZDEBGnexus (dropshot_internal): failed to check if bgp peer exists in switch port settings actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true error = NotFound local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 65d2c580-6aac-47db-a2ca-c97db997201b uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
9952024-12-14T03:35:04.174ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 65d2c580-6aac-47db-a2ca-c97db997201b roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
9962024-12-14T03:35:04.175ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 65d2c580-6aac-47db-a2ca-c97db997201b resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
9972024-12-14T03:35:04.176ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 65d2c580-6aac-47db-a2ca-c97db997201b roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
9982024-12-14T03:35:04.178ZDEBGnexus (dropshot_internal): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 65d2c580-6aac-47db-a2ca-c97db997201b resource = Fleet result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
9992024-12-14T03:35:04.178ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 65d2c580-6aac-47db-a2ca-c97db997201b roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
10002024-12-14T03:35:04.178ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 65d2c580-6aac-47db-a2ca-c97db997201b resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
10012024-12-14T03:35:04.180ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 65d2c580-6aac-47db-a2ca-c97db997201b roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
10022024-12-14T03:35:04.180ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 65d2c580-6aac-47db-a2ca-c97db997201b resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
10032024-12-14T03:35:04.181ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 65d2c580-6aac-47db-a2ca-c97db997201b roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
10042024-12-14T03:35:04.184ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 65d2c580-6aac-47db-a2ca-c97db997201b resource = IpPool { parent: Fleet, key: bdf4635b-d53e-4acb-8b1c-1769f4520d05, lookup_type: ByName("oxide-service-pool") } result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
10052024-12-14T03:35:04.184ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 65d2c580-6aac-47db-a2ca-c97db997201b roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
10062024-12-14T03:35:04.184ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 65d2c580-6aac-47db-a2ca-c97db997201b resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
10072024-12-14T03:35:04.185ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 65d2c580-6aac-47db-a2ca-c97db997201b roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
10082024-12-14T03:35:04.185ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 65d2c580-6aac-47db-a2ca-c97db997201b resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
10092024-12-14T03:35:04.187ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 65d2c580-6aac-47db-a2ca-c97db997201b roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
10102024-12-14T03:35:04.188ZDEBGnexus (dropshot_internal): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 65d2c580-6aac-47db-a2ca-c97db997201b resource = IpPool { parent: Fleet, key: bdf4635b-d53e-4acb-8b1c-1769f4520d05, lookup_type: ByName("oxide-service-pool") } result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
10112024-12-14T03:35:04.195ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 65d2c580-6aac-47db-a2ca-c97db997201b roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
10122024-12-14T03:35:04.195ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 65d2c580-6aac-47db-a2ca-c97db997201b resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
10132024-12-14T03:35:04.197ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 65d2c580-6aac-47db-a2ca-c97db997201b roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
10142024-12-14T03:35:04.199ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 65d2c580-6aac-47db-a2ca-c97db997201b resource = BlueprintConfig result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
10152024-12-14T03:35:04.290ZINFOnexus (dropshot_internal): inserted blueprint actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true blueprint_id = eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1 file = nexus/db-queries/src/db/datastore/deployment.rs:456 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 65d2c580-6aac-47db-a2ca-c97db997201b uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
10162024-12-14T03:35:04.290ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 65d2c580-6aac-47db-a2ca-c97db997201b roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
10172024-12-14T03:35:04.291ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 65d2c580-6aac-47db-a2ca-c97db997201b resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
10182024-12-14T03:35:04.292ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 65d2c580-6aac-47db-a2ca-c97db997201b roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
10192024-12-14T03:35:04.294ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 65d2c580-6aac-47db-a2ca-c97db997201b resource = BlueprintConfig result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
10202024-12-14T03:35:04.297ZINFOnexus (dropshot_internal): No networking records needed for internal_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 65d2c580-6aac-47db-a2ca-c97db997201b uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
10212024-12-14T03:35:04.297ZINFOnexus (dropshot_internal): No networking records needed for internal_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 65d2c580-6aac-47db-a2ca-c97db997201b uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
10222024-12-14T03:35:04.297ZINFOnexus (dropshot_internal): No networking records needed for internal_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 65d2c580-6aac-47db-a2ca-c97db997201b uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
10232024-12-14T03:35:04.297ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 65d2c580-6aac-47db-a2ca-c97db997201b uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
10242024-12-14T03:35:04.297ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 65d2c580-6aac-47db-a2ca-c97db997201b uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
10252024-12-14T03:35:04.298ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 65d2c580-6aac-47db-a2ca-c97db997201b uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
10262024-12-14T03:35:04.298ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 65d2c580-6aac-47db-a2ca-c97db997201b uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
10272024-12-14T03:35:04.298ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 65d2c580-6aac-47db-a2ca-c97db997201b uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
10282024-12-14T03:35:04.376ZINFOnexus (dropshot_internal): Inserted networking records for external_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 65d2c580-6aac-47db-a2ca-c97db997201b uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
10292024-12-14T03:35:04.392ZINFOnexus (dropshot_internal): Inserted networking records for external_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 65d2c580-6aac-47db-a2ca-c97db997201b uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
10302024-12-14T03:35:04.407ZINFOnexus (dropshot_internal): Inserted networking records for nexus service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 65d2c580-6aac-47db-a2ca-c97db997201b uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
10312024-12-14T03:35:04.423ZINFOnexus (dropshot_internal): Inserted networking records for nexus service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 65d2c580-6aac-47db-a2ca-c97db997201b uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
10322024-12-14T03:35:04.444ZINFOnexus (dropshot_internal): Inserted networking records for nexus service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 65d2c580-6aac-47db-a2ca-c97db997201b uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
10332024-12-14T03:35:04.444ZINFOnexus (dropshot_internal): No networking records needed for oximeter service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 65d2c580-6aac-47db-a2ca-c97db997201b uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
10342024-12-14T03:35:04.444ZINFOnexus (dropshot_internal): No networking records needed for clickhouse service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 65d2c580-6aac-47db-a2ca-c97db997201b uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
10352024-12-14T03:35:04.444ZINFOnexus (dropshot_internal): No networking records needed for crucible_pantry service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 65d2c580-6aac-47db-a2ca-c97db997201b uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
10362024-12-14T03:35:04.444ZINFOnexus (dropshot_internal): No networking records needed for crucible_pantry service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 65d2c580-6aac-47db-a2ca-c97db997201b uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
10372024-12-14T03:35:04.444ZINFOnexus (dropshot_internal): No networking records needed for crucible_pantry service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 65d2c580-6aac-47db-a2ca-c97db997201b uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
10382024-12-14T03:35:04.444ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 65d2c580-6aac-47db-a2ca-c97db997201b uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
10392024-12-14T03:35:04.444ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 65d2c580-6aac-47db-a2ca-c97db997201b uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
10402024-12-14T03:35:04.444ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 65d2c580-6aac-47db-a2ca-c97db997201b uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
10412024-12-14T03:35:04.444ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 65d2c580-6aac-47db-a2ca-c97db997201b uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
10422024-12-14T03:35:04.444ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 65d2c580-6aac-47db-a2ca-c97db997201b uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
10432024-12-14T03:35:04.444ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 65d2c580-6aac-47db-a2ca-c97db997201b uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
10442024-12-14T03:35:04.444ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 65d2c580-6aac-47db-a2ca-c97db997201b uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
10452024-12-14T03:35:04.444ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 65d2c580-6aac-47db-a2ca-c97db997201b uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
10462024-12-14T03:35:04.444ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 65d2c580-6aac-47db-a2ca-c97db997201b uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
10472024-12-14T03:35:04.467ZINFOnexus (dropshot_internal): Inserted networking records for boundary_ntp service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 65d2c580-6aac-47db-a2ca-c97db997201b uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
10482024-12-14T03:35:04.467ZINFOnexus (dropshot_internal): Inserted service networking records actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:809 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 65d2c580-6aac-47db-a2ca-c97db997201b uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
10492024-12-14T03:35:04.467ZINFOnexus (dropshot_internal): physical disk upsert in handoff: PhysicalDisk { identity: PhysicalDiskIdentity { id: b81997dc-4390-4d6b-b937-ec142d15ce9e (physical_disk), time_created: 2024-12-14T03:35:04.053335016Z, time_modified: 2024-12-14T03:35:04.053335016Z, }, time_deleted: None, rcgen: Generation( Generation( 1, ), ), vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-U2", variant: U2, sled_id: 8d70e61c-94ed-41ce-b36c-cb904f92c534, disk_policy: InService, disk_state: Active, } actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:812 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 65d2c580-6aac-47db-a2ca-c97db997201b uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
10502024-12-14T03:35:04.467ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 65d2c580-6aac-47db-a2ca-c97db997201b roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
10512024-12-14T03:35:04.467ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 65d2c580-6aac-47db-a2ca-c97db997201b resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
10522024-12-14T03:35:04.469ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 65d2c580-6aac-47db-a2ca-c97db997201b roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
10532024-12-14T03:35:04.471ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 65d2c580-6aac-47db-a2ca-c97db997201b resource = Fleet result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
10542024-12-14T03:35:04.492ZERROnexus (dropshot_internal): Failed to upsert physical disk actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true err = Custom transaction error: Object (of type ById(8d70e61c-94ed-41ce-b36c-cb904f92c534)) not found: sled file = nexus/db-queries/src/db/datastore/rack.rs:816 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 65d2c580-6aac-47db-a2ca-c97db997201b uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
10552024-12-14T03:35:04.499ZINFOnexus (dropshot_internal): request completed error_message_external = not found: sled with id "8d70e61c-94ed-41ce-b36c-cb904f92c534" error_message_internal = not found: sled with id "8d70e61c-94ed-41ce-b36c-cb904f92c534" file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 450149 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 65d2c580-6aac-47db-a2ca-c97db997201b response_code = 404 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
10562024-12-14T03:35:05.091ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
10572024-12-14T03:35:05.091ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
10582024-12-14T03:35:05.092ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
10592024-12-14T03:35:05.092ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
10602024-12-14T03:35:05.094ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10612024-12-14T03:35:05.096ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: a121ca05-bbee-41bf-b9db-9e03ff035200, lookup_type: ById(a121ca05-bbee-41bf-b9db-9e03ff035200) } result = Ok(())
10622024-12-14T03:35:05.096ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: a121ca05-bbee-41bf-b9db-9e03ff035200, time_created: 2024-12-14T03:34:57.145875Z, time_modified: 2024-12-14T03:34:57.145875Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
10632024-12-14T03:35:06.011ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = f2dc57d7-467e-483d-a644-e778adc6b204 roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
10642024-12-14T03:35:06.011ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = f2dc57d7-467e-483d-a644-e778adc6b204 resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
10652024-12-14T03:35:06.013ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = f2dc57d7-467e-483d-a644-e778adc6b204 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
10662024-12-14T03:35:06.014ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = f2dc57d7-467e-483d-a644-e778adc6b204 resource = Fleet result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
10672024-12-14T03:35:06.014ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = f2dc57d7-467e-483d-a644-e778adc6b204 roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
10682024-12-14T03:35:06.015ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = f2dc57d7-467e-483d-a644-e778adc6b204 resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
10692024-12-14T03:35:06.057ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = f2dc57d7-467e-483d-a644-e778adc6b204 roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
10702024-12-14T03:35:06.057ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = f2dc57d7-467e-483d-a644-e778adc6b204 resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
10712024-12-14T03:35:06.059ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = f2dc57d7-467e-483d-a644-e778adc6b204 roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
10722024-12-14T03:35:06.059ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = f2dc57d7-467e-483d-a644-e778adc6b204 resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
10732024-12-14T03:35:06.060ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = f2dc57d7-467e-483d-a644-e778adc6b204 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
10742024-12-14T03:35:06.063ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = f2dc57d7-467e-483d-a644-e778adc6b204 resource = Rack { parent: Fleet, key: a121ca05-bbee-41bf-b9db-9e03ff035200, lookup_type: ById(a121ca05-bbee-41bf-b9db-9e03ff035200) } result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
10752024-12-14T03:35:06.063ZDEBGnexus (dropshot_internal): updating rack subnet for rack a121ca05-bbee-41bf-b9db-9e03ff035200 to Some( V6( Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56, }, ), ) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = f2dc57d7-467e-483d-a644-e778adc6b204 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
10762024-12-14T03:35:06.063ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = f2dc57d7-467e-483d-a644-e778adc6b204 roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
10772024-12-14T03:35:06.063ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = f2dc57d7-467e-483d-a644-e778adc6b204 resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
10782024-12-14T03:35:06.068ZINFOnexus (dropshot_internal): Using automatic external switchport discovery actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:324 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = f2dc57d7-467e-483d-a644-e778adc6b204 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
10792024-12-14T03:35:06.099ZDEBGnexus (DpdClient): client request actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true body = None local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = f2dc57d7-467e-483d-a644-e778adc6b204 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
10802024-12-14T03:35:06.099ZDEBGnexus (DpdClient): client response actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = f2dc57d7-467e-483d-a644-e778adc6b204 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/ports", status: 200, headers: {"content-type": "application/json", "x-request-id": "f295a5f8-ef7f-4d93-a1a9-a5727e7cb1da", "content-length": "24", "date": "Sat, 14 Dec 2024 03:35:05 GMT"} }) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
10812024-12-14T03:35:06.099ZINFOnexus (dropshot_internal): discovered ports for switch0: [ Internal( Internal( "int0", ), ), Rear( Rear( "rear0", ), ), Qsfp( Qsfp( "qsfp0", ), ), ] actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:344 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = f2dc57d7-467e-483d-a644-e778adc6b204 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
10822024-12-14T03:35:06.099ZINFOnexus (dropshot_internal): populating ports for switch0: [ Name( "qsfp0", ), ] actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:354 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = f2dc57d7-467e-483d-a644-e778adc6b204 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
10832024-12-14T03:35:06.099ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = f2dc57d7-467e-483d-a644-e778adc6b204 roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
10842024-12-14T03:35:06.099ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = f2dc57d7-467e-483d-a644-e778adc6b204 resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
10852024-12-14T03:35:06.172ZINFOnexus (dropshot_internal): Recording Rack Network Configuration actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:389 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = f2dc57d7-467e-483d-a644-e778adc6b204 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
10862024-12-14T03:35:06.172ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = f2dc57d7-467e-483d-a644-e778adc6b204 roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
10872024-12-14T03:35:06.172ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = f2dc57d7-467e-483d-a644-e778adc6b204 resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
10882024-12-14T03:35:06.311ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = f2dc57d7-467e-483d-a644-e778adc6b204 roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
10892024-12-14T03:35:06.312ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = f2dc57d7-467e-483d-a644-e778adc6b204 resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
10902024-12-14T03:35:06.315ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = f2dc57d7-467e-483d-a644-e778adc6b204 roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
10912024-12-14T03:35:06.315ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = f2dc57d7-467e-483d-a644-e778adc6b204 resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
10922024-12-14T03:35:06.317ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = f2dc57d7-467e-483d-a644-e778adc6b204 roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
10932024-12-14T03:35:06.317ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = f2dc57d7-467e-483d-a644-e778adc6b204 resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
10942024-12-14T03:35:06.319ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = f2dc57d7-467e-483d-a644-e778adc6b204 roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
10952024-12-14T03:35:06.320ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = f2dc57d7-467e-483d-a644-e778adc6b204 resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
10962024-12-14T03:35:06.335ZDEBGnexus (dropshot_internal): failed to check if bgp peer exists in switch port settings actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true error = NotFound local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = f2dc57d7-467e-483d-a644-e778adc6b204 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
10972024-12-14T03:35:06.337ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = f2dc57d7-467e-483d-a644-e778adc6b204 roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
10982024-12-14T03:35:06.337ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = f2dc57d7-467e-483d-a644-e778adc6b204 resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
10992024-12-14T03:35:06.338ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = f2dc57d7-467e-483d-a644-e778adc6b204 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
11002024-12-14T03:35:06.340ZDEBGnexus (dropshot_internal): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = f2dc57d7-467e-483d-a644-e778adc6b204 resource = Fleet result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
11012024-12-14T03:35:06.340ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = f2dc57d7-467e-483d-a644-e778adc6b204 roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
11022024-12-14T03:35:06.340ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = f2dc57d7-467e-483d-a644-e778adc6b204 resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
11032024-12-14T03:35:06.342ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = f2dc57d7-467e-483d-a644-e778adc6b204 roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
11042024-12-14T03:35:06.343ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = f2dc57d7-467e-483d-a644-e778adc6b204 resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
11052024-12-14T03:35:06.344ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 2 reason = Timeout
11062024-12-14T03:35:06.344ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
11072024-12-14T03:35:06.344ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 2 reason = Timeout
11082024-12-14T03:35:06.344ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
11092024-12-14T03:35:06.344ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = f2dc57d7-467e-483d-a644-e778adc6b204 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
11102024-12-14T03:35:06.344ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
11112024-12-14T03:35:06.344ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11122024-12-14T03:35:06.345ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11132024-12-14T03:35:06.346ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = f2dc57d7-467e-483d-a644-e778adc6b204 resource = IpPool { parent: Fleet, key: bdf4635b-d53e-4acb-8b1c-1769f4520d05, lookup_type: ByName("oxide-service-pool") } result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
11142024-12-14T03:35:06.346ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = f2dc57d7-467e-483d-a644-e778adc6b204 roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
11152024-12-14T03:35:06.347ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = f2dc57d7-467e-483d-a644-e778adc6b204 resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
11162024-12-14T03:35:06.348ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = f2dc57d7-467e-483d-a644-e778adc6b204 roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
11172024-12-14T03:35:06.348ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
11182024-12-14T03:35:06.348ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
11192024-12-14T03:35:06.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11202024-12-14T03:35:06.348ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = f2dc57d7-467e-483d-a644-e778adc6b204 resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
11212024-12-14T03:35:06.350ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = f2dc57d7-467e-483d-a644-e778adc6b204 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
11222024-12-14T03:35:06.350ZWARNnexus (BackgroundTasks): failed to read target blueprint background_task = blueprint_loader error = Internal Error: no target blueprint set file = nexus/src/app/background/tasks/blueprint_load.rs:69
11232024-12-14T03:35:06.350ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 6.293136ms iteration = 2 status = {"error":"failed to read target blueprint: Internal Error: no target blueprint set"}
11242024-12-14T03:35:06.351ZDEBGnexus (dropshot_internal): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = f2dc57d7-467e-483d-a644-e778adc6b204 resource = IpPool { parent: Fleet, key: bdf4635b-d53e-4acb-8b1c-1769f4520d05, lookup_type: ByName("oxide-service-pool") } result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
11252024-12-14T03:35:06.358ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = f2dc57d7-467e-483d-a644-e778adc6b204 roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
11262024-12-14T03:35:06.359ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = f2dc57d7-467e-483d-a644-e778adc6b204 resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
11272024-12-14T03:35:06.372ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
11282024-12-14T03:35:06.372ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
11292024-12-14T03:35:06.384ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = f2dc57d7-467e-483d-a644-e778adc6b204 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
11302024-12-14T03:35:06.386ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = f2dc57d7-467e-483d-a644-e778adc6b204 resource = BlueprintConfig result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
11312024-12-14T03:35:06.402ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 57.824669ms iteration = 2 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
11322024-12-14T03:35:06.402ZINFOnexus (dropshot_internal): inserted blueprint actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true blueprint_id = eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1 file = nexus/db-queries/src/db/datastore/deployment.rs:456 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = f2dc57d7-467e-483d-a644-e778adc6b204 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
11332024-12-14T03:35:06.402ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = f2dc57d7-467e-483d-a644-e778adc6b204 roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
11342024-12-14T03:35:06.403ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = f2dc57d7-467e-483d-a644-e778adc6b204 resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
11352024-12-14T03:35:06.404ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = f2dc57d7-467e-483d-a644-e778adc6b204 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
11362024-12-14T03:35:06.406ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = f2dc57d7-467e-483d-a644-e778adc6b204 resource = BlueprintConfig result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
11372024-12-14T03:35:06.411ZINFOnexus (dropshot_internal): No networking records needed for internal_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = f2dc57d7-467e-483d-a644-e778adc6b204 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
11382024-12-14T03:35:06.411ZINFOnexus (dropshot_internal): No networking records needed for internal_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = f2dc57d7-467e-483d-a644-e778adc6b204 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
11392024-12-14T03:35:06.411ZINFOnexus (dropshot_internal): No networking records needed for internal_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = f2dc57d7-467e-483d-a644-e778adc6b204 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
11402024-12-14T03:35:06.411ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = f2dc57d7-467e-483d-a644-e778adc6b204 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
11412024-12-14T03:35:06.411ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = f2dc57d7-467e-483d-a644-e778adc6b204 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
11422024-12-14T03:35:06.411ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = f2dc57d7-467e-483d-a644-e778adc6b204 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
11432024-12-14T03:35:06.411ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = f2dc57d7-467e-483d-a644-e778adc6b204 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
11442024-12-14T03:35:06.411ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = f2dc57d7-467e-483d-a644-e778adc6b204 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
11452024-12-14T03:35:06.440ZINFOnexus (dropshot_internal): Inserted networking records for external_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = f2dc57d7-467e-483d-a644-e778adc6b204 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
11462024-12-14T03:35:06.461ZINFOnexus (dropshot_internal): Inserted networking records for external_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = f2dc57d7-467e-483d-a644-e778adc6b204 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
11472024-12-14T03:35:06.483ZINFOnexus (dropshot_internal): Inserted networking records for nexus service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = f2dc57d7-467e-483d-a644-e778adc6b204 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
11482024-12-14T03:35:06.504ZINFOnexus (dropshot_internal): Inserted networking records for nexus service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = f2dc57d7-467e-483d-a644-e778adc6b204 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
11492024-12-14T03:35:06.528ZINFOnexus (dropshot_internal): Inserted networking records for nexus service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = f2dc57d7-467e-483d-a644-e778adc6b204 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
11502024-12-14T03:35:06.528ZINFOnexus (dropshot_internal): No networking records needed for oximeter service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = f2dc57d7-467e-483d-a644-e778adc6b204 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
11512024-12-14T03:35:06.528ZINFOnexus (dropshot_internal): No networking records needed for clickhouse service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = f2dc57d7-467e-483d-a644-e778adc6b204 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
11522024-12-14T03:35:06.528ZINFOnexus (dropshot_internal): No networking records needed for crucible_pantry service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = f2dc57d7-467e-483d-a644-e778adc6b204 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
11532024-12-14T03:35:06.528ZINFOnexus (dropshot_internal): No networking records needed for crucible_pantry service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = f2dc57d7-467e-483d-a644-e778adc6b204 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
11542024-12-14T03:35:06.528ZINFOnexus (dropshot_internal): No networking records needed for crucible_pantry service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = f2dc57d7-467e-483d-a644-e778adc6b204 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
11552024-12-14T03:35:06.528ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = f2dc57d7-467e-483d-a644-e778adc6b204 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
11562024-12-14T03:35:06.528ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = f2dc57d7-467e-483d-a644-e778adc6b204 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
11572024-12-14T03:35:06.528ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = f2dc57d7-467e-483d-a644-e778adc6b204 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
11582024-12-14T03:35:06.528ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = f2dc57d7-467e-483d-a644-e778adc6b204 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
11592024-12-14T03:35:06.528ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = f2dc57d7-467e-483d-a644-e778adc6b204 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
11602024-12-14T03:35:06.528ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = f2dc57d7-467e-483d-a644-e778adc6b204 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
11612024-12-14T03:35:06.528ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = f2dc57d7-467e-483d-a644-e778adc6b204 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
11622024-12-14T03:35:06.528ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = f2dc57d7-467e-483d-a644-e778adc6b204 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
11632024-12-14T03:35:06.528ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = f2dc57d7-467e-483d-a644-e778adc6b204 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
11642024-12-14T03:35:06.554ZINFOnexus (dropshot_internal): Inserted networking records for boundary_ntp service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = f2dc57d7-467e-483d-a644-e778adc6b204 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
11652024-12-14T03:35:06.554ZINFOnexus (dropshot_internal): Inserted service networking records actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:809 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = f2dc57d7-467e-483d-a644-e778adc6b204 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
11662024-12-14T03:35:06.554ZINFOnexus (dropshot_internal): physical disk upsert in handoff: PhysicalDisk { identity: PhysicalDiskIdentity { id: b81997dc-4390-4d6b-b937-ec142d15ce9e (physical_disk), time_created: 2024-12-14T03:35:06.014838053Z, time_modified: 2024-12-14T03:35:06.014838053Z, }, time_deleted: None, rcgen: Generation( Generation( 1, ), ), vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-U2", variant: U2, sled_id: 8d70e61c-94ed-41ce-b36c-cb904f92c534, disk_policy: InService, disk_state: Active, } actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:812 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = f2dc57d7-467e-483d-a644-e778adc6b204 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
11672024-12-14T03:35:06.554ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = f2dc57d7-467e-483d-a644-e778adc6b204 roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
11682024-12-14T03:35:06.555ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = f2dc57d7-467e-483d-a644-e778adc6b204 resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
11692024-12-14T03:35:06.556ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = f2dc57d7-467e-483d-a644-e778adc6b204 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
11702024-12-14T03:35:06.558ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = f2dc57d7-467e-483d-a644-e778adc6b204 resource = Fleet result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
11712024-12-14T03:35:06.562ZERROnexus (dropshot_internal): Failed to upsert physical disk actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true err = Custom transaction error: Object (of type ById(8d70e61c-94ed-41ce-b36c-cb904f92c534)) not found: sled file = nexus/db-queries/src/db/datastore/rack.rs:816 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = f2dc57d7-467e-483d-a644-e778adc6b204 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
11722024-12-14T03:35:06.573ZINFOnexus (dropshot_internal): request completed error_message_external = not found: sled with id "8d70e61c-94ed-41ce-b36c-cb904f92c534" error_message_internal = not found: sled with id "8d70e61c-94ed-41ce-b36c-cb904f92c534" file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 562873 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = f2dc57d7-467e-483d-a644-e778adc6b204 response_code = 404 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
11732024-12-14T03:35:07.098ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
11742024-12-14T03:35:07.098ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
11752024-12-14T03:35:07.099ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
11762024-12-14T03:35:07.100ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
11772024-12-14T03:35:07.101ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11782024-12-14T03:35:07.104ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: a121ca05-bbee-41bf-b9db-9e03ff035200, lookup_type: ById(a121ca05-bbee-41bf-b9db-9e03ff035200) } result = Ok(())
11792024-12-14T03:35:07.104ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: a121ca05-bbee-41bf-b9db-9e03ff035200, time_created: 2024-12-14T03:34:57.145875Z, time_modified: 2024-12-14T03:34:57.145875Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
11802024-12-14T03:35:09.022ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 3d44980b-ea9e-48d9-9be8-75d43f4391c8 roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
11812024-12-14T03:35:09.022ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 3d44980b-ea9e-48d9-9be8-75d43f4391c8 resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
11822024-12-14T03:35:09.025ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 3d44980b-ea9e-48d9-9be8-75d43f4391c8 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
11832024-12-14T03:35:09.026ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 3d44980b-ea9e-48d9-9be8-75d43f4391c8 resource = Fleet result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
11842024-12-14T03:35:09.026ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 3d44980b-ea9e-48d9-9be8-75d43f4391c8 roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
11852024-12-14T03:35:09.026ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 3d44980b-ea9e-48d9-9be8-75d43f4391c8 resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
11862024-12-14T03:35:09.029ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 3d44980b-ea9e-48d9-9be8-75d43f4391c8 roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
11872024-12-14T03:35:09.029ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 3d44980b-ea9e-48d9-9be8-75d43f4391c8 resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
11882024-12-14T03:35:09.031ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 3d44980b-ea9e-48d9-9be8-75d43f4391c8 roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
11892024-12-14T03:35:09.031ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 3d44980b-ea9e-48d9-9be8-75d43f4391c8 resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
11902024-12-14T03:35:09.032ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 3d44980b-ea9e-48d9-9be8-75d43f4391c8 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
11912024-12-14T03:35:09.035ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 3d44980b-ea9e-48d9-9be8-75d43f4391c8 resource = Rack { parent: Fleet, key: a121ca05-bbee-41bf-b9db-9e03ff035200, lookup_type: ById(a121ca05-bbee-41bf-b9db-9e03ff035200) } result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
11922024-12-14T03:35:09.035ZDEBGnexus (dropshot_internal): updating rack subnet for rack a121ca05-bbee-41bf-b9db-9e03ff035200 to Some( V6( Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56, }, ), ) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 3d44980b-ea9e-48d9-9be8-75d43f4391c8 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
11932024-12-14T03:35:09.035ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 3d44980b-ea9e-48d9-9be8-75d43f4391c8 roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
11942024-12-14T03:35:09.035ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 3d44980b-ea9e-48d9-9be8-75d43f4391c8 resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
11952024-12-14T03:35:09.045ZINFOnexus (dropshot_internal): Using automatic external switchport discovery actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:324 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 3d44980b-ea9e-48d9-9be8-75d43f4391c8 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
11962024-12-14T03:35:09.075ZDEBGnexus (DpdClient): client request actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true body = None local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 3d44980b-ea9e-48d9-9be8-75d43f4391c8 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
11972024-12-14T03:35:09.076ZDEBGnexus (DpdClient): client response actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 3d44980b-ea9e-48d9-9be8-75d43f4391c8 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/ports", status: 200, headers: {"content-type": "application/json", "x-request-id": "6b80c558-94f6-4d5e-990f-e4b8c675c857", "content-length": "24", "date": "Sat, 14 Dec 2024 03:35:08 GMT"} }) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
11982024-12-14T03:35:09.076ZINFOnexus (dropshot_internal): discovered ports for switch0: [ Internal( Internal( "int0", ), ), Rear( Rear( "rear0", ), ), Qsfp( Qsfp( "qsfp0", ), ), ] actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:344 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 3d44980b-ea9e-48d9-9be8-75d43f4391c8 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
11992024-12-14T03:35:09.076ZINFOnexus (dropshot_internal): populating ports for switch0: [ Name( "qsfp0", ), ] actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:354 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 3d44980b-ea9e-48d9-9be8-75d43f4391c8 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
12002024-12-14T03:35:09.076ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 3d44980b-ea9e-48d9-9be8-75d43f4391c8 roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
12012024-12-14T03:35:09.076ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 3d44980b-ea9e-48d9-9be8-75d43f4391c8 resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
12022024-12-14T03:35:09.088ZINFOnexus (dropshot_internal): Recording Rack Network Configuration actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:389 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 3d44980b-ea9e-48d9-9be8-75d43f4391c8 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
12032024-12-14T03:35:09.088ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 3d44980b-ea9e-48d9-9be8-75d43f4391c8 roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
12042024-12-14T03:35:09.088ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 3d44980b-ea9e-48d9-9be8-75d43f4391c8 resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
12052024-12-14T03:35:09.092ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 3d44980b-ea9e-48d9-9be8-75d43f4391c8 roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
12062024-12-14T03:35:09.092ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 3d44980b-ea9e-48d9-9be8-75d43f4391c8 resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
12072024-12-14T03:35:09.095ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 3d44980b-ea9e-48d9-9be8-75d43f4391c8 roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
12082024-12-14T03:35:09.095ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 3d44980b-ea9e-48d9-9be8-75d43f4391c8 resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
12092024-12-14T03:35:09.096ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 3d44980b-ea9e-48d9-9be8-75d43f4391c8 roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
12102024-12-14T03:35:09.096ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 3d44980b-ea9e-48d9-9be8-75d43f4391c8 resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
12112024-12-14T03:35:09.098ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 3d44980b-ea9e-48d9-9be8-75d43f4391c8 roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
12122024-12-14T03:35:09.098ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 3d44980b-ea9e-48d9-9be8-75d43f4391c8 resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
12132024-12-14T03:35:09.100ZDEBGnexus (dropshot_internal): failed to check if bgp peer exists in switch port settings actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true error = NotFound local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 3d44980b-ea9e-48d9-9be8-75d43f4391c8 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
12142024-12-14T03:35:09.101ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 3d44980b-ea9e-48d9-9be8-75d43f4391c8 roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
12152024-12-14T03:35:09.101ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 3d44980b-ea9e-48d9-9be8-75d43f4391c8 resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
12162024-12-14T03:35:09.103ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 3d44980b-ea9e-48d9-9be8-75d43f4391c8 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
12172024-12-14T03:35:09.105ZDEBGnexus (dropshot_internal): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 3d44980b-ea9e-48d9-9be8-75d43f4391c8 resource = Fleet result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
12182024-12-14T03:35:09.105ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 3d44980b-ea9e-48d9-9be8-75d43f4391c8 roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
12192024-12-14T03:35:09.105ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 3d44980b-ea9e-48d9-9be8-75d43f4391c8 resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
12202024-12-14T03:35:09.105ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
12212024-12-14T03:35:09.106ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
12222024-12-14T03:35:09.106ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 3d44980b-ea9e-48d9-9be8-75d43f4391c8 roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
12232024-12-14T03:35:09.106ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
12242024-12-14T03:35:09.107ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 3d44980b-ea9e-48d9-9be8-75d43f4391c8 resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
12252024-12-14T03:35:09.107ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
12262024-12-14T03:35:09.108ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 3d44980b-ea9e-48d9-9be8-75d43f4391c8 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
12272024-12-14T03:35:09.108ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12282024-12-14T03:35:09.111ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 3d44980b-ea9e-48d9-9be8-75d43f4391c8 resource = IpPool { parent: Fleet, key: bdf4635b-d53e-4acb-8b1c-1769f4520d05, lookup_type: ByName("oxide-service-pool") } result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
12292024-12-14T03:35:09.111ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 3d44980b-ea9e-48d9-9be8-75d43f4391c8 roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
12302024-12-14T03:35:09.111ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: a121ca05-bbee-41bf-b9db-9e03ff035200, lookup_type: ById(a121ca05-bbee-41bf-b9db-9e03ff035200) } result = Ok(())
12312024-12-14T03:35:09.111ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: a121ca05-bbee-41bf-b9db-9e03ff035200, time_created: 2024-12-14T03:34:57.145875Z, time_modified: 2024-12-14T03:34:57.145875Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
12322024-12-14T03:35:09.111ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 3d44980b-ea9e-48d9-9be8-75d43f4391c8 resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
12332024-12-14T03:35:09.113ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 3d44980b-ea9e-48d9-9be8-75d43f4391c8 roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
12342024-12-14T03:35:09.113ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 3d44980b-ea9e-48d9-9be8-75d43f4391c8 resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
12352024-12-14T03:35:09.115ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 3d44980b-ea9e-48d9-9be8-75d43f4391c8 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
12362024-12-14T03:35:09.116ZDEBGnexus (dropshot_internal): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 3d44980b-ea9e-48d9-9be8-75d43f4391c8 resource = IpPool { parent: Fleet, key: bdf4635b-d53e-4acb-8b1c-1769f4520d05, lookup_type: ByName("oxide-service-pool") } result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
12372024-12-14T03:35:09.122ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 3d44980b-ea9e-48d9-9be8-75d43f4391c8 roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
12382024-12-14T03:35:09.122ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 3d44980b-ea9e-48d9-9be8-75d43f4391c8 resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
12392024-12-14T03:35:09.124ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 3d44980b-ea9e-48d9-9be8-75d43f4391c8 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
12402024-12-14T03:35:09.126ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 3d44980b-ea9e-48d9-9be8-75d43f4391c8 resource = BlueprintConfig result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
12412024-12-14T03:35:09.139ZINFOnexus (dropshot_internal): inserted blueprint actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true blueprint_id = eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1 file = nexus/db-queries/src/db/datastore/deployment.rs:456 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 3d44980b-ea9e-48d9-9be8-75d43f4391c8 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
12422024-12-14T03:35:09.139ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 3d44980b-ea9e-48d9-9be8-75d43f4391c8 roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
12432024-12-14T03:35:09.140ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 3d44980b-ea9e-48d9-9be8-75d43f4391c8 resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
12442024-12-14T03:35:09.141ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 3d44980b-ea9e-48d9-9be8-75d43f4391c8 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
12452024-12-14T03:35:09.143ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 3d44980b-ea9e-48d9-9be8-75d43f4391c8 resource = BlueprintConfig result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
12462024-12-14T03:35:09.147ZINFOnexus (dropshot_internal): No networking records needed for internal_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 3d44980b-ea9e-48d9-9be8-75d43f4391c8 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
12472024-12-14T03:35:09.147ZINFOnexus (dropshot_internal): No networking records needed for internal_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 3d44980b-ea9e-48d9-9be8-75d43f4391c8 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
12482024-12-14T03:35:09.147ZINFOnexus (dropshot_internal): No networking records needed for internal_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 3d44980b-ea9e-48d9-9be8-75d43f4391c8 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
12492024-12-14T03:35:09.147ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 3d44980b-ea9e-48d9-9be8-75d43f4391c8 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
12502024-12-14T03:35:09.147ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 3d44980b-ea9e-48d9-9be8-75d43f4391c8 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
12512024-12-14T03:35:09.147ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 3d44980b-ea9e-48d9-9be8-75d43f4391c8 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
12522024-12-14T03:35:09.147ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 3d44980b-ea9e-48d9-9be8-75d43f4391c8 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
12532024-12-14T03:35:09.147ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 3d44980b-ea9e-48d9-9be8-75d43f4391c8 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
12542024-12-14T03:35:09.169ZINFOnexus (dropshot_internal): Inserted networking records for external_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 3d44980b-ea9e-48d9-9be8-75d43f4391c8 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
12552024-12-14T03:35:09.192ZINFOnexus (dropshot_internal): Inserted networking records for external_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 3d44980b-ea9e-48d9-9be8-75d43f4391c8 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
12562024-12-14T03:35:09.214ZINFOnexus (dropshot_internal): Inserted networking records for nexus service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 3d44980b-ea9e-48d9-9be8-75d43f4391c8 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
12572024-12-14T03:35:09.236ZINFOnexus (dropshot_internal): Inserted networking records for nexus service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 3d44980b-ea9e-48d9-9be8-75d43f4391c8 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
12582024-12-14T03:35:09.257ZINFOnexus (dropshot_internal): Inserted networking records for nexus service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 3d44980b-ea9e-48d9-9be8-75d43f4391c8 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
12592024-12-14T03:35:09.257ZINFOnexus (dropshot_internal): No networking records needed for oximeter service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 3d44980b-ea9e-48d9-9be8-75d43f4391c8 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
12602024-12-14T03:35:09.257ZINFOnexus (dropshot_internal): No networking records needed for clickhouse service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 3d44980b-ea9e-48d9-9be8-75d43f4391c8 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
12612024-12-14T03:35:09.257ZINFOnexus (dropshot_internal): No networking records needed for crucible_pantry service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 3d44980b-ea9e-48d9-9be8-75d43f4391c8 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
12622024-12-14T03:35:09.257ZINFOnexus (dropshot_internal): No networking records needed for crucible_pantry service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 3d44980b-ea9e-48d9-9be8-75d43f4391c8 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
12632024-12-14T03:35:09.257ZINFOnexus (dropshot_internal): No networking records needed for crucible_pantry service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 3d44980b-ea9e-48d9-9be8-75d43f4391c8 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
12642024-12-14T03:35:09.257ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 3d44980b-ea9e-48d9-9be8-75d43f4391c8 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
12652024-12-14T03:35:09.257ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 3d44980b-ea9e-48d9-9be8-75d43f4391c8 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
12662024-12-14T03:35:09.257ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 3d44980b-ea9e-48d9-9be8-75d43f4391c8 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
12672024-12-14T03:35:09.257ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 3d44980b-ea9e-48d9-9be8-75d43f4391c8 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
12682024-12-14T03:35:09.257ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 3d44980b-ea9e-48d9-9be8-75d43f4391c8 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
12692024-12-14T03:35:09.257ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 3d44980b-ea9e-48d9-9be8-75d43f4391c8 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
12702024-12-14T03:35:09.257ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 3d44980b-ea9e-48d9-9be8-75d43f4391c8 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
12712024-12-14T03:35:09.257ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 3d44980b-ea9e-48d9-9be8-75d43f4391c8 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
12722024-12-14T03:35:09.257ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 3d44980b-ea9e-48d9-9be8-75d43f4391c8 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
12732024-12-14T03:35:09.283ZINFOnexus (dropshot_internal): Inserted networking records for boundary_ntp service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 3d44980b-ea9e-48d9-9be8-75d43f4391c8 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
12742024-12-14T03:35:09.283ZINFOnexus (dropshot_internal): Inserted service networking records actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:809 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 3d44980b-ea9e-48d9-9be8-75d43f4391c8 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
12752024-12-14T03:35:09.283ZINFOnexus (dropshot_internal): physical disk upsert in handoff: PhysicalDisk { identity: PhysicalDiskIdentity { id: b81997dc-4390-4d6b-b937-ec142d15ce9e (physical_disk), time_created: 2024-12-14T03:35:09.026369986Z, time_modified: 2024-12-14T03:35:09.026369986Z, }, time_deleted: None, rcgen: Generation( Generation( 1, ), ), vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-U2", variant: U2, sled_id: 8d70e61c-94ed-41ce-b36c-cb904f92c534, disk_policy: InService, disk_state: Active, } actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:812 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 3d44980b-ea9e-48d9-9be8-75d43f4391c8 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
12762024-12-14T03:35:09.283ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 3d44980b-ea9e-48d9-9be8-75d43f4391c8 roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
12772024-12-14T03:35:09.283ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 3d44980b-ea9e-48d9-9be8-75d43f4391c8 resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
12782024-12-14T03:35:09.285ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 3d44980b-ea9e-48d9-9be8-75d43f4391c8 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
12792024-12-14T03:35:09.287ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 3d44980b-ea9e-48d9-9be8-75d43f4391c8 resource = Fleet result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
12802024-12-14T03:35:09.289ZERROnexus (dropshot_internal): Failed to upsert physical disk actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true err = Custom transaction error: Object (of type ById(8d70e61c-94ed-41ce-b36c-cb904f92c534)) not found: sled file = nexus/db-queries/src/db/datastore/rack.rs:816 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 3d44980b-ea9e-48d9-9be8-75d43f4391c8 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
12812024-12-14T03:35:09.300ZINFOnexus (dropshot_internal): request completed error_message_external = not found: sled with id "8d70e61c-94ed-41ce-b36c-cb904f92c534" error_message_internal = not found: sled with id "8d70e61c-94ed-41ce-b36c-cb904f92c534" file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 278086 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 3d44980b-ea9e-48d9-9be8-75d43f4391c8 response_code = 404 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
12822024-12-14T03:35:11.112ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
12832024-12-14T03:35:11.112ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
12842024-12-14T03:35:11.114ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
12852024-12-14T03:35:11.114ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
12862024-12-14T03:35:11.115ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12872024-12-14T03:35:11.118ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: a121ca05-bbee-41bf-b9db-9e03ff035200, lookup_type: ById(a121ca05-bbee-41bf-b9db-9e03ff035200) } result = Ok(())
12882024-12-14T03:35:11.118ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: a121ca05-bbee-41bf-b9db-9e03ff035200, time_created: 2024-12-14T03:34:57.145875Z, time_modified: 2024-12-14T03:34:57.145875Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
12892024-12-14T03:35:13.119ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
12902024-12-14T03:35:13.119ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
12912024-12-14T03:35:13.121ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
12922024-12-14T03:35:13.121ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
12932024-12-14T03:35:13.123ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12942024-12-14T03:35:13.125ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: a121ca05-bbee-41bf-b9db-9e03ff035200, lookup_type: ById(a121ca05-bbee-41bf-b9db-9e03ff035200) } result = Ok(())
12952024-12-14T03:35:13.125ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: a121ca05-bbee-41bf-b9db-9e03ff035200, time_created: 2024-12-14T03:34:57.145875Z, time_modified: 2024-12-14T03:34:57.145875Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
12962024-12-14T03:35:14.925ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 2b83d200-4c75-4a7a-9956-199310783c8e roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
12972024-12-14T03:35:14.926ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 2b83d200-4c75-4a7a-9956-199310783c8e resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
12982024-12-14T03:35:14.927ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 2b83d200-4c75-4a7a-9956-199310783c8e roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
12992024-12-14T03:35:14.928ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 2b83d200-4c75-4a7a-9956-199310783c8e resource = Fleet result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
13002024-12-14T03:35:14.928ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 2b83d200-4c75-4a7a-9956-199310783c8e roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
13012024-12-14T03:35:14.928ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 2b83d200-4c75-4a7a-9956-199310783c8e resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
13022024-12-14T03:35:14.931ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 2b83d200-4c75-4a7a-9956-199310783c8e roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
13032024-12-14T03:35:14.931ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 2b83d200-4c75-4a7a-9956-199310783c8e resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
13042024-12-14T03:35:14.933ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 2b83d200-4c75-4a7a-9956-199310783c8e roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
13052024-12-14T03:35:14.933ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 2b83d200-4c75-4a7a-9956-199310783c8e resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
13062024-12-14T03:35:14.935ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 2b83d200-4c75-4a7a-9956-199310783c8e roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
13072024-12-14T03:35:14.937ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 2b83d200-4c75-4a7a-9956-199310783c8e resource = Rack { parent: Fleet, key: a121ca05-bbee-41bf-b9db-9e03ff035200, lookup_type: ById(a121ca05-bbee-41bf-b9db-9e03ff035200) } result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
13082024-12-14T03:35:14.937ZDEBGnexus (dropshot_internal): updating rack subnet for rack a121ca05-bbee-41bf-b9db-9e03ff035200 to Some( V6( Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56, }, ), ) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 2b83d200-4c75-4a7a-9956-199310783c8e uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
13092024-12-14T03:35:14.937ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 2b83d200-4c75-4a7a-9956-199310783c8e roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
13102024-12-14T03:35:14.937ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 2b83d200-4c75-4a7a-9956-199310783c8e resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
13112024-12-14T03:35:14.942ZINFOnexus (dropshot_internal): Using automatic external switchport discovery actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:324 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 2b83d200-4c75-4a7a-9956-199310783c8e uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
13122024-12-14T03:35:14.972ZDEBGnexus (DpdClient): client request actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true body = None local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 2b83d200-4c75-4a7a-9956-199310783c8e uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
13132024-12-14T03:35:14.973ZDEBGnexus (DpdClient): client response actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 2b83d200-4c75-4a7a-9956-199310783c8e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/ports", status: 200, headers: {"content-type": "application/json", "x-request-id": "40fffeb2-9ed7-4d35-876f-159cf8ae5c54", "content-length": "24", "date": "Sat, 14 Dec 2024 03:35:14 GMT"} }) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
13142024-12-14T03:35:14.973ZINFOnexus (dropshot_internal): discovered ports for switch0: [ Internal( Internal( "int0", ), ), Rear( Rear( "rear0", ), ), Qsfp( Qsfp( "qsfp0", ), ), ] actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:344 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 2b83d200-4c75-4a7a-9956-199310783c8e uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
13152024-12-14T03:35:14.973ZINFOnexus (dropshot_internal): populating ports for switch0: [ Name( "qsfp0", ), ] actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:354 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 2b83d200-4c75-4a7a-9956-199310783c8e uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
13162024-12-14T03:35:14.973ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 2b83d200-4c75-4a7a-9956-199310783c8e roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
13172024-12-14T03:35:14.973ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 2b83d200-4c75-4a7a-9956-199310783c8e resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
13182024-12-14T03:35:14.985ZINFOnexus (dropshot_internal): Recording Rack Network Configuration actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:389 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 2b83d200-4c75-4a7a-9956-199310783c8e uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
13192024-12-14T03:35:14.985ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 2b83d200-4c75-4a7a-9956-199310783c8e roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
13202024-12-14T03:35:14.985ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 2b83d200-4c75-4a7a-9956-199310783c8e resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
13212024-12-14T03:35:14.989ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 2b83d200-4c75-4a7a-9956-199310783c8e roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
13222024-12-14T03:35:14.989ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 2b83d200-4c75-4a7a-9956-199310783c8e resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
13232024-12-14T03:35:14.992ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 2b83d200-4c75-4a7a-9956-199310783c8e roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
13242024-12-14T03:35:14.993ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 2b83d200-4c75-4a7a-9956-199310783c8e resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
13252024-12-14T03:35:14.994ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 2b83d200-4c75-4a7a-9956-199310783c8e roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
13262024-12-14T03:35:14.994ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 2b83d200-4c75-4a7a-9956-199310783c8e resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
13272024-12-14T03:35:14.995ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 2b83d200-4c75-4a7a-9956-199310783c8e roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
13282024-12-14T03:35:14.996ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 2b83d200-4c75-4a7a-9956-199310783c8e resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
13292024-12-14T03:35:14.998ZDEBGnexus (dropshot_internal): failed to check if bgp peer exists in switch port settings actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true error = NotFound local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 2b83d200-4c75-4a7a-9956-199310783c8e uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
13302024-12-14T03:35:14.999ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 2b83d200-4c75-4a7a-9956-199310783c8e roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
13312024-12-14T03:35:14.999ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 2b83d200-4c75-4a7a-9956-199310783c8e resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
13322024-12-14T03:35:15.001ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 2b83d200-4c75-4a7a-9956-199310783c8e roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
13332024-12-14T03:35:15.003ZDEBGnexus (dropshot_internal): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 2b83d200-4c75-4a7a-9956-199310783c8e resource = Fleet result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
13342024-12-14T03:35:15.003ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 2b83d200-4c75-4a7a-9956-199310783c8e roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
13352024-12-14T03:35:15.003ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 2b83d200-4c75-4a7a-9956-199310783c8e resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
13362024-12-14T03:35:15.005ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 2b83d200-4c75-4a7a-9956-199310783c8e roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
13372024-12-14T03:35:15.005ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 2b83d200-4c75-4a7a-9956-199310783c8e resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
13382024-12-14T03:35:15.006ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 2b83d200-4c75-4a7a-9956-199310783c8e roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
13392024-12-14T03:35:15.009ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 2b83d200-4c75-4a7a-9956-199310783c8e resource = IpPool { parent: Fleet, key: bdf4635b-d53e-4acb-8b1c-1769f4520d05, lookup_type: ByName("oxide-service-pool") } result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
13402024-12-14T03:35:15.009ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 2b83d200-4c75-4a7a-9956-199310783c8e roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
13412024-12-14T03:35:15.009ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 2b83d200-4c75-4a7a-9956-199310783c8e resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
13422024-12-14T03:35:15.010ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 2b83d200-4c75-4a7a-9956-199310783c8e roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
13432024-12-14T03:35:15.010ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 2b83d200-4c75-4a7a-9956-199310783c8e resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
13442024-12-14T03:35:15.012ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 2b83d200-4c75-4a7a-9956-199310783c8e roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
13452024-12-14T03:35:15.013ZDEBGnexus (dropshot_internal): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 2b83d200-4c75-4a7a-9956-199310783c8e resource = IpPool { parent: Fleet, key: bdf4635b-d53e-4acb-8b1c-1769f4520d05, lookup_type: ByName("oxide-service-pool") } result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
13462024-12-14T03:35:15.033ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 2b83d200-4c75-4a7a-9956-199310783c8e roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
13472024-12-14T03:35:15.033ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 2b83d200-4c75-4a7a-9956-199310783c8e resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
13482024-12-14T03:35:15.034ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 2b83d200-4c75-4a7a-9956-199310783c8e roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
13492024-12-14T03:35:15.036ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 2b83d200-4c75-4a7a-9956-199310783c8e resource = BlueprintConfig result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
13502024-12-14T03:35:15.126ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
13512024-12-14T03:35:15.127ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
13522024-12-14T03:35:15.128ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
13532024-12-14T03:35:15.128ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
13542024-12-14T03:35:15.131ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13552024-12-14T03:35:15.133ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: a121ca05-bbee-41bf-b9db-9e03ff035200, lookup_type: ById(a121ca05-bbee-41bf-b9db-9e03ff035200) } result = Ok(())
13562024-12-14T03:35:15.133ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: a121ca05-bbee-41bf-b9db-9e03ff035200, time_created: 2024-12-14T03:34:57.145875Z, time_modified: 2024-12-14T03:34:57.145875Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
13572024-12-14T03:35:15.173ZINFOnexus (dropshot_internal): inserted blueprint actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true blueprint_id = eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1 file = nexus/db-queries/src/db/datastore/deployment.rs:456 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 2b83d200-4c75-4a7a-9956-199310783c8e uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
13582024-12-14T03:35:15.173ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 2b83d200-4c75-4a7a-9956-199310783c8e roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
13592024-12-14T03:35:15.173ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 2b83d200-4c75-4a7a-9956-199310783c8e resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
13602024-12-14T03:35:15.175ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 2b83d200-4c75-4a7a-9956-199310783c8e roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
13612024-12-14T03:35:15.177ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 2b83d200-4c75-4a7a-9956-199310783c8e resource = BlueprintConfig result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
13622024-12-14T03:35:15.187ZINFOnexus (dropshot_internal): No networking records needed for internal_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 2b83d200-4c75-4a7a-9956-199310783c8e uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
13632024-12-14T03:35:15.187ZINFOnexus (dropshot_internal): No networking records needed for internal_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 2b83d200-4c75-4a7a-9956-199310783c8e uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
13642024-12-14T03:35:15.187ZINFOnexus (dropshot_internal): No networking records needed for internal_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 2b83d200-4c75-4a7a-9956-199310783c8e uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
13652024-12-14T03:35:15.187ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 2b83d200-4c75-4a7a-9956-199310783c8e uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
13662024-12-14T03:35:15.187ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 2b83d200-4c75-4a7a-9956-199310783c8e uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
13672024-12-14T03:35:15.187ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 2b83d200-4c75-4a7a-9956-199310783c8e uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
13682024-12-14T03:35:15.187ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 2b83d200-4c75-4a7a-9956-199310783c8e uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
13692024-12-14T03:35:15.187ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 2b83d200-4c75-4a7a-9956-199310783c8e uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
13702024-12-14T03:35:15.264ZINFOnexus (dropshot_internal): Inserted networking records for external_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 2b83d200-4c75-4a7a-9956-199310783c8e uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
13712024-12-14T03:35:15.287ZINFOnexus (dropshot_internal): Inserted networking records for external_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 2b83d200-4c75-4a7a-9956-199310783c8e uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
13722024-12-14T03:35:15.312ZINFOnexus (dropshot_internal): Inserted networking records for nexus service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 2b83d200-4c75-4a7a-9956-199310783c8e uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
13732024-12-14T03:35:15.333ZINFOnexus (dropshot_internal): Inserted networking records for nexus service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 2b83d200-4c75-4a7a-9956-199310783c8e uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
13742024-12-14T03:35:15.362ZINFOnexus (dropshot_internal): Inserted networking records for nexus service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 2b83d200-4c75-4a7a-9956-199310783c8e uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
13752024-12-14T03:35:15.362ZINFOnexus (dropshot_internal): No networking records needed for oximeter service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 2b83d200-4c75-4a7a-9956-199310783c8e uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
13762024-12-14T03:35:15.362ZINFOnexus (dropshot_internal): No networking records needed for clickhouse service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 2b83d200-4c75-4a7a-9956-199310783c8e uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
13772024-12-14T03:35:15.362ZINFOnexus (dropshot_internal): No networking records needed for crucible_pantry service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 2b83d200-4c75-4a7a-9956-199310783c8e uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
13782024-12-14T03:35:15.362ZINFOnexus (dropshot_internal): No networking records needed for crucible_pantry service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 2b83d200-4c75-4a7a-9956-199310783c8e uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
13792024-12-14T03:35:15.362ZINFOnexus (dropshot_internal): No networking records needed for crucible_pantry service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 2b83d200-4c75-4a7a-9956-199310783c8e uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
13802024-12-14T03:35:15.362ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 2b83d200-4c75-4a7a-9956-199310783c8e uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
13812024-12-14T03:35:15.362ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 2b83d200-4c75-4a7a-9956-199310783c8e uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
13822024-12-14T03:35:15.362ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 2b83d200-4c75-4a7a-9956-199310783c8e uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
13832024-12-14T03:35:15.362ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 2b83d200-4c75-4a7a-9956-199310783c8e uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
13842024-12-14T03:35:15.362ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 2b83d200-4c75-4a7a-9956-199310783c8e uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
13852024-12-14T03:35:15.362ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 2b83d200-4c75-4a7a-9956-199310783c8e uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
13862024-12-14T03:35:15.362ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 2b83d200-4c75-4a7a-9956-199310783c8e uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
13872024-12-14T03:35:15.362ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 2b83d200-4c75-4a7a-9956-199310783c8e uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
13882024-12-14T03:35:15.362ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 2b83d200-4c75-4a7a-9956-199310783c8e uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
13892024-12-14T03:35:15.392ZINFOnexus (dropshot_internal): Inserted networking records for boundary_ntp service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 2b83d200-4c75-4a7a-9956-199310783c8e uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
13902024-12-14T03:35:15.393ZINFOnexus (dropshot_internal): Inserted service networking records actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:809 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 2b83d200-4c75-4a7a-9956-199310783c8e uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
13912024-12-14T03:35:15.393ZINFOnexus (dropshot_internal): physical disk upsert in handoff: PhysicalDisk { identity: PhysicalDiskIdentity { id: b81997dc-4390-4d6b-b937-ec142d15ce9e (physical_disk), time_created: 2024-12-14T03:35:14.928681033Z, time_modified: 2024-12-14T03:35:14.928681033Z, }, time_deleted: None, rcgen: Generation( Generation( 1, ), ), vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-U2", variant: U2, sled_id: 8d70e61c-94ed-41ce-b36c-cb904f92c534, disk_policy: InService, disk_state: Active, } actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:812 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 2b83d200-4c75-4a7a-9956-199310783c8e uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
13922024-12-14T03:35:15.393ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 2b83d200-4c75-4a7a-9956-199310783c8e roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
13932024-12-14T03:35:15.393ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 2b83d200-4c75-4a7a-9956-199310783c8e resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
13942024-12-14T03:35:15.395ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 2b83d200-4c75-4a7a-9956-199310783c8e roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
13952024-12-14T03:35:15.397ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 2b83d200-4c75-4a7a-9956-199310783c8e resource = Fleet result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
13962024-12-14T03:35:15.417ZERROnexus (dropshot_internal): Failed to upsert physical disk actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true err = Custom transaction error: Object (of type ById(8d70e61c-94ed-41ce-b36c-cb904f92c534)) not found: sled file = nexus/db-queries/src/db/datastore/rack.rs:816 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 2b83d200-4c75-4a7a-9956-199310783c8e uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
13972024-12-14T03:35:15.422ZINFOnexus (dropshot_internal): request completed error_message_external = not found: sled with id "8d70e61c-94ed-41ce-b36c-cb904f92c534" error_message_internal = not found: sled with id "8d70e61c-94ed-41ce-b36c-cb904f92c534" file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 497056 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = 2b83d200-4c75-4a7a-9956-199310783c8e response_code = 404 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
13982024-12-14T03:35:16.344ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 3 reason = Timeout
13992024-12-14T03:35:16.344ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
14002024-12-14T03:35:16.344ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 3 reason = Timeout
14012024-12-14T03:35:16.344ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14022024-12-14T03:35:16.345ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14032024-12-14T03:35:16.345ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
14042024-12-14T03:35:16.347ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14052024-12-14T03:35:16.350ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
14062024-12-14T03:35:16.350ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14072024-12-14T03:35:16.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14082024-12-14T03:35:16.352ZWARNnexus (BackgroundTasks): failed to read target blueprint background_task = blueprint_loader error = Internal Error: no target blueprint set file = nexus/src/app/background/tasks/blueprint_load.rs:69
14092024-12-14T03:35:16.352ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 7.748705ms iteration = 3 status = {"error":"failed to read target blueprint: Internal Error: no target blueprint set"}
14102024-12-14T03:35:16.374ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
14112024-12-14T03:35:16.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
14122024-12-14T03:35:16.376ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.688075ms iteration = 3 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
14132024-12-14T03:35:17.134ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
14142024-12-14T03:35:17.135ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
14152024-12-14T03:35:17.137ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
14162024-12-14T03:35:17.137ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
14172024-12-14T03:35:17.139ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14182024-12-14T03:35:17.141ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: a121ca05-bbee-41bf-b9db-9e03ff035200, lookup_type: ById(a121ca05-bbee-41bf-b9db-9e03ff035200) } result = Ok(())
14192024-12-14T03:35:17.141ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: a121ca05-bbee-41bf-b9db-9e03ff035200, time_created: 2024-12-14T03:34:57.145875Z, time_modified: 2024-12-14T03:34:57.145875Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
14202024-12-14T03:35:18.352ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = e0213694-1dcd-41cf-af41-e5a2b9e1a7a8 roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
14212024-12-14T03:35:18.352ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = e0213694-1dcd-41cf-af41-e5a2b9e1a7a8 resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
14222024-12-14T03:35:18.354ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = e0213694-1dcd-41cf-af41-e5a2b9e1a7a8 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
14232024-12-14T03:35:18.356ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = e0213694-1dcd-41cf-af41-e5a2b9e1a7a8 resource = Fleet result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
14242024-12-14T03:35:18.356ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = e0213694-1dcd-41cf-af41-e5a2b9e1a7a8 roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
14252024-12-14T03:35:18.356ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = e0213694-1dcd-41cf-af41-e5a2b9e1a7a8 resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
14262024-12-14T03:35:18.359ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = e0213694-1dcd-41cf-af41-e5a2b9e1a7a8 roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
14272024-12-14T03:35:18.359ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = e0213694-1dcd-41cf-af41-e5a2b9e1a7a8 resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
14282024-12-14T03:35:18.360ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = e0213694-1dcd-41cf-af41-e5a2b9e1a7a8 roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
14292024-12-14T03:35:18.360ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = e0213694-1dcd-41cf-af41-e5a2b9e1a7a8 resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
14302024-12-14T03:35:18.362ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = e0213694-1dcd-41cf-af41-e5a2b9e1a7a8 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
14312024-12-14T03:35:18.364ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = e0213694-1dcd-41cf-af41-e5a2b9e1a7a8 resource = Rack { parent: Fleet, key: a121ca05-bbee-41bf-b9db-9e03ff035200, lookup_type: ById(a121ca05-bbee-41bf-b9db-9e03ff035200) } result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
14322024-12-14T03:35:18.364ZDEBGnexus (dropshot_internal): updating rack subnet for rack a121ca05-bbee-41bf-b9db-9e03ff035200 to Some( V6( Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56, }, ), ) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = e0213694-1dcd-41cf-af41-e5a2b9e1a7a8 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
14332024-12-14T03:35:18.364ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = e0213694-1dcd-41cf-af41-e5a2b9e1a7a8 roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
14342024-12-14T03:35:18.364ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = e0213694-1dcd-41cf-af41-e5a2b9e1a7a8 resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
14352024-12-14T03:35:18.370ZINFOnexus (dropshot_internal): Using automatic external switchport discovery actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:324 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = e0213694-1dcd-41cf-af41-e5a2b9e1a7a8 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
14362024-12-14T03:35:18.401ZDEBGnexus (DpdClient): client request actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true body = None local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = e0213694-1dcd-41cf-af41-e5a2b9e1a7a8 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
14372024-12-14T03:35:18.401ZDEBGnexus (DpdClient): client response actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = e0213694-1dcd-41cf-af41-e5a2b9e1a7a8 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/ports", status: 200, headers: {"content-type": "application/json", "x-request-id": "589e835f-233c-46b9-beec-53862e7ebde2", "content-length": "24", "date": "Sat, 14 Dec 2024 03:35:17 GMT"} }) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
14382024-12-14T03:35:18.401ZINFOnexus (dropshot_internal): discovered ports for switch0: [ Internal( Internal( "int0", ), ), Rear( Rear( "rear0", ), ), Qsfp( Qsfp( "qsfp0", ), ), ] actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:344 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = e0213694-1dcd-41cf-af41-e5a2b9e1a7a8 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
14392024-12-14T03:35:18.401ZINFOnexus (dropshot_internal): populating ports for switch0: [ Name( "qsfp0", ), ] actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:354 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = e0213694-1dcd-41cf-af41-e5a2b9e1a7a8 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
14402024-12-14T03:35:18.401ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = e0213694-1dcd-41cf-af41-e5a2b9e1a7a8 roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
14412024-12-14T03:35:18.402ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = e0213694-1dcd-41cf-af41-e5a2b9e1a7a8 resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
14422024-12-14T03:35:18.410ZINFOnexus (dropshot_internal): Recording Rack Network Configuration actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:389 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = e0213694-1dcd-41cf-af41-e5a2b9e1a7a8 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
14432024-12-14T03:35:18.410ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = e0213694-1dcd-41cf-af41-e5a2b9e1a7a8 roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
14442024-12-14T03:35:18.410ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = e0213694-1dcd-41cf-af41-e5a2b9e1a7a8 resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
14452024-12-14T03:35:18.413ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = e0213694-1dcd-41cf-af41-e5a2b9e1a7a8 roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
14462024-12-14T03:35:18.413ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = e0213694-1dcd-41cf-af41-e5a2b9e1a7a8 resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
14472024-12-14T03:35:18.416ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = e0213694-1dcd-41cf-af41-e5a2b9e1a7a8 roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
14482024-12-14T03:35:18.416ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = e0213694-1dcd-41cf-af41-e5a2b9e1a7a8 resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
14492024-12-14T03:35:18.417ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = e0213694-1dcd-41cf-af41-e5a2b9e1a7a8 roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
14502024-12-14T03:35:18.418ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = e0213694-1dcd-41cf-af41-e5a2b9e1a7a8 resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
14512024-12-14T03:35:18.419ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = e0213694-1dcd-41cf-af41-e5a2b9e1a7a8 roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
14522024-12-14T03:35:18.419ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = e0213694-1dcd-41cf-af41-e5a2b9e1a7a8 resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
14532024-12-14T03:35:18.422ZDEBGnexus (dropshot_internal): failed to check if bgp peer exists in switch port settings actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true error = NotFound local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = e0213694-1dcd-41cf-af41-e5a2b9e1a7a8 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
14542024-12-14T03:35:18.423ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = e0213694-1dcd-41cf-af41-e5a2b9e1a7a8 roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
14552024-12-14T03:35:18.423ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = e0213694-1dcd-41cf-af41-e5a2b9e1a7a8 resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
14562024-12-14T03:35:18.425ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = e0213694-1dcd-41cf-af41-e5a2b9e1a7a8 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
14572024-12-14T03:35:18.426ZDEBGnexus (dropshot_internal): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = e0213694-1dcd-41cf-af41-e5a2b9e1a7a8 resource = Fleet result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
14582024-12-14T03:35:18.426ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = e0213694-1dcd-41cf-af41-e5a2b9e1a7a8 roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
14592024-12-14T03:35:18.426ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = e0213694-1dcd-41cf-af41-e5a2b9e1a7a8 resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
14602024-12-14T03:35:18.428ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = e0213694-1dcd-41cf-af41-e5a2b9e1a7a8 roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
14612024-12-14T03:35:18.429ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = e0213694-1dcd-41cf-af41-e5a2b9e1a7a8 resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
14622024-12-14T03:35:18.430ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = e0213694-1dcd-41cf-af41-e5a2b9e1a7a8 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
14632024-12-14T03:35:18.432ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = e0213694-1dcd-41cf-af41-e5a2b9e1a7a8 resource = IpPool { parent: Fleet, key: bdf4635b-d53e-4acb-8b1c-1769f4520d05, lookup_type: ByName("oxide-service-pool") } result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
14642024-12-14T03:35:18.432ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = e0213694-1dcd-41cf-af41-e5a2b9e1a7a8 roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
14652024-12-14T03:35:18.432ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = e0213694-1dcd-41cf-af41-e5a2b9e1a7a8 resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
14662024-12-14T03:35:18.434ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = e0213694-1dcd-41cf-af41-e5a2b9e1a7a8 roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
14672024-12-14T03:35:18.434ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = e0213694-1dcd-41cf-af41-e5a2b9e1a7a8 resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
14682024-12-14T03:35:18.435ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = e0213694-1dcd-41cf-af41-e5a2b9e1a7a8 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
14692024-12-14T03:35:18.437ZDEBGnexus (dropshot_internal): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = e0213694-1dcd-41cf-af41-e5a2b9e1a7a8 resource = IpPool { parent: Fleet, key: bdf4635b-d53e-4acb-8b1c-1769f4520d05, lookup_type: ByName("oxide-service-pool") } result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
14702024-12-14T03:35:18.443ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = e0213694-1dcd-41cf-af41-e5a2b9e1a7a8 roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
14712024-12-14T03:35:18.444ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = e0213694-1dcd-41cf-af41-e5a2b9e1a7a8 resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
14722024-12-14T03:35:18.445ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = e0213694-1dcd-41cf-af41-e5a2b9e1a7a8 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
14732024-12-14T03:35:18.447ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = e0213694-1dcd-41cf-af41-e5a2b9e1a7a8 resource = BlueprintConfig result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
14742024-12-14T03:35:18.461ZINFOnexus (dropshot_internal): inserted blueprint actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true blueprint_id = eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1 file = nexus/db-queries/src/db/datastore/deployment.rs:456 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = e0213694-1dcd-41cf-af41-e5a2b9e1a7a8 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
14752024-12-14T03:35:18.461ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = e0213694-1dcd-41cf-af41-e5a2b9e1a7a8 roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
14762024-12-14T03:35:18.461ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = e0213694-1dcd-41cf-af41-e5a2b9e1a7a8 resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
14772024-12-14T03:35:18.462ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = e0213694-1dcd-41cf-af41-e5a2b9e1a7a8 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
14782024-12-14T03:35:18.464ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = e0213694-1dcd-41cf-af41-e5a2b9e1a7a8 resource = BlueprintConfig result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
14792024-12-14T03:35:18.468ZINFOnexus (dropshot_internal): No networking records needed for internal_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = e0213694-1dcd-41cf-af41-e5a2b9e1a7a8 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
14802024-12-14T03:35:18.468ZINFOnexus (dropshot_internal): No networking records needed for internal_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = e0213694-1dcd-41cf-af41-e5a2b9e1a7a8 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
14812024-12-14T03:35:18.468ZINFOnexus (dropshot_internal): No networking records needed for internal_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = e0213694-1dcd-41cf-af41-e5a2b9e1a7a8 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
14822024-12-14T03:35:18.468ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = e0213694-1dcd-41cf-af41-e5a2b9e1a7a8 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
14832024-12-14T03:35:18.468ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = e0213694-1dcd-41cf-af41-e5a2b9e1a7a8 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
14842024-12-14T03:35:18.468ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = e0213694-1dcd-41cf-af41-e5a2b9e1a7a8 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
14852024-12-14T03:35:18.468ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = e0213694-1dcd-41cf-af41-e5a2b9e1a7a8 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
14862024-12-14T03:35:18.468ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = e0213694-1dcd-41cf-af41-e5a2b9e1a7a8 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
14872024-12-14T03:35:18.490ZINFOnexus (dropshot_internal): Inserted networking records for external_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = e0213694-1dcd-41cf-af41-e5a2b9e1a7a8 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
14882024-12-14T03:35:18.511ZINFOnexus (dropshot_internal): Inserted networking records for external_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = e0213694-1dcd-41cf-af41-e5a2b9e1a7a8 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
14892024-12-14T03:35:18.532ZINFOnexus (dropshot_internal): Inserted networking records for nexus service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = e0213694-1dcd-41cf-af41-e5a2b9e1a7a8 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
14902024-12-14T03:35:18.553ZINFOnexus (dropshot_internal): Inserted networking records for nexus service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = e0213694-1dcd-41cf-af41-e5a2b9e1a7a8 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
14912024-12-14T03:35:18.580ZINFOnexus (dropshot_internal): Inserted networking records for nexus service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = e0213694-1dcd-41cf-af41-e5a2b9e1a7a8 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
14922024-12-14T03:35:18.580ZINFOnexus (dropshot_internal): No networking records needed for oximeter service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = e0213694-1dcd-41cf-af41-e5a2b9e1a7a8 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
14932024-12-14T03:35:18.580ZINFOnexus (dropshot_internal): No networking records needed for clickhouse service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = e0213694-1dcd-41cf-af41-e5a2b9e1a7a8 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
14942024-12-14T03:35:18.580ZINFOnexus (dropshot_internal): No networking records needed for crucible_pantry service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = e0213694-1dcd-41cf-af41-e5a2b9e1a7a8 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
14952024-12-14T03:35:18.580ZINFOnexus (dropshot_internal): No networking records needed for crucible_pantry service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = e0213694-1dcd-41cf-af41-e5a2b9e1a7a8 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
14962024-12-14T03:35:18.580ZINFOnexus (dropshot_internal): No networking records needed for crucible_pantry service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = e0213694-1dcd-41cf-af41-e5a2b9e1a7a8 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
14972024-12-14T03:35:18.580ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = e0213694-1dcd-41cf-af41-e5a2b9e1a7a8 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
14982024-12-14T03:35:18.580ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = e0213694-1dcd-41cf-af41-e5a2b9e1a7a8 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
14992024-12-14T03:35:18.580ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = e0213694-1dcd-41cf-af41-e5a2b9e1a7a8 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
15002024-12-14T03:35:18.580ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = e0213694-1dcd-41cf-af41-e5a2b9e1a7a8 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
15012024-12-14T03:35:18.580ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = e0213694-1dcd-41cf-af41-e5a2b9e1a7a8 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
15022024-12-14T03:35:18.580ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = e0213694-1dcd-41cf-af41-e5a2b9e1a7a8 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
15032024-12-14T03:35:18.580ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = e0213694-1dcd-41cf-af41-e5a2b9e1a7a8 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
15042024-12-14T03:35:18.580ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = e0213694-1dcd-41cf-af41-e5a2b9e1a7a8 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
15052024-12-14T03:35:18.580ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = e0213694-1dcd-41cf-af41-e5a2b9e1a7a8 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
15062024-12-14T03:35:18.602ZINFOnexus (dropshot_internal): Inserted networking records for boundary_ntp service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = e0213694-1dcd-41cf-af41-e5a2b9e1a7a8 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
15072024-12-14T03:35:18.602ZINFOnexus (dropshot_internal): Inserted service networking records actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:809 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = e0213694-1dcd-41cf-af41-e5a2b9e1a7a8 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
15082024-12-14T03:35:18.602ZINFOnexus (dropshot_internal): physical disk upsert in handoff: PhysicalDisk { identity: PhysicalDiskIdentity { id: b81997dc-4390-4d6b-b937-ec142d15ce9e (physical_disk), time_created: 2024-12-14T03:35:18.356286462Z, time_modified: 2024-12-14T03:35:18.356286462Z, }, time_deleted: None, rcgen: Generation( Generation( 1, ), ), vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-U2", variant: U2, sled_id: 8d70e61c-94ed-41ce-b36c-cb904f92c534, disk_policy: InService, disk_state: Active, } actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:812 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = e0213694-1dcd-41cf-af41-e5a2b9e1a7a8 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
15092024-12-14T03:35:18.602ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = e0213694-1dcd-41cf-af41-e5a2b9e1a7a8 roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
15102024-12-14T03:35:18.602ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = e0213694-1dcd-41cf-af41-e5a2b9e1a7a8 resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
15112024-12-14T03:35:18.604ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = e0213694-1dcd-41cf-af41-e5a2b9e1a7a8 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
15122024-12-14T03:35:18.606ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = e0213694-1dcd-41cf-af41-e5a2b9e1a7a8 resource = Fleet result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
15132024-12-14T03:35:18.608ZERROnexus (dropshot_internal): Failed to upsert physical disk actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true err = Custom transaction error: Object (of type ById(8d70e61c-94ed-41ce-b36c-cb904f92c534)) not found: sled file = nexus/db-queries/src/db/datastore/rack.rs:816 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = e0213694-1dcd-41cf-af41-e5a2b9e1a7a8 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
15142024-12-14T03:35:18.614ZINFOnexus (dropshot_internal): request completed error_message_external = not found: sled with id "8d70e61c-94ed-41ce-b36c-cb904f92c534" error_message_internal = not found: sled with id "8d70e61c-94ed-41ce-b36c-cb904f92c534" file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 262597 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = e0213694-1dcd-41cf-af41-e5a2b9e1a7a8 response_code = 404 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
15152024-12-14T03:35:19.142ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
15162024-12-14T03:35:19.142ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
15172024-12-14T03:35:19.144ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
15182024-12-14T03:35:19.144ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
15192024-12-14T03:35:19.146ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15202024-12-14T03:35:19.148ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: a121ca05-bbee-41bf-b9db-9e03ff035200, lookup_type: ById(a121ca05-bbee-41bf-b9db-9e03ff035200) } result = Ok(())
15212024-12-14T03:35:19.148ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: a121ca05-bbee-41bf-b9db-9e03ff035200, time_created: 2024-12-14T03:34:57.145875Z, time_modified: 2024-12-14T03:34:57.145875Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
15222024-12-14T03:35:21.149ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
15232024-12-14T03:35:21.150ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
15242024-12-14T03:35:21.151ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
15252024-12-14T03:35:21.151ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
15262024-12-14T03:35:21.153ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15272024-12-14T03:35:21.155ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: a121ca05-bbee-41bf-b9db-9e03ff035200, lookup_type: ById(a121ca05-bbee-41bf-b9db-9e03ff035200) } result = Ok(())
15282024-12-14T03:35:21.155ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: a121ca05-bbee-41bf-b9db-9e03ff035200, time_created: 2024-12-14T03:34:57.145875Z, time_modified: 2024-12-14T03:34:57.145875Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
15292024-12-14T03:35:23.015ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = a52633c1-b120-42a9-b8bf-24a590a15686 roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
15302024-12-14T03:35:23.015ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = a52633c1-b120-42a9-b8bf-24a590a15686 resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
15312024-12-14T03:35:23.017ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = a52633c1-b120-42a9-b8bf-24a590a15686 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
15322024-12-14T03:35:23.018ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = a52633c1-b120-42a9-b8bf-24a590a15686 resource = Fleet result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
15332024-12-14T03:35:23.018ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = a52633c1-b120-42a9-b8bf-24a590a15686 roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
15342024-12-14T03:35:23.018ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = a52633c1-b120-42a9-b8bf-24a590a15686 resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
15352024-12-14T03:35:23.021ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = a52633c1-b120-42a9-b8bf-24a590a15686 roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
15362024-12-14T03:35:23.021ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = a52633c1-b120-42a9-b8bf-24a590a15686 resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
15372024-12-14T03:35:23.023ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = a52633c1-b120-42a9-b8bf-24a590a15686 roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
15382024-12-14T03:35:23.023ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = a52633c1-b120-42a9-b8bf-24a590a15686 resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
15392024-12-14T03:35:23.025ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = a52633c1-b120-42a9-b8bf-24a590a15686 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
15402024-12-14T03:35:23.027ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = a52633c1-b120-42a9-b8bf-24a590a15686 resource = Rack { parent: Fleet, key: a121ca05-bbee-41bf-b9db-9e03ff035200, lookup_type: ById(a121ca05-bbee-41bf-b9db-9e03ff035200) } result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
15412024-12-14T03:35:23.027ZDEBGnexus (dropshot_internal): updating rack subnet for rack a121ca05-bbee-41bf-b9db-9e03ff035200 to Some( V6( Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56, }, ), ) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = a52633c1-b120-42a9-b8bf-24a590a15686 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
15422024-12-14T03:35:23.027ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = a52633c1-b120-42a9-b8bf-24a590a15686 roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
15432024-12-14T03:35:23.027ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = a52633c1-b120-42a9-b8bf-24a590a15686 resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
15442024-12-14T03:35:23.032ZINFOnexus (dropshot_internal): Using automatic external switchport discovery actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:324 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = a52633c1-b120-42a9-b8bf-24a590a15686 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
15452024-12-14T03:35:23.063ZDEBGnexus (DpdClient): client request actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true body = None local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = a52633c1-b120-42a9-b8bf-24a590a15686 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
15462024-12-14T03:35:23.063ZDEBGnexus (DpdClient): client response actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = a52633c1-b120-42a9-b8bf-24a590a15686 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/ports", status: 200, headers: {"content-type": "application/json", "x-request-id": "b78e4cfc-0106-4cb4-bb1d-663ab05f17fe", "content-length": "24", "date": "Sat, 14 Dec 2024 03:35:22 GMT"} }) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
15472024-12-14T03:35:23.063ZINFOnexus (dropshot_internal): discovered ports for switch0: [ Internal( Internal( "int0", ), ), Rear( Rear( "rear0", ), ), Qsfp( Qsfp( "qsfp0", ), ), ] actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:344 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = a52633c1-b120-42a9-b8bf-24a590a15686 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
15482024-12-14T03:35:23.063ZINFOnexus (dropshot_internal): populating ports for switch0: [ Name( "qsfp0", ), ] actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:354 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = a52633c1-b120-42a9-b8bf-24a590a15686 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
15492024-12-14T03:35:23.063ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = a52633c1-b120-42a9-b8bf-24a590a15686 roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
15502024-12-14T03:35:23.063ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = a52633c1-b120-42a9-b8bf-24a590a15686 resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
15512024-12-14T03:35:23.074ZINFOnexus (dropshot_internal): Recording Rack Network Configuration actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:389 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = a52633c1-b120-42a9-b8bf-24a590a15686 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
15522024-12-14T03:35:23.074ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = a52633c1-b120-42a9-b8bf-24a590a15686 roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
15532024-12-14T03:35:23.074ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = a52633c1-b120-42a9-b8bf-24a590a15686 resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
15542024-12-14T03:35:23.077ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = a52633c1-b120-42a9-b8bf-24a590a15686 roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
15552024-12-14T03:35:23.078ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = a52633c1-b120-42a9-b8bf-24a590a15686 resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
15562024-12-14T03:35:23.080ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = a52633c1-b120-42a9-b8bf-24a590a15686 roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
15572024-12-14T03:35:23.081ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = a52633c1-b120-42a9-b8bf-24a590a15686 resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
15582024-12-14T03:35:23.082ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = a52633c1-b120-42a9-b8bf-24a590a15686 roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
15592024-12-14T03:35:23.082ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = a52633c1-b120-42a9-b8bf-24a590a15686 resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
15602024-12-14T03:35:23.083ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = a52633c1-b120-42a9-b8bf-24a590a15686 roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
15612024-12-14T03:35:23.083ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = a52633c1-b120-42a9-b8bf-24a590a15686 resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
15622024-12-14T03:35:23.086ZDEBGnexus (dropshot_internal): failed to check if bgp peer exists in switch port settings actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true error = NotFound local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = a52633c1-b120-42a9-b8bf-24a590a15686 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
15632024-12-14T03:35:23.087ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = a52633c1-b120-42a9-b8bf-24a590a15686 roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
15642024-12-14T03:35:23.087ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = a52633c1-b120-42a9-b8bf-24a590a15686 resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
15652024-12-14T03:35:23.088ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = a52633c1-b120-42a9-b8bf-24a590a15686 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
15662024-12-14T03:35:23.090ZDEBGnexus (dropshot_internal): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = a52633c1-b120-42a9-b8bf-24a590a15686 resource = Fleet result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
15672024-12-14T03:35:23.090ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = a52633c1-b120-42a9-b8bf-24a590a15686 roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
15682024-12-14T03:35:23.090ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = a52633c1-b120-42a9-b8bf-24a590a15686 resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
15692024-12-14T03:35:23.092ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = a52633c1-b120-42a9-b8bf-24a590a15686 roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
15702024-12-14T03:35:23.092ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = a52633c1-b120-42a9-b8bf-24a590a15686 resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
15712024-12-14T03:35:23.093ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = a52633c1-b120-42a9-b8bf-24a590a15686 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
15722024-12-14T03:35:23.096ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = a52633c1-b120-42a9-b8bf-24a590a15686 resource = IpPool { parent: Fleet, key: bdf4635b-d53e-4acb-8b1c-1769f4520d05, lookup_type: ByName("oxide-service-pool") } result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
15732024-12-14T03:35:23.096ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = a52633c1-b120-42a9-b8bf-24a590a15686 roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
15742024-12-14T03:35:23.096ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = a52633c1-b120-42a9-b8bf-24a590a15686 resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
15752024-12-14T03:35:23.097ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = a52633c1-b120-42a9-b8bf-24a590a15686 roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
15762024-12-14T03:35:23.097ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = a52633c1-b120-42a9-b8bf-24a590a15686 resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
15772024-12-14T03:35:23.098ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = a52633c1-b120-42a9-b8bf-24a590a15686 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
15782024-12-14T03:35:23.100ZDEBGnexus (dropshot_internal): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = a52633c1-b120-42a9-b8bf-24a590a15686 resource = IpPool { parent: Fleet, key: bdf4635b-d53e-4acb-8b1c-1769f4520d05, lookup_type: ByName("oxide-service-pool") } result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
15792024-12-14T03:35:23.106ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = a52633c1-b120-42a9-b8bf-24a590a15686 roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
15802024-12-14T03:35:23.106ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = a52633c1-b120-42a9-b8bf-24a590a15686 resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
15812024-12-14T03:35:23.107ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = a52633c1-b120-42a9-b8bf-24a590a15686 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
15822024-12-14T03:35:23.109ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = a52633c1-b120-42a9-b8bf-24a590a15686 resource = BlueprintConfig result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
15832024-12-14T03:35:23.127ZINFOnexus (dropshot_internal): inserted blueprint actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true blueprint_id = eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1 file = nexus/db-queries/src/db/datastore/deployment.rs:456 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = a52633c1-b120-42a9-b8bf-24a590a15686 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
15842024-12-14T03:35:23.128ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = a52633c1-b120-42a9-b8bf-24a590a15686 roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
15852024-12-14T03:35:23.128ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = a52633c1-b120-42a9-b8bf-24a590a15686 resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
15862024-12-14T03:35:23.129ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = a52633c1-b120-42a9-b8bf-24a590a15686 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
15872024-12-14T03:35:23.131ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = a52633c1-b120-42a9-b8bf-24a590a15686 resource = BlueprintConfig result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
15882024-12-14T03:35:23.135ZINFOnexus (dropshot_internal): No networking records needed for internal_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = a52633c1-b120-42a9-b8bf-24a590a15686 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
15892024-12-14T03:35:23.135ZINFOnexus (dropshot_internal): No networking records needed for internal_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = a52633c1-b120-42a9-b8bf-24a590a15686 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
15902024-12-14T03:35:23.135ZINFOnexus (dropshot_internal): No networking records needed for internal_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = a52633c1-b120-42a9-b8bf-24a590a15686 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
15912024-12-14T03:35:23.135ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = a52633c1-b120-42a9-b8bf-24a590a15686 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
15922024-12-14T03:35:23.135ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = a52633c1-b120-42a9-b8bf-24a590a15686 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
15932024-12-14T03:35:23.135ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = a52633c1-b120-42a9-b8bf-24a590a15686 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
15942024-12-14T03:35:23.135ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = a52633c1-b120-42a9-b8bf-24a590a15686 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
15952024-12-14T03:35:23.135ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = a52633c1-b120-42a9-b8bf-24a590a15686 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
15962024-12-14T03:35:23.156ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
15972024-12-14T03:35:23.156ZINFOnexus (dropshot_internal): Inserted networking records for external_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = a52633c1-b120-42a9-b8bf-24a590a15686 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
15982024-12-14T03:35:23.156ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
15992024-12-14T03:35:23.158ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
16002024-12-14T03:35:23.158ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
16012024-12-14T03:35:23.159ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16022024-12-14T03:35:23.162ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: a121ca05-bbee-41bf-b9db-9e03ff035200, lookup_type: ById(a121ca05-bbee-41bf-b9db-9e03ff035200) } result = Ok(())
16032024-12-14T03:35:23.162ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: a121ca05-bbee-41bf-b9db-9e03ff035200, time_created: 2024-12-14T03:34:57.145875Z, time_modified: 2024-12-14T03:34:57.145875Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
16042024-12-14T03:35:23.177ZINFOnexus (dropshot_internal): Inserted networking records for external_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = a52633c1-b120-42a9-b8bf-24a590a15686 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
16052024-12-14T03:35:23.200ZINFOnexus (dropshot_internal): Inserted networking records for nexus service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = a52633c1-b120-42a9-b8bf-24a590a15686 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
16062024-12-14T03:35:23.221ZINFOnexus (dropshot_internal): Inserted networking records for nexus service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = a52633c1-b120-42a9-b8bf-24a590a15686 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
16072024-12-14T03:35:23.243ZINFOnexus (dropshot_internal): Inserted networking records for nexus service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = a52633c1-b120-42a9-b8bf-24a590a15686 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
16082024-12-14T03:35:23.243ZINFOnexus (dropshot_internal): No networking records needed for oximeter service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = a52633c1-b120-42a9-b8bf-24a590a15686 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
16092024-12-14T03:35:23.244ZINFOnexus (dropshot_internal): No networking records needed for clickhouse service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = a52633c1-b120-42a9-b8bf-24a590a15686 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
16102024-12-14T03:35:23.244ZINFOnexus (dropshot_internal): No networking records needed for crucible_pantry service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = a52633c1-b120-42a9-b8bf-24a590a15686 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
16112024-12-14T03:35:23.244ZINFOnexus (dropshot_internal): No networking records needed for crucible_pantry service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = a52633c1-b120-42a9-b8bf-24a590a15686 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
16122024-12-14T03:35:23.244ZINFOnexus (dropshot_internal): No networking records needed for crucible_pantry service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = a52633c1-b120-42a9-b8bf-24a590a15686 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
16132024-12-14T03:35:23.244ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = a52633c1-b120-42a9-b8bf-24a590a15686 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
16142024-12-14T03:35:23.244ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = a52633c1-b120-42a9-b8bf-24a590a15686 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
16152024-12-14T03:35:23.244ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = a52633c1-b120-42a9-b8bf-24a590a15686 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
16162024-12-14T03:35:23.244ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = a52633c1-b120-42a9-b8bf-24a590a15686 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
16172024-12-14T03:35:23.244ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = a52633c1-b120-42a9-b8bf-24a590a15686 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
16182024-12-14T03:35:23.244ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = a52633c1-b120-42a9-b8bf-24a590a15686 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
16192024-12-14T03:35:23.244ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = a52633c1-b120-42a9-b8bf-24a590a15686 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
16202024-12-14T03:35:23.244ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = a52633c1-b120-42a9-b8bf-24a590a15686 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
16212024-12-14T03:35:23.244ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = a52633c1-b120-42a9-b8bf-24a590a15686 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
16222024-12-14T03:35:23.265ZINFOnexus (dropshot_internal): Inserted networking records for boundary_ntp service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = a52633c1-b120-42a9-b8bf-24a590a15686 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
16232024-12-14T03:35:23.265ZINFOnexus (dropshot_internal): Inserted service networking records actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:809 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = a52633c1-b120-42a9-b8bf-24a590a15686 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
16242024-12-14T03:35:23.265ZINFOnexus (dropshot_internal): physical disk upsert in handoff: PhysicalDisk { identity: PhysicalDiskIdentity { id: b81997dc-4390-4d6b-b937-ec142d15ce9e (physical_disk), time_created: 2024-12-14T03:35:23.018491495Z, time_modified: 2024-12-14T03:35:23.018491495Z, }, time_deleted: None, rcgen: Generation( Generation( 1, ), ), vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-U2", variant: U2, sled_id: 8d70e61c-94ed-41ce-b36c-cb904f92c534, disk_policy: InService, disk_state: Active, } actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:812 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = a52633c1-b120-42a9-b8bf-24a590a15686 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
16252024-12-14T03:35:23.265ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = a52633c1-b120-42a9-b8bf-24a590a15686 roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
16262024-12-14T03:35:23.265ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = a52633c1-b120-42a9-b8bf-24a590a15686 resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
16272024-12-14T03:35:23.267ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = a52633c1-b120-42a9-b8bf-24a590a15686 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
16282024-12-14T03:35:23.268ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = a52633c1-b120-42a9-b8bf-24a590a15686 resource = Fleet result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
16292024-12-14T03:35:23.271ZERROnexus (dropshot_internal): Failed to upsert physical disk actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true err = Custom transaction error: Object (of type ById(8d70e61c-94ed-41ce-b36c-cb904f92c534)) not found: sled file = nexus/db-queries/src/db/datastore/rack.rs:816 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = a52633c1-b120-42a9-b8bf-24a590a15686 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
16302024-12-14T03:35:23.277ZINFOnexus (dropshot_internal): request completed error_message_external = not found: sled with id "8d70e61c-94ed-41ce-b36c-cb904f92c534" error_message_internal = not found: sled with id "8d70e61c-94ed-41ce-b36c-cb904f92c534" file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 262563 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = a52633c1-b120-42a9-b8bf-24a590a15686 response_code = 404 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
16312024-12-14T03:35:25.163ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
16322024-12-14T03:35:25.164ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
16332024-12-14T03:35:25.165ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
16342024-12-14T03:35:25.165ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
16352024-12-14T03:35:25.167ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16362024-12-14T03:35:25.169ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: a121ca05-bbee-41bf-b9db-9e03ff035200, lookup_type: ById(a121ca05-bbee-41bf-b9db-9e03ff035200) } result = Ok(())
16372024-12-14T03:35:25.169ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: a121ca05-bbee-41bf-b9db-9e03ff035200, time_created: 2024-12-14T03:34:57.145875Z, time_modified: 2024-12-14T03:34:57.145875Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
16382024-12-14T03:35:25.600ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:56805 req_id = 08ef4876-f47e-469f-b5ba-5a5b60f73ce6 roles = RoleSet { roles: {} } uri = /metrics/collectors/a321e00a-3126-4ea4-b26d-c0e3eea69166/producers?sort_by=id_ascending
16392024-12-14T03:35:25.600ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:56805 req_id = 08ef4876-f47e-469f-b5ba-5a5b60f73ce6 resource = Database result = Ok(()) uri = /metrics/collectors/a321e00a-3126-4ea4-b26d-c0e3eea69166/producers?sort_by=id_ascending
16402024-12-14T03:35:25.602ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2934 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:56805 req_id = 08ef4876-f47e-469f-b5ba-5a5b60f73ce6 response_code = 200 uri = /metrics/collectors/a321e00a-3126-4ea4-b26d-c0e3eea69166/producers?sort_by=id_ascending
16412024-12-14T03:35:25.603ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:56805 req_id = 787a5fc9-d376-48c4-9bf3-f71b47f8297b roles = RoleSet { roles: {} } uri = /metrics/collectors/a321e00a-3126-4ea4-b26d-c0e3eea69166/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkMjc4ZjcxNy0zMzhmLTQ1ODYtOTIxMS00NjM2YmFhODIwMDQifX0%3D
16422024-12-14T03:35:25.603ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:56805 req_id = 787a5fc9-d376-48c4-9bf3-f71b47f8297b resource = Database result = Ok(()) uri = /metrics/collectors/a321e00a-3126-4ea4-b26d-c0e3eea69166/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkMjc4ZjcxNy0zMzhmLTQ1ODYtOTIxMS00NjM2YmFhODIwMDQifX0%3D
16432024-12-14T03:35:25.605ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2762 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:56805 req_id = 787a5fc9-d376-48c4-9bf3-f71b47f8297b response_code = 200 uri = /metrics/collectors/a321e00a-3126-4ea4-b26d-c0e3eea69166/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkMjc4ZjcxNy0zMzhmLTQ1ODYtOTIxMS00NjM2YmFhODIwMDQifX0%3D
16442024-12-14T03:35:26.344ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 2 reason = Timeout
16452024-12-14T03:35:26.345ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
16462024-12-14T03:35:26.345ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 2 reason = Timeout
16472024-12-14T03:35:26.345ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16482024-12-14T03:35:26.345ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 2 reason = Timeout
16492024-12-14T03:35:26.345ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
16502024-12-14T03:35:26.345ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 2 reason = Timeout
16512024-12-14T03:35:26.345ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 2 reason = Timeout
16522024-12-14T03:35:26.345ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
16532024-12-14T03:35:26.345ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 4 reason = Timeout
16542024-12-14T03:35:26.345ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
16552024-12-14T03:35:26.345ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
16562024-12-14T03:35:26.345ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16572024-12-14T03:35:26.345ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 2 reason = Timeout
16582024-12-14T03:35:26.345ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
16592024-12-14T03:35:26.345ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 2 reason = Timeout
16602024-12-14T03:35:26.345ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 3 reason = Timeout
16612024-12-14T03:35:26.345ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
16622024-12-14T03:35:26.345ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 2 reason = Timeout
16632024-12-14T03:35:26.345ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
16642024-12-14T03:35:26.345ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
16652024-12-14T03:35:26.345ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 2 reason = Timeout
16662024-12-14T03:35:26.345ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 2 reason = Timeout
16672024-12-14T03:35:26.345ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
16682024-12-14T03:35:26.345ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
16692024-12-14T03:35:26.345ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 4 reason = Timeout
16702024-12-14T03:35:26.345ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 2 reason = Timeout
16712024-12-14T03:35:26.345ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
16722024-12-14T03:35:26.345ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16732024-12-14T03:35:26.345ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 2 reason = Timeout
16742024-12-14T03:35:26.345ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
16752024-12-14T03:35:26.345ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 2 reason = Timeout
16762024-12-14T03:35:26.345ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
16772024-12-14T03:35:26.345ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 2 reason = Timeout
16782024-12-14T03:35:26.345ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
16792024-12-14T03:35:26.345ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
16802024-12-14T03:35:26.345ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16812024-12-14T03:35:26.345ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
16822024-12-14T03:35:26.345ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
16832024-12-14T03:35:26.345ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16842024-12-14T03:35:26.345ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
16852024-12-14T03:35:26.345ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
16862024-12-14T03:35:26.345ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
16872024-12-14T03:35:26.345ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
16882024-12-14T03:35:26.345ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
16892024-12-14T03:35:26.345ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
16902024-12-14T03:35:26.345ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
16912024-12-14T03:35:26.345ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
16922024-12-14T03:35:26.345ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
16932024-12-14T03:35:26.345ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
16942024-12-14T03:35:26.345ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16952024-12-14T03:35:26.347ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16962024-12-14T03:35:26.349ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16972024-12-14T03:35:26.349ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
16982024-12-14T03:35:26.349ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16992024-12-14T03:35:26.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
17002024-12-14T03:35:26.351ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
17012024-12-14T03:35:26.351ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17022024-12-14T03:35:26.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17032024-12-14T03:35:26.352ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17042024-12-14T03:35:26.353ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8d70e61c-94ed-41ce-b36c-cb904f92c534.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8d70e61c-94ed-41ce-b36c-cb904f92c534.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1132, tv_nsec: 673754419 } })
17052024-12-14T03:35:26.353ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
17062024-12-14T03:35:26.354ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17072024-12-14T03:35:26.356ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
17082024-12-14T03:35:26.356ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
17092024-12-14T03:35:26.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
17102024-12-14T03:35:26.357ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
17112024-12-14T03:35:26.357ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
17122024-12-14T03:35:26.358ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
17132024-12-14T03:35:26.360ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17142024-12-14T03:35:26.361ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17152024-12-14T03:35:26.361ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8d70e61c-94ed-41ce-b36c-cb904f92c534.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8d70e61c-94ed-41ce-b36c-cb904f92c534.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1132, tv_nsec: 682371932 } })
17162024-12-14T03:35:26.362ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
17172024-12-14T03:35:26.362ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 17.418319ms iteration = 2 status = {}
17182024-12-14T03:35:26.364ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
17192024-12-14T03:35:26.364ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17202024-12-14T03:35:26.364ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17212024-12-14T03:35:26.364ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
17222024-12-14T03:35:26.364ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
17232024-12-14T03:35:26.364ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
17242024-12-14T03:35:26.366ZWARNnexus (BackgroundTasks): failed to read target blueprint background_task = blueprint_loader error = Internal Error: no target blueprint set file = nexus/src/app/background/tasks/blueprint_load.rs:69
17252024-12-14T03:35:26.366ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.587783ms iteration = 4 status = {"error":"failed to read target blueprint: Internal Error: no target blueprint set"}
17262024-12-14T03:35:26.374ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
17272024-12-14T03:35:26.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
17282024-12-14T03:35:26.376ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 31.887369ms iteration = 2 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
17292024-12-14T03:35:26.380ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
17302024-12-14T03:35:26.381ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
17312024-12-14T03:35:26.390ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
17322024-12-14T03:35:26.390ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
17332024-12-14T03:35:26.391ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
17342024-12-14T03:35:26.391ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
17352024-12-14T03:35:26.391ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
17362024-12-14T03:35:26.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
17372024-12-14T03:35:26.394ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17382024-12-14T03:35:26.396ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
17392024-12-14T03:35:26.396ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
17402024-12-14T03:35:26.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
17412024-12-14T03:35:26.398ZINFOnexus (BackgroundTasks): Physical Disk Adoption: Rack not yet initialized background_task = physical_disk_adoption file = nexus/src/app/background/tasks/physical_disk_adoption.rs:80 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200
17422024-12-14T03:35:26.398ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 53.032352ms iteration = 3 status = {"error":"rack not yet initialized: a121ca05-bbee-41bf-b9db-9e03ff035200"}
17432024-12-14T03:35:26.400ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
17442024-12-14T03:35:26.400ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
17452024-12-14T03:35:26.401ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 55.823438ms iteration = 2 status = {"errors":[],"garbage_collect_requested":[]}
17462024-12-14T03:35:26.401ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "07554f78-60ef-4688-824f-00eb9487994a", "content-length": "26", "date": "Sat, 14 Dec 2024 03:35:26 GMT"} })
17472024-12-14T03:35:26.401ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
17482024-12-14T03:35:26.403ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
17492024-12-14T03:35:26.404ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 59.530613ms iteration = 2 status = {"errors":[],"records_set_to_done":[]}
17502024-12-14T03:35:26.405ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
17512024-12-14T03:35:26.405ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
17522024-12-14T03:35:26.405ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
17532024-12-14T03:35:26.405ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
17542024-12-14T03:35:26.407ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 62.632055ms iteration = 2 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
17552024-12-14T03:35:26.410ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
17562024-12-14T03:35:26.410ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 64.967402ms iteration = 2 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
17572024-12-14T03:35:26.412ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 67.340039ms iteration = 4 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
17582024-12-14T03:35:26.414ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
17592024-12-14T03:35:26.414ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
17602024-12-14T03:35:26.414ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "96cf0a5a-29c9-4ae6-a02b-dd57bb5c049a", "content-length": "26", "date": "Sat, 14 Dec 2024 03:35:26 GMT"} })
17612024-12-14T03:35:26.414ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
17622024-12-14T03:35:26.415ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
17632024-12-14T03:35:26.426ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
17642024-12-14T03:35:26.426ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
17652024-12-14T03:35:26.426ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
17662024-12-14T03:35:26.427ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
17672024-12-14T03:35:26.430ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
17682024-12-14T03:35:26.430ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
17692024-12-14T03:35:26.436ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 91.789178ms iteration = 2 status = {}
17702024-12-14T03:35:26.444ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 99.310299ms iteration = 2 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
17712024-12-14T03:35:26.461ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
17722024-12-14T03:35:26.461ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
17732024-12-14T03:35:26.461ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 116.33148ms iteration = 2 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
17742024-12-14T03:35:26.468ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 123.516034ms iteration = 2 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
17752024-12-14T03:35:26.479ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
17762024-12-14T03:35:26.479ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
17772024-12-14T03:35:26.506ZERROnexus (BackgroundTasks): nexus is running but no service zone nat values could be generated from inventory background_task = service_zone_nat_tracker file = nexus/src/app/background/tasks/sync_service_zone_nat.rs:257
17782024-12-14T03:35:26.506ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 161.524696ms iteration = 2 status = {"error":"nexus is running but no service zone nat values could be generated from inventory"}
17792024-12-14T03:35:26.512ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 167.72489ms iteration = 2 status = {}
17802024-12-14T03:35:26.523ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
17812024-12-14T03:35:26.524ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "04f2cb73-9dff-4e9d-a553-35229cc95f8a", "content-length": "1", "date": "Sat, 14 Dec 2024 03:35:26 GMT"} })
17822024-12-14T03:35:26.525ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
17832024-12-14T03:35:26.525ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
17842024-12-14T03:35:26.528ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 183.1837ms iteration = 2 status = null
17852024-12-14T03:35:26.574ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
17862024-12-14T03:35:26.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
17872024-12-14T03:35:26.576ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17882024-12-14T03:35:26.578ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
17892024-12-14T03:35:26.578ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
17902024-12-14T03:35:26.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
17912024-12-14T03:35:26.579ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17922024-12-14T03:35:26.581ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
17932024-12-14T03:35:26.581ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
17942024-12-14T03:35:26.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
17952024-12-14T03:35:26.584ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 238.925907ms iteration = 2 status = {}
17962024-12-14T03:35:27.170ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
17972024-12-14T03:35:27.170ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
17982024-12-14T03:35:27.172ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
17992024-12-14T03:35:27.172ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
18002024-12-14T03:35:27.173ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18012024-12-14T03:35:27.176ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: a121ca05-bbee-41bf-b9db-9e03ff035200, lookup_type: ById(a121ca05-bbee-41bf-b9db-9e03ff035200) } result = Ok(())
18022024-12-14T03:35:27.176ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: a121ca05-bbee-41bf-b9db-9e03ff035200, time_created: 2024-12-14T03:34:57.145875Z, time_modified: 2024-12-14T03:34:57.145875Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
18032024-12-14T03:35:29.178ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
18042024-12-14T03:35:29.178ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
18052024-12-14T03:35:29.180ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
18062024-12-14T03:35:29.180ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
18072024-12-14T03:35:29.182ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18082024-12-14T03:35:29.184ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: a121ca05-bbee-41bf-b9db-9e03ff035200, lookup_type: ById(a121ca05-bbee-41bf-b9db-9e03ff035200) } result = Ok(())
18092024-12-14T03:35:29.184ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: a121ca05-bbee-41bf-b9db-9e03ff035200, time_created: 2024-12-14T03:34:57.145875Z, time_modified: 2024-12-14T03:34:57.145875Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
18102024-12-14T03:35:29.759ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = d05d4717-2ca8-4274-aaf3-40926ea27a17 roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
18112024-12-14T03:35:29.759ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = d05d4717-2ca8-4274-aaf3-40926ea27a17 resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
18122024-12-14T03:35:29.761ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = d05d4717-2ca8-4274-aaf3-40926ea27a17 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
18132024-12-14T03:35:29.762ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = d05d4717-2ca8-4274-aaf3-40926ea27a17 resource = Fleet result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
18142024-12-14T03:35:29.762ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = d05d4717-2ca8-4274-aaf3-40926ea27a17 roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
18152024-12-14T03:35:29.762ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = d05d4717-2ca8-4274-aaf3-40926ea27a17 resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
18162024-12-14T03:35:29.765ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = d05d4717-2ca8-4274-aaf3-40926ea27a17 roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
18172024-12-14T03:35:29.766ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = d05d4717-2ca8-4274-aaf3-40926ea27a17 resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
18182024-12-14T03:35:29.767ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = d05d4717-2ca8-4274-aaf3-40926ea27a17 roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
18192024-12-14T03:35:29.767ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = d05d4717-2ca8-4274-aaf3-40926ea27a17 resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
18202024-12-14T03:35:29.769ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = d05d4717-2ca8-4274-aaf3-40926ea27a17 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
18212024-12-14T03:35:29.772ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = d05d4717-2ca8-4274-aaf3-40926ea27a17 resource = Rack { parent: Fleet, key: a121ca05-bbee-41bf-b9db-9e03ff035200, lookup_type: ById(a121ca05-bbee-41bf-b9db-9e03ff035200) } result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
18222024-12-14T03:35:29.772ZDEBGnexus (dropshot_internal): updating rack subnet for rack a121ca05-bbee-41bf-b9db-9e03ff035200 to Some( V6( Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56, }, ), ) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = d05d4717-2ca8-4274-aaf3-40926ea27a17 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
18232024-12-14T03:35:29.772ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = d05d4717-2ca8-4274-aaf3-40926ea27a17 roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
18242024-12-14T03:35:29.772ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = d05d4717-2ca8-4274-aaf3-40926ea27a17 resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
18252024-12-14T03:35:29.777ZINFOnexus (dropshot_internal): Using automatic external switchport discovery actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:324 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = d05d4717-2ca8-4274-aaf3-40926ea27a17 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
18262024-12-14T03:35:29.808ZDEBGnexus (DpdClient): client request actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true body = None local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = d05d4717-2ca8-4274-aaf3-40926ea27a17 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
18272024-12-14T03:35:29.808ZDEBGnexus (DpdClient): client response actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = d05d4717-2ca8-4274-aaf3-40926ea27a17 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/ports", status: 200, headers: {"content-type": "application/json", "x-request-id": "b269dd2b-2c11-4cf4-9f1e-9f3f588ffb29", "content-length": "24", "date": "Sat, 14 Dec 2024 03:35:29 GMT"} }) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
18282024-12-14T03:35:29.808ZINFOnexus (dropshot_internal): discovered ports for switch0: [ Internal( Internal( "int0", ), ), Rear( Rear( "rear0", ), ), Qsfp( Qsfp( "qsfp0", ), ), ] actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:344 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = d05d4717-2ca8-4274-aaf3-40926ea27a17 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
18292024-12-14T03:35:29.808ZINFOnexus (dropshot_internal): populating ports for switch0: [ Name( "qsfp0", ), ] actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:354 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = d05d4717-2ca8-4274-aaf3-40926ea27a17 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
18302024-12-14T03:35:29.808ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = d05d4717-2ca8-4274-aaf3-40926ea27a17 roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
18312024-12-14T03:35:29.808ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = d05d4717-2ca8-4274-aaf3-40926ea27a17 resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
18322024-12-14T03:35:29.817ZINFOnexus (dropshot_internal): Recording Rack Network Configuration actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:389 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = d05d4717-2ca8-4274-aaf3-40926ea27a17 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
18332024-12-14T03:35:29.817ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = d05d4717-2ca8-4274-aaf3-40926ea27a17 roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
18342024-12-14T03:35:29.818ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = d05d4717-2ca8-4274-aaf3-40926ea27a17 resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
18352024-12-14T03:35:29.822ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = d05d4717-2ca8-4274-aaf3-40926ea27a17 roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
18362024-12-14T03:35:29.822ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = d05d4717-2ca8-4274-aaf3-40926ea27a17 resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
18372024-12-14T03:35:29.825ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = d05d4717-2ca8-4274-aaf3-40926ea27a17 roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
18382024-12-14T03:35:29.825ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = d05d4717-2ca8-4274-aaf3-40926ea27a17 resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
18392024-12-14T03:35:29.827ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = d05d4717-2ca8-4274-aaf3-40926ea27a17 roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
18402024-12-14T03:35:29.827ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = d05d4717-2ca8-4274-aaf3-40926ea27a17 resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
18412024-12-14T03:35:29.828ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = d05d4717-2ca8-4274-aaf3-40926ea27a17 roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
18422024-12-14T03:35:29.828ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = d05d4717-2ca8-4274-aaf3-40926ea27a17 resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
18432024-12-14T03:35:29.831ZDEBGnexus (dropshot_internal): failed to check if bgp peer exists in switch port settings actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true error = NotFound local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = d05d4717-2ca8-4274-aaf3-40926ea27a17 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
18442024-12-14T03:35:29.832ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = d05d4717-2ca8-4274-aaf3-40926ea27a17 roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
18452024-12-14T03:35:29.833ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = d05d4717-2ca8-4274-aaf3-40926ea27a17 resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
18462024-12-14T03:35:29.834ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = d05d4717-2ca8-4274-aaf3-40926ea27a17 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
18472024-12-14T03:35:29.835ZDEBGnexus (dropshot_internal): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = d05d4717-2ca8-4274-aaf3-40926ea27a17 resource = Fleet result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
18482024-12-14T03:35:29.835ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = d05d4717-2ca8-4274-aaf3-40926ea27a17 roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
18492024-12-14T03:35:29.835ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = d05d4717-2ca8-4274-aaf3-40926ea27a17 resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
18502024-12-14T03:35:29.837ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = d05d4717-2ca8-4274-aaf3-40926ea27a17 roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
18512024-12-14T03:35:29.837ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = d05d4717-2ca8-4274-aaf3-40926ea27a17 resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
18522024-12-14T03:35:29.839ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = d05d4717-2ca8-4274-aaf3-40926ea27a17 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
18532024-12-14T03:35:29.841ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = d05d4717-2ca8-4274-aaf3-40926ea27a17 resource = IpPool { parent: Fleet, key: bdf4635b-d53e-4acb-8b1c-1769f4520d05, lookup_type: ByName("oxide-service-pool") } result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
18542024-12-14T03:35:29.841ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = d05d4717-2ca8-4274-aaf3-40926ea27a17 roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
18552024-12-14T03:35:29.841ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = d05d4717-2ca8-4274-aaf3-40926ea27a17 resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
18562024-12-14T03:35:29.843ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = d05d4717-2ca8-4274-aaf3-40926ea27a17 roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
18572024-12-14T03:35:29.843ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = d05d4717-2ca8-4274-aaf3-40926ea27a17 resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
18582024-12-14T03:35:29.844ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = d05d4717-2ca8-4274-aaf3-40926ea27a17 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
18592024-12-14T03:35:29.846ZDEBGnexus (dropshot_internal): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = d05d4717-2ca8-4274-aaf3-40926ea27a17 resource = IpPool { parent: Fleet, key: bdf4635b-d53e-4acb-8b1c-1769f4520d05, lookup_type: ByName("oxide-service-pool") } result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
18602024-12-14T03:35:29.850ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = d05d4717-2ca8-4274-aaf3-40926ea27a17 roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
18612024-12-14T03:35:29.850ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = d05d4717-2ca8-4274-aaf3-40926ea27a17 resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
18622024-12-14T03:35:29.851ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = d05d4717-2ca8-4274-aaf3-40926ea27a17 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
18632024-12-14T03:35:29.853ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = d05d4717-2ca8-4274-aaf3-40926ea27a17 resource = BlueprintConfig result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
18642024-12-14T03:35:29.929ZINFOnexus (dropshot_internal): inserted blueprint actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true blueprint_id = eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1 file = nexus/db-queries/src/db/datastore/deployment.rs:456 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = d05d4717-2ca8-4274-aaf3-40926ea27a17 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
18652024-12-14T03:35:29.929ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = d05d4717-2ca8-4274-aaf3-40926ea27a17 roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
18662024-12-14T03:35:29.929ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = d05d4717-2ca8-4274-aaf3-40926ea27a17 resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
18672024-12-14T03:35:29.930ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = d05d4717-2ca8-4274-aaf3-40926ea27a17 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
18682024-12-14T03:35:29.932ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = d05d4717-2ca8-4274-aaf3-40926ea27a17 resource = BlueprintConfig result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
18692024-12-14T03:35:29.935ZINFOnexus (dropshot_internal): No networking records needed for internal_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = d05d4717-2ca8-4274-aaf3-40926ea27a17 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
18702024-12-14T03:35:29.935ZINFOnexus (dropshot_internal): No networking records needed for internal_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = d05d4717-2ca8-4274-aaf3-40926ea27a17 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
18712024-12-14T03:35:29.935ZINFOnexus (dropshot_internal): No networking records needed for internal_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = d05d4717-2ca8-4274-aaf3-40926ea27a17 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
18722024-12-14T03:35:29.935ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = d05d4717-2ca8-4274-aaf3-40926ea27a17 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
18732024-12-14T03:35:29.935ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = d05d4717-2ca8-4274-aaf3-40926ea27a17 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
18742024-12-14T03:35:29.935ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = d05d4717-2ca8-4274-aaf3-40926ea27a17 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
18752024-12-14T03:35:29.935ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = d05d4717-2ca8-4274-aaf3-40926ea27a17 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
18762024-12-14T03:35:29.935ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = d05d4717-2ca8-4274-aaf3-40926ea27a17 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
18772024-12-14T03:35:29.980ZINFOnexus (dropshot_internal): Inserted networking records for external_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = d05d4717-2ca8-4274-aaf3-40926ea27a17 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
18782024-12-14T03:35:29.996ZINFOnexus (dropshot_internal): Inserted networking records for external_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = d05d4717-2ca8-4274-aaf3-40926ea27a17 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
18792024-12-14T03:35:30.010ZINFOnexus (dropshot_internal): Inserted networking records for nexus service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = d05d4717-2ca8-4274-aaf3-40926ea27a17 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
18802024-12-14T03:35:30.026ZINFOnexus (dropshot_internal): Inserted networking records for nexus service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = d05d4717-2ca8-4274-aaf3-40926ea27a17 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
18812024-12-14T03:35:30.042ZINFOnexus (dropshot_internal): Inserted networking records for nexus service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = d05d4717-2ca8-4274-aaf3-40926ea27a17 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
18822024-12-14T03:35:30.042ZINFOnexus (dropshot_internal): No networking records needed for oximeter service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = d05d4717-2ca8-4274-aaf3-40926ea27a17 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
18832024-12-14T03:35:30.042ZINFOnexus (dropshot_internal): No networking records needed for clickhouse service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = d05d4717-2ca8-4274-aaf3-40926ea27a17 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
18842024-12-14T03:35:30.042ZINFOnexus (dropshot_internal): No networking records needed for crucible_pantry service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = d05d4717-2ca8-4274-aaf3-40926ea27a17 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
18852024-12-14T03:35:30.042ZINFOnexus (dropshot_internal): No networking records needed for crucible_pantry service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = d05d4717-2ca8-4274-aaf3-40926ea27a17 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
18862024-12-14T03:35:30.042ZINFOnexus (dropshot_internal): No networking records needed for crucible_pantry service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = d05d4717-2ca8-4274-aaf3-40926ea27a17 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
18872024-12-14T03:35:30.042ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = d05d4717-2ca8-4274-aaf3-40926ea27a17 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
18882024-12-14T03:35:30.042ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = d05d4717-2ca8-4274-aaf3-40926ea27a17 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
18892024-12-14T03:35:30.042ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = d05d4717-2ca8-4274-aaf3-40926ea27a17 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
18902024-12-14T03:35:30.042ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = d05d4717-2ca8-4274-aaf3-40926ea27a17 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
18912024-12-14T03:35:30.042ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = d05d4717-2ca8-4274-aaf3-40926ea27a17 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
18922024-12-14T03:35:30.042ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = d05d4717-2ca8-4274-aaf3-40926ea27a17 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
18932024-12-14T03:35:30.042ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = d05d4717-2ca8-4274-aaf3-40926ea27a17 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
18942024-12-14T03:35:30.042ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = d05d4717-2ca8-4274-aaf3-40926ea27a17 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
18952024-12-14T03:35:30.042ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = d05d4717-2ca8-4274-aaf3-40926ea27a17 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
18962024-12-14T03:35:30.057ZINFOnexus (dropshot_internal): Inserted networking records for boundary_ntp service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = d05d4717-2ca8-4274-aaf3-40926ea27a17 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
18972024-12-14T03:35:30.057ZINFOnexus (dropshot_internal): Inserted service networking records actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:809 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = d05d4717-2ca8-4274-aaf3-40926ea27a17 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
18982024-12-14T03:35:30.057ZINFOnexus (dropshot_internal): physical disk upsert in handoff: PhysicalDisk { identity: PhysicalDiskIdentity { id: b81997dc-4390-4d6b-b937-ec142d15ce9e (physical_disk), time_created: 2024-12-14T03:35:29.762700818Z, time_modified: 2024-12-14T03:35:29.762700818Z, }, time_deleted: None, rcgen: Generation( Generation( 1, ), ), vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-U2", variant: U2, sled_id: 8d70e61c-94ed-41ce-b36c-cb904f92c534, disk_policy: InService, disk_state: Active, } actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:812 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = d05d4717-2ca8-4274-aaf3-40926ea27a17 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
18992024-12-14T03:35:30.057ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = d05d4717-2ca8-4274-aaf3-40926ea27a17 roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
19002024-12-14T03:35:30.058ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = d05d4717-2ca8-4274-aaf3-40926ea27a17 resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
19012024-12-14T03:35:30.059ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = d05d4717-2ca8-4274-aaf3-40926ea27a17 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
19022024-12-14T03:35:30.061ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = d05d4717-2ca8-4274-aaf3-40926ea27a17 resource = Fleet result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
19032024-12-14T03:35:30.078ZERROnexus (dropshot_internal): Failed to upsert physical disk actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true err = Custom transaction error: Object (of type ById(8d70e61c-94ed-41ce-b36c-cb904f92c534)) not found: sled file = nexus/db-queries/src/db/datastore/rack.rs:816 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = d05d4717-2ca8-4274-aaf3-40926ea27a17 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
19042024-12-14T03:35:30.083ZINFOnexus (dropshot_internal): request completed error_message_external = not found: sled with id "8d70e61c-94ed-41ce-b36c-cb904f92c534" error_message_internal = not found: sled with id "8d70e61c-94ed-41ce-b36c-cb904f92c534" file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 324872 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = d05d4717-2ca8-4274-aaf3-40926ea27a17 response_code = 404 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
19052024-12-14T03:35:31.186ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
19062024-12-14T03:35:31.186ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
19072024-12-14T03:35:31.187ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
19082024-12-14T03:35:31.188ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
19092024-12-14T03:35:31.190ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19102024-12-14T03:35:31.192ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: a121ca05-bbee-41bf-b9db-9e03ff035200, lookup_type: ById(a121ca05-bbee-41bf-b9db-9e03ff035200) } result = Ok(())
19112024-12-14T03:35:31.192ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: a121ca05-bbee-41bf-b9db-9e03ff035200, time_created: 2024-12-14T03:34:57.145875Z, time_modified: 2024-12-14T03:34:57.145875Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
19122024-12-14T03:35:33.193ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
19132024-12-14T03:35:33.193ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
19142024-12-14T03:35:33.195ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
19152024-12-14T03:35:33.195ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
19162024-12-14T03:35:33.197ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19172024-12-14T03:35:33.199ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: a121ca05-bbee-41bf-b9db-9e03ff035200, lookup_type: ById(a121ca05-bbee-41bf-b9db-9e03ff035200) } result = Ok(())
19182024-12-14T03:35:33.199ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: a121ca05-bbee-41bf-b9db-9e03ff035200, time_created: 2024-12-14T03:34:57.145875Z, time_modified: 2024-12-14T03:34:57.145875Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
19192024-12-14T03:35:35.201ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
19202024-12-14T03:35:35.201ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
19212024-12-14T03:35:35.202ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
19222024-12-14T03:35:35.203ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
19232024-12-14T03:35:35.204ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19242024-12-14T03:35:35.207ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: a121ca05-bbee-41bf-b9db-9e03ff035200, lookup_type: ById(a121ca05-bbee-41bf-b9db-9e03ff035200) } result = Ok(())
19252024-12-14T03:35:35.207ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: a121ca05-bbee-41bf-b9db-9e03ff035200, time_created: 2024-12-14T03:34:57.145875Z, time_modified: 2024-12-14T03:34:57.145875Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
19262024-12-14T03:35:36.344ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 5 reason = Timeout
19272024-12-14T03:35:36.344ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 5 reason = Timeout
19282024-12-14T03:35:36.344ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
19292024-12-14T03:35:36.344ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19302024-12-14T03:35:36.344ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19312024-12-14T03:35:36.344ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
19322024-12-14T03:35:36.346ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19332024-12-14T03:35:36.349ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
19342024-12-14T03:35:36.349ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19352024-12-14T03:35:36.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19362024-12-14T03:35:36.351ZWARNnexus (BackgroundTasks): failed to read target blueprint background_task = blueprint_loader error = Internal Error: no target blueprint set file = nexus/src/app/background/tasks/blueprint_load.rs:69
19372024-12-14T03:35:36.351ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 7.272956ms iteration = 5 status = {"error":"failed to read target blueprint: Internal Error: no target blueprint set"}
19382024-12-14T03:35:36.379ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
19392024-12-14T03:35:36.379ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
19402024-12-14T03:35:36.380ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 36.652074ms iteration = 5 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
19412024-12-14T03:35:37.208ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
19422024-12-14T03:35:37.208ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
19432024-12-14T03:35:37.209ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
19442024-12-14T03:35:37.209ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
19452024-12-14T03:35:37.211ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19462024-12-14T03:35:37.213ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: a121ca05-bbee-41bf-b9db-9e03ff035200, lookup_type: ById(a121ca05-bbee-41bf-b9db-9e03ff035200) } result = Ok(())
19472024-12-14T03:35:37.213ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: a121ca05-bbee-41bf-b9db-9e03ff035200, time_created: 2024-12-14T03:34:57.145875Z, time_modified: 2024-12-14T03:34:57.145875Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
19482024-12-14T03:35:38.529ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:42883
19492024-12-14T03:35:38.529ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:42883 req_id = cda68aa5-dd61-4322-af9b-c99e52a31038 roles = RoleSet { roles: {} } uri = /metrics/producers
19502024-12-14T03:35:38.529ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:42883 req_id = cda68aa5-dd61-4322-af9b-c99e52a31038 resource = Database result = Ok(()) uri = /metrics/producers
19512024-12-14T03:35:38.595ZINFOnexus: assigned collector to new producer collector_id = a321e00a-3126-4ea4-b26d-c0e3eea69166 file = nexus/src/app/oximeter.rs:76 producer_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534
19522024-12-14T03:35:38.595ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 66207 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:42883 req_id = cda68aa5-dd61-4322-af9b-c99e52a31038 response_code = 201 uri = /metrics/producers
19532024-12-14T03:35:39.214ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
19542024-12-14T03:35:39.215ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
19552024-12-14T03:35:39.216ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
19562024-12-14T03:35:39.217ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
19572024-12-14T03:35:39.218ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19582024-12-14T03:35:39.221ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: a121ca05-bbee-41bf-b9db-9e03ff035200, lookup_type: ById(a121ca05-bbee-41bf-b9db-9e03ff035200) } result = Ok(())
19592024-12-14T03:35:39.221ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: a121ca05-bbee-41bf-b9db-9e03ff035200, time_created: 2024-12-14T03:34:57.145875Z, time_modified: 2024-12-14T03:34:57.145875Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
19602024-12-14T03:35:40.101ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
19612024-12-14T03:35:40.101ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
19622024-12-14T03:35:40.103ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
19632024-12-14T03:35:40.104ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e resource = Fleet result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
19642024-12-14T03:35:40.104ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
19652024-12-14T03:35:40.104ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
19662024-12-14T03:35:40.107ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
19672024-12-14T03:35:40.107ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
19682024-12-14T03:35:40.109ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
19692024-12-14T03:35:40.109ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
19702024-12-14T03:35:40.111ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
19712024-12-14T03:35:40.114ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e resource = Rack { parent: Fleet, key: a121ca05-bbee-41bf-b9db-9e03ff035200, lookup_type: ById(a121ca05-bbee-41bf-b9db-9e03ff035200) } result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
19722024-12-14T03:35:40.114ZDEBGnexus (dropshot_internal): updating rack subnet for rack a121ca05-bbee-41bf-b9db-9e03ff035200 to Some( V6( Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56, }, ), ) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
19732024-12-14T03:35:40.114ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
19742024-12-14T03:35:40.114ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
19752024-12-14T03:35:40.118ZINFOnexus (dropshot_internal): Using automatic external switchport discovery actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:324 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
19762024-12-14T03:35:40.149ZDEBGnexus (DpdClient): client request actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true body = None local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
19772024-12-14T03:35:40.149ZDEBGnexus (DpdClient): client response actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/ports", status: 200, headers: {"content-type": "application/json", "x-request-id": "b4c7b68f-c3fd-4761-a1a9-0dbc22c6d426", "content-length": "24", "date": "Sat, 14 Dec 2024 03:35:39 GMT"} }) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
19782024-12-14T03:35:40.149ZINFOnexus (dropshot_internal): discovered ports for switch0: [ Internal( Internal( "int0", ), ), Rear( Rear( "rear0", ), ), Qsfp( Qsfp( "qsfp0", ), ), ] actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:344 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
19792024-12-14T03:35:40.149ZINFOnexus (dropshot_internal): populating ports for switch0: [ Name( "qsfp0", ), ] actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:354 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
19802024-12-14T03:35:40.149ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
19812024-12-14T03:35:40.149ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
19822024-12-14T03:35:40.159ZINFOnexus (dropshot_internal): Recording Rack Network Configuration actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:389 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
19832024-12-14T03:35:40.159ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
19842024-12-14T03:35:40.159ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
19852024-12-14T03:35:40.163ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
19862024-12-14T03:35:40.163ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
19872024-12-14T03:35:40.166ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
19882024-12-14T03:35:40.167ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
19892024-12-14T03:35:40.168ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
19902024-12-14T03:35:40.168ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
19912024-12-14T03:35:40.170ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
19922024-12-14T03:35:40.170ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
19932024-12-14T03:35:40.173ZDEBGnexus (dropshot_internal): failed to check if bgp peer exists in switch port settings actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true error = NotFound local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
19942024-12-14T03:35:40.174ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
19952024-12-14T03:35:40.175ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
19962024-12-14T03:35:40.176ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
19972024-12-14T03:35:40.177ZDEBGnexus (dropshot_internal): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e resource = Fleet result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
19982024-12-14T03:35:40.177ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
19992024-12-14T03:35:40.178ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
20002024-12-14T03:35:40.180ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
20012024-12-14T03:35:40.180ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
20022024-12-14T03:35:40.181ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
20032024-12-14T03:35:40.184ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e resource = IpPool { parent: Fleet, key: bdf4635b-d53e-4acb-8b1c-1769f4520d05, lookup_type: ByName("oxide-service-pool") } result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
20042024-12-14T03:35:40.184ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
20052024-12-14T03:35:40.184ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
20062024-12-14T03:35:40.185ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
20072024-12-14T03:35:40.185ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
20082024-12-14T03:35:40.186ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
20092024-12-14T03:35:40.188ZDEBGnexus (dropshot_internal): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e resource = IpPool { parent: Fleet, key: bdf4635b-d53e-4acb-8b1c-1769f4520d05, lookup_type: ByName("oxide-service-pool") } result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
20102024-12-14T03:35:40.196ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
20112024-12-14T03:35:40.197ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
20122024-12-14T03:35:40.198ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
20132024-12-14T03:35:40.200ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e resource = BlueprintConfig result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
20142024-12-14T03:35:40.216ZINFOnexus (dropshot_internal): inserted blueprint actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true blueprint_id = eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1 file = nexus/db-queries/src/db/datastore/deployment.rs:456 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
20152024-12-14T03:35:40.216ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
20162024-12-14T03:35:40.217ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
20172024-12-14T03:35:40.218ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
20182024-12-14T03:35:40.220ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e resource = BlueprintConfig result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
20192024-12-14T03:35:40.224ZINFOnexus (dropshot_internal): No networking records needed for internal_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
20202024-12-14T03:35:40.224ZINFOnexus (dropshot_internal): No networking records needed for internal_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
20212024-12-14T03:35:40.224ZINFOnexus (dropshot_internal): No networking records needed for internal_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
20222024-12-14T03:35:40.224ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
20232024-12-14T03:35:40.224ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
20242024-12-14T03:35:40.224ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
20252024-12-14T03:35:40.224ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
20262024-12-14T03:35:40.224ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
20272024-12-14T03:35:40.252ZINFOnexus (dropshot_internal): Inserted networking records for external_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
20282024-12-14T03:35:40.277ZINFOnexus (dropshot_internal): Inserted networking records for external_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
20292024-12-14T03:35:40.300ZINFOnexus (dropshot_internal): Inserted networking records for nexus service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
20302024-12-14T03:35:40.322ZINFOnexus (dropshot_internal): Inserted networking records for nexus service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
20312024-12-14T03:35:40.344ZINFOnexus (dropshot_internal): Inserted networking records for nexus service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
20322024-12-14T03:35:40.344ZINFOnexus (dropshot_internal): No networking records needed for oximeter service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
20332024-12-14T03:35:40.344ZINFOnexus (dropshot_internal): No networking records needed for clickhouse service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
20342024-12-14T03:35:40.344ZINFOnexus (dropshot_internal): No networking records needed for crucible_pantry service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
20352024-12-14T03:35:40.344ZINFOnexus (dropshot_internal): No networking records needed for crucible_pantry service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
20362024-12-14T03:35:40.344ZINFOnexus (dropshot_internal): No networking records needed for crucible_pantry service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
20372024-12-14T03:35:40.344ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
20382024-12-14T03:35:40.344ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
20392024-12-14T03:35:40.344ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
20402024-12-14T03:35:40.344ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
20412024-12-14T03:35:40.344ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
20422024-12-14T03:35:40.344ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
20432024-12-14T03:35:40.344ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
20442024-12-14T03:35:40.344ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
20452024-12-14T03:35:40.344ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
20462024-12-14T03:35:40.366ZINFOnexus (dropshot_internal): Inserted networking records for boundary_ntp service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
20472024-12-14T03:35:40.366ZINFOnexus (dropshot_internal): Inserted service networking records actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:809 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
20482024-12-14T03:35:40.366ZINFOnexus (dropshot_internal): physical disk upsert in handoff: PhysicalDisk { identity: PhysicalDiskIdentity { id: b81997dc-4390-4d6b-b937-ec142d15ce9e (physical_disk), time_created: 2024-12-14T03:35:40.104800039Z, time_modified: 2024-12-14T03:35:40.104800039Z, }, time_deleted: None, rcgen: Generation( Generation( 1, ), ), vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-U2", variant: U2, sled_id: 8d70e61c-94ed-41ce-b36c-cb904f92c534, disk_policy: InService, disk_state: Active, } actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:812 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
20492024-12-14T03:35:40.366ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
20502024-12-14T03:35:40.366ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
20512024-12-14T03:35:40.368ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
20522024-12-14T03:35:40.370ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e resource = Fleet result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
20532024-12-14T03:35:40.377ZINFOnexus (dropshot_internal): physical disk upsert in handoff: PhysicalDisk { identity: PhysicalDiskIdentity { id: f83e9603-e3a8-47da-9504-66a4bf4099ca (physical_disk), time_created: 2024-12-14T03:35:40.104800376Z, time_modified: 2024-12-14T03:35:40.104800376Z, }, time_deleted: None, rcgen: Generation( Generation( 1, ), ), vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-U2", variant: U2, sled_id: 8d70e61c-94ed-41ce-b36c-cb904f92c534, disk_policy: InService, disk_state: Active, } actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:812 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
20542024-12-14T03:35:40.377ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
20552024-12-14T03:35:40.377ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
20562024-12-14T03:35:40.378ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
20572024-12-14T03:35:40.380ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e resource = Fleet result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
20582024-12-14T03:35:40.384ZINFOnexus (dropshot_internal): physical disk upsert in handoff: PhysicalDisk { identity: PhysicalDiskIdentity { id: cd382e0d-1a14-4b5e-af68-9b0f91136cdd (physical_disk), time_created: 2024-12-14T03:35:40.104800470Z, time_modified: 2024-12-14T03:35:40.104800470Z, }, time_deleted: None, rcgen: Generation( Generation( 1, ), ), vendor: "synthetic-vendor", serial: "synthetic-serial-2", model: "synthetic-model-U2", variant: U2, sled_id: 8d70e61c-94ed-41ce-b36c-cb904f92c534, disk_policy: InService, disk_state: Active, } actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:812 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
20592024-12-14T03:35:40.384ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
20602024-12-14T03:35:40.384ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
20612024-12-14T03:35:40.386ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
20622024-12-14T03:35:40.388ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e resource = Fleet result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
20632024-12-14T03:35:40.392ZINFOnexus (dropshot_internal): physical disk upsert in handoff: PhysicalDisk { identity: PhysicalDiskIdentity { id: 886cad8d-5ef0-4fe6-8a6e-ad6ec9f45ac2 (physical_disk), time_created: 2024-12-14T03:35:40.104800545Z, time_modified: 2024-12-14T03:35:40.104800545Z, }, time_deleted: None, rcgen: Generation( Generation( 1, ), ), vendor: "synthetic-vendor", serial: "synthetic-serial-3", model: "synthetic-model-U2", variant: U2, sled_id: 8d70e61c-94ed-41ce-b36c-cb904f92c534, disk_policy: InService, disk_state: Active, } actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:812 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
20642024-12-14T03:35:40.392ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
20652024-12-14T03:35:40.392ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
20662024-12-14T03:35:40.394ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
20672024-12-14T03:35:40.395ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e resource = Fleet result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
20682024-12-14T03:35:40.399ZINFOnexus (dropshot_internal): physical disk upsert in handoff: PhysicalDisk { identity: PhysicalDiskIdentity { id: f81a2509-d51f-44fb-a2b7-97691d2615b9 (physical_disk), time_created: 2024-12-14T03:35:40.104800620Z, time_modified: 2024-12-14T03:35:40.104800620Z, }, time_deleted: None, rcgen: Generation( Generation( 1, ), ), vendor: "synthetic-vendor", serial: "synthetic-serial-4", model: "synthetic-model-U2", variant: U2, sled_id: 8d70e61c-94ed-41ce-b36c-cb904f92c534, disk_policy: InService, disk_state: Active, } actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:812 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
20692024-12-14T03:35:40.399ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
20702024-12-14T03:35:40.400ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
20712024-12-14T03:35:40.401ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
20722024-12-14T03:35:40.403ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e resource = Fleet result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
20732024-12-14T03:35:40.406ZINFOnexus (dropshot_internal): physical disk upsert in handoff: PhysicalDisk { identity: PhysicalDiskIdentity { id: 898c34fb-d713-4e9e-b455-a2586f2fe214 (physical_disk), time_created: 2024-12-14T03:35:40.104800695Z, time_modified: 2024-12-14T03:35:40.104800695Z, }, time_deleted: None, rcgen: Generation( Generation( 1, ), ), vendor: "synthetic-vendor", serial: "synthetic-serial-5", model: "synthetic-model-U2", variant: U2, sled_id: 8d70e61c-94ed-41ce-b36c-cb904f92c534, disk_policy: InService, disk_state: Active, } actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:812 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
20742024-12-14T03:35:40.407ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
20752024-12-14T03:35:40.407ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
20762024-12-14T03:35:40.408ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
20772024-12-14T03:35:40.410ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e resource = Fleet result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
20782024-12-14T03:35:40.414ZINFOnexus (dropshot_internal): physical disk upsert in handoff: PhysicalDisk { identity: PhysicalDiskIdentity { id: 2b6bea95-f700-492c-a5c6-767c15932ae4 (physical_disk), time_created: 2024-12-14T03:35:40.104800770Z, time_modified: 2024-12-14T03:35:40.104800770Z, }, time_deleted: None, rcgen: Generation( Generation( 1, ), ), vendor: "synthetic-vendor", serial: "synthetic-serial-6", model: "synthetic-model-U2", variant: U2, sled_id: 8d70e61c-94ed-41ce-b36c-cb904f92c534, disk_policy: InService, disk_state: Active, } actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:812 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
20792024-12-14T03:35:40.414ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
20802024-12-14T03:35:40.414ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
20812024-12-14T03:35:40.415ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
20822024-12-14T03:35:40.417ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e resource = Fleet result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
20832024-12-14T03:35:40.421ZINFOnexus (dropshot_internal): physical disk upsert in handoff: PhysicalDisk { identity: PhysicalDiskIdentity { id: e8b2158c-1495-41ac-9d9c-7411ad62587c (physical_disk), time_created: 2024-12-14T03:35:40.104800835Z, time_modified: 2024-12-14T03:35:40.104800835Z, }, time_deleted: None, rcgen: Generation( Generation( 1, ), ), vendor: "synthetic-vendor", serial: "synthetic-serial-7", model: "synthetic-model-U2", variant: U2, sled_id: 8d70e61c-94ed-41ce-b36c-cb904f92c534, disk_policy: InService, disk_state: Active, } actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:812 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
20842024-12-14T03:35:40.421ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
20852024-12-14T03:35:40.421ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
20862024-12-14T03:35:40.423ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
20872024-12-14T03:35:40.425ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e resource = Fleet result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
20882024-12-14T03:35:40.429ZINFOnexus (dropshot_internal): physical disk upsert in handoff: PhysicalDisk { identity: PhysicalDiskIdentity { id: 3be7b2b6-00f9-4c64-88a0-59eefb81e64b (physical_disk), time_created: 2024-12-14T03:35:40.104800910Z, time_modified: 2024-12-14T03:35:40.104800910Z, }, time_deleted: None, rcgen: Generation( Generation( 1, ), ), vendor: "synthetic-vendor", serial: "synthetic-serial-8", model: "synthetic-model-U2", variant: U2, sled_id: 8d70e61c-94ed-41ce-b36c-cb904f92c534, disk_policy: InService, disk_state: Active, } actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:812 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
20892024-12-14T03:35:40.429ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
20902024-12-14T03:35:40.429ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
20912024-12-14T03:35:40.430ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
20922024-12-14T03:35:40.432ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e resource = Fleet result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
20932024-12-14T03:35:40.436ZINFOnexus (dropshot_internal): Inserted physical disks actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:824 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
20942024-12-14T03:35:40.436ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
20952024-12-14T03:35:40.437ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
20962024-12-14T03:35:40.438ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
20972024-12-14T03:35:40.439ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e resource = Fleet result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
20982024-12-14T03:35:40.445ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
20992024-12-14T03:35:40.446ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
21002024-12-14T03:35:40.447ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
21012024-12-14T03:35:40.448ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e resource = Fleet result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
21022024-12-14T03:35:40.453ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
21032024-12-14T03:35:40.453ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
21042024-12-14T03:35:40.454ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
21052024-12-14T03:35:40.455ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e resource = Fleet result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
21062024-12-14T03:35:40.460ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
21072024-12-14T03:35:40.460ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
21082024-12-14T03:35:40.461ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
21092024-12-14T03:35:40.462ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e resource = Fleet result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
21102024-12-14T03:35:40.467ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
21112024-12-14T03:35:40.467ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
21122024-12-14T03:35:40.468ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
21132024-12-14T03:35:40.469ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e resource = Fleet result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
21142024-12-14T03:35:40.474ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
21152024-12-14T03:35:40.474ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
21162024-12-14T03:35:40.475ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
21172024-12-14T03:35:40.476ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e resource = Fleet result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
21182024-12-14T03:35:40.481ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
21192024-12-14T03:35:40.481ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
21202024-12-14T03:35:40.482ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
21212024-12-14T03:35:40.483ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e resource = Fleet result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
21222024-12-14T03:35:40.487ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
21232024-12-14T03:35:40.488ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
21242024-12-14T03:35:40.489ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
21252024-12-14T03:35:40.490ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e resource = Fleet result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
21262024-12-14T03:35:40.494ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
21272024-12-14T03:35:40.494ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
21282024-12-14T03:35:40.496ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
21292024-12-14T03:35:40.497ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e resource = Fleet result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
21302024-12-14T03:35:40.501ZINFOnexus (dropshot_internal): Inserted zpools actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:836 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
21312024-12-14T03:35:40.791ZINFOnexus (dropshot_internal): Inserted datasets actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:866 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
21322024-12-14T03:35:40.845ZINFOnexus (dropshot_internal): Populated DNS tables for internal DNS actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:877 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
21332024-12-14T03:35:40.848ZINFOnexus (dropshot_internal): Populated DNS tables for external DNS actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:886 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
21342024-12-14T03:35:40.848ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
21352024-12-14T03:35:40.849ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
21362024-12-14T03:35:40.850ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
21372024-12-14T03:35:40.852ZDEBGnexus (dropshot_internal): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e resource = Fleet result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
21382024-12-14T03:35:40.852ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
21392024-12-14T03:35:40.852ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
21402024-12-14T03:35:40.854ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
21412024-12-14T03:35:40.855ZDEBGnexus (dropshot_internal): authorize result action = ModifyPolicy actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e resource = Fleet result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
21422024-12-14T03:35:40.889ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
21432024-12-14T03:35:40.889ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
21442024-12-14T03:35:40.891ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
21452024-12-14T03:35:40.893ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e resource = DnsConfig result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
21462024-12-14T03:35:40.893ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
21472024-12-14T03:35:40.894ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
21482024-12-14T03:35:40.895ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
21492024-12-14T03:35:40.897ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e resource = DnsConfig result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
21502024-12-14T03:35:40.899ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
21512024-12-14T03:35:40.900ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
21522024-12-14T03:35:40.901ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
21532024-12-14T03:35:40.904ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e resource = DnsConfig result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
21542024-12-14T03:35:40.918ZINFOnexus (dropshot_internal): Created recovery silo actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:451 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
21552024-12-14T03:35:40.929ZINFOnexus (dropshot_internal): Created recovery user actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:467 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
21562024-12-14T03:35:40.936ZINFOnexus (dropshot_internal): Created recovery user's password actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:481 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
21572024-12-14T03:35:40.936ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
21582024-12-14T03:35:40.936ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
21592024-12-14T03:35:40.938ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
21602024-12-14T03:35:40.938ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
21612024-12-14T03:35:40.939ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
21622024-12-14T03:35:40.940ZDEBGnexus (dropshot_internal): authorize result action = ModifyPolicy actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e resource = Silo { parent: Fleet, key: 578bc52c-ac81-41a6-a56b-dfc79805368e, lookup_type: ById(578bc52c-ac81-41a6-a56b-dfc79805368e) } result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
21632024-12-14T03:35:40.940ZDEBGnexus (dropshot_internal): Generated role assignment queries actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
21642024-12-14T03:35:40.945ZINFOnexus (dropshot_internal): Granted Silo privileges actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:509 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
21652024-12-14T03:35:40.945ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
21662024-12-14T03:35:40.945ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
21672024-12-14T03:35:40.946ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
21682024-12-14T03:35:40.947ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e resource = Fleet result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
21692024-12-14T03:35:40.969ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
21702024-12-14T03:35:40.969ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
21712024-12-14T03:35:40.971ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
21722024-12-14T03:35:40.971ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
21732024-12-14T03:35:40.973ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
21742024-12-14T03:35:40.973ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
21752024-12-14T03:35:40.976ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
21762024-12-14T03:35:40.976ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
21772024-12-14T03:35:40.977ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
21782024-12-14T03:35:40.977ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
21792024-12-14T03:35:40.980ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
21802024-12-14T03:35:40.980ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
21812024-12-14T03:35:40.981ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
21822024-12-14T03:35:40.985ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
21832024-12-14T03:35:40.985ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
21842024-12-14T03:35:40.985ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
21852024-12-14T03:35:40.986ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
21862024-12-14T03:35:40.986ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
21872024-12-14T03:35:40.988ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
21882024-12-14T03:35:40.988ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
21892024-12-14T03:35:40.990ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
21902024-12-14T03:35:40.993ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
21912024-12-14T03:35:40.993ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
21922024-12-14T03:35:40.993ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
21932024-12-14T03:35:40.997ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
21942024-12-14T03:35:40.997ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
21952024-12-14T03:35:40.999ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
21962024-12-14T03:35:40.999ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
21972024-12-14T03:35:41.001ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
21982024-12-14T03:35:41.001ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
21992024-12-14T03:35:41.003ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
22002024-12-14T03:35:41.003ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
22012024-12-14T03:35:41.004ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
22022024-12-14T03:35:41.004ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
22032024-12-14T03:35:41.005ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
22042024-12-14T03:35:41.005ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
22052024-12-14T03:35:41.007ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
22062024-12-14T03:35:41.010ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
22072024-12-14T03:35:41.010ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
22082024-12-14T03:35:41.010ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
22092024-12-14T03:35:41.011ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
22102024-12-14T03:35:41.012ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
22112024-12-14T03:35:41.013ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
22122024-12-14T03:35:41.013ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
22132024-12-14T03:35:41.016ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
22142024-12-14T03:35:41.016ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
22152024-12-14T03:35:41.018ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
22162024-12-14T03:35:41.018ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
22172024-12-14T03:35:41.020ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
22182024-12-14T03:35:41.020ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
22192024-12-14T03:35:41.021ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
22202024-12-14T03:35:41.021ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
22212024-12-14T03:35:41.023ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
22222024-12-14T03:35:41.026ZDEBGnexus (dropshot_internal): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
22232024-12-14T03:35:41.026ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
22242024-12-14T03:35:41.026ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
22252024-12-14T03:35:41.027ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
22262024-12-14T03:35:41.027ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
22272024-12-14T03:35:41.029ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
22282024-12-14T03:35:41.029ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
22292024-12-14T03:35:41.030ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
22302024-12-14T03:35:41.033ZDEBGnexus (dropshot_internal): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
22312024-12-14T03:35:41.033ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
22322024-12-14T03:35:41.033ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
22332024-12-14T03:35:41.037ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
22342024-12-14T03:35:41.038ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
22352024-12-14T03:35:41.040ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
22362024-12-14T03:35:41.040ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
22372024-12-14T03:35:41.042ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
22382024-12-14T03:35:41.042ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
22392024-12-14T03:35:41.044ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
22402024-12-14T03:35:41.044ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
22412024-12-14T03:35:41.046ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
22422024-12-14T03:35:41.047ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
22432024-12-14T03:35:41.048ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
22442024-12-14T03:35:41.048ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
22452024-12-14T03:35:41.049ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
22462024-12-14T03:35:41.049ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
22472024-12-14T03:35:41.051ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
22482024-12-14T03:35:41.054ZDEBGnexus (dropshot_internal): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
22492024-12-14T03:35:41.054ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
22502024-12-14T03:35:41.054ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
22512024-12-14T03:35:41.055ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
22522024-12-14T03:35:41.055ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
22532024-12-14T03:35:41.056ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
22542024-12-14T03:35:41.057ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
22552024-12-14T03:35:41.058ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
22562024-12-14T03:35:41.061ZDEBGnexus (dropshot_internal): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
22572024-12-14T03:35:41.061ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
22582024-12-14T03:35:41.061ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
22592024-12-14T03:35:41.073ZDEBGnexus: resolved names for firewall rules instance_interfaces = {} subnet_interfaces = {Name("nexus"): [NetworkInterface { id: 4f1fe649-79cb-49da-9215-8ff632ac6466, kind: Service { id: e8d9646f-a541-4c11-b5b2-f953427ca2f3 }, name: Name("nexus-e8d9646f-a541-4c11-b5b2-f953427ca2f3"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 170, 226])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 513aa8b2-d165-4db3-997f-2262204f1075, kind: Service { id: dc6862c8-90dd-40bf-a461-5b36c4239936 }, name: Name("nexus-dc6862c8-90dd-40bf-a461-5b36c4239936"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 182, 203])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 669bb0eb-969e-4430-94e4-187a825d1f3d, kind: Service { id: 5f2fe413-3c4a-4994-b4a0-995c1da486b1 }, name: Name("nexus-5f2fe413-3c4a-4994-b4a0-995c1da486b1"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 143, 224])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("external-dns"): [NetworkInterface { id: 0951ac68-a8db-47fb-ad0e-675cae6d693a, kind: Service { id: 28f528f1-3159-4fbc-9304-37b7e4a50ae8 }, name: Name("external-dns-28f528f1-3159-4fbc-9304-37b7e4a50ae8"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 140, 181])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cb55e4cb-e945-41d1-ba05-5e6f98df2e24, kind: Service { id: 7274e15f-a5f6-4975-bcdd-a2ef890c0230 }, name: Name("external-dns-7274e15f-a5f6-4975-bcdd-a2ef890c0230"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 190, 158])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })], Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })]} vpc_interfaces = {}
22602024-12-14T03:35:41.073ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
22612024-12-14T03:35:41.074ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
22622024-12-14T03:35:41.075ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
22632024-12-14T03:35:41.076ZDEBGnexus (dropshot_internal): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e resource = Fleet result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
22642024-12-14T03:35:41.076ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e roles = RoleSet { roles: {} } uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
22652024-12-14T03:35:41.077ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e resource = Database result = Ok(()) uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
22662024-12-14T03:35:41.078ZDEBGnexus: Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified.
22672024-12-14T03:35:41.081ZDEBGnexus: resolved firewall rules for sled agents sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 0951ac68-a8db-47fb-ad0e-675cae6d693a, kind: Service { id: 28f528f1-3159-4fbc-9304-37b7e4a50ae8 }, name: Name("external-dns-28f528f1-3159-4fbc-9304-37b7e4a50ae8"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 140, 181])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cb55e4cb-e945-41d1-ba05-5e6f98df2e24, kind: Service { id: 7274e15f-a5f6-4975-bcdd-a2ef890c0230 }, name: Name("external-dns-7274e15f-a5f6-4975-bcdd-a2ef890c0230"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 190, 158])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 4f1fe649-79cb-49da-9215-8ff632ac6466, kind: Service { id: e8d9646f-a541-4c11-b5b2-f953427ca2f3 }, name: Name("nexus-e8d9646f-a541-4c11-b5b2-f953427ca2f3"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 170, 226])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 513aa8b2-d165-4db3-997f-2262204f1075, kind: Service { id: dc6862c8-90dd-40bf-a461-5b36c4239936 }, name: Name("nexus-dc6862c8-90dd-40bf-a461-5b36c4239936"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 182, 203])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 669bb0eb-969e-4430-94e4-187a825d1f3d, kind: Service { id: 5f2fe413-3c4a-4994-b4a0-995c1da486b1 }, name: Name("nexus-5f2fe413-3c4a-4994-b4a0-995c1da486b1"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 143, 224])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
22682024-12-14T03:35:41.081ZDEBGnexus: resolved 2 rules for sleds
22692024-12-14T03:35:41.127ZDEBGnexus: resolved sleds for vpc oxide-services vpc_to_sled = [Sled { identity: SledIdentity { id: 8d70e61c-94ed-41ce-b36c-cb904f92c534, time_created: 2024-12-14T03:35:37.430597Z, time_modified: 2024-12-14T03:35:37.430597Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: a121ca05-bbee-41bf-b9db-9e03ff035200, is_scrimlet: true, serial_number: "buskin", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
22702024-12-14T03:35:41.127ZDEBGnexus: sending firewall rules to sled agents
22712024-12-14T03:35:41.127ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
22722024-12-14T03:35:41.128ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
22732024-12-14T03:35:41.130ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
22742024-12-14T03:35:41.130ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
22752024-12-14T03:35:41.131ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
22762024-12-14T03:35:41.133ZDEBGnexus (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Sled { parent: Fleet, key: 8d70e61c-94ed-41ce-b36c-cb904f92c534, lookup_type: ById(8d70e61c-94ed-41ce-b36c-cb904f92c534) } result = Ok(())
22772024-12-14T03:35:41.164ZDEBGnexus: client request SledAgent = 8d70e61c-94ed-41ce-b36c-cb904f92c534 body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
22782024-12-14T03:35:41.167ZDEBGnexus: client response SledAgent = 8d70e61c-94ed-41ce-b36c-cb904f92c534 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "6e91bcb7-2b01-46aa-a917-e310827e9bdd", "date": "Sat, 14 Dec 2024 03:35:41 GMT"} })
22792024-12-14T03:35:41.167ZINFOnexus: updated firewall rules on 1 sleds file = nexus/networking/src/firewall_rules.rs:496
22802024-12-14T03:35:41.167ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 2 reason = Signaled
22812024-12-14T03:35:41.167ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1067258 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65187 req_id = b9ade9d7-2ab7-41a5-b135-6ac6775b106e response_code = 204 uri = /racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete
22822024-12-14T03:35:41.167ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 2 reason = Signaled
22832024-12-14T03:35:41.167ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
22842024-12-14T03:35:41.167ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
22852024-12-14T03:35:41.167ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 2 reason = Signaled
22862024-12-14T03:35:41.167ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
22872024-12-14T03:35:41.167ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 2 reason = Signaled
22882024-12-14T03:35:41.167ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 2 reason = Signaled
22892024-12-14T03:35:41.167ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
22902024-12-14T03:35:41.167ZDEBGnexus (BackgroundTasks): activating background_task = inventory_collection iteration = 2 reason = Signaled
22912024-12-14T03:35:41.167ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
22922024-12-14T03:35:41.167ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
22932024-12-14T03:35:41.168ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
22942024-12-14T03:35:41.168ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
22952024-12-14T03:35:41.168ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
22962024-12-14T03:35:41.168ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
22972024-12-14T03:35:41.168ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("3db8556d-0ae0-4824-8953-f38d8eef7409.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7b672843-049d-4d9c-b0a2-21d7b6323621.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("db39fe07-65c4-451a-a2bd-78fcdfc10040.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("db39fe07-65c4-451a-a2bd-78fcdfc10040.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1147, tv_nsec: 488983789 } })
22982024-12-14T03:35:41.168ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("28f528f1-3159-4fbc-9304-37b7e4a50ae8.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7274e15f-a5f6-4975-bcdd-a2ef890c0230.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("7274e15f-a5f6-4975-bcdd-a2ef890c0230.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1147, tv_nsec: 489099152 } })
22992024-12-14T03:35:41.168ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
23002024-12-14T03:35:41.168ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.04206ms iteration = 2 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
23012024-12-14T03:35:41.169ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
23022024-12-14T03:35:41.169ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.147743ms iteration = 2 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
23032024-12-14T03:35:41.169ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
23042024-12-14T03:35:41.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
23052024-12-14T03:35:41.169ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
23062024-12-14T03:35:41.169ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23072024-12-14T03:35:41.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
23082024-12-14T03:35:41.170ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23092024-12-14T03:35:41.170ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23102024-12-14T03:35:41.171ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
23112024-12-14T03:35:41.171ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
23122024-12-14T03:35:41.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
23132024-12-14T03:35:41.172ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
23142024-12-14T03:35:41.172ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
23152024-12-14T03:35:41.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
23162024-12-14T03:35:41.173ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
23172024-12-14T03:35:41.174ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
23182024-12-14T03:35:41.174ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
23192024-12-14T03:35:41.174ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
23202024-12-14T03:35:41.174ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
23212024-12-14T03:35:41.174ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
23222024-12-14T03:35:41.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
23232024-12-14T03:35:41.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
23242024-12-14T03:35:41.176ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23252024-12-14T03:35:41.176ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23262024-12-14T03:35:41.176ZDEBGnexus (BackgroundTasks): inventory_prune_one: eligible for removal background_task = inventory_collection candidates = [(31a9a568-b3f8-4460-96ea-3ad6407a415a, 0), (4d99c1d3-3ed9-4e96-8a1e-fbb486858f71, 0), (685109b5-7be5-4359-9979-d56c9af49240, 0), (0b6b7861-d0fc-41e3-ad38-89d90540f360, 0)] collection_id = 31a9a568-b3f8-4460-96ea-3ad6407a415a
23272024-12-14T03:35:41.176ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
23282024-12-14T03:35:41.176ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
23292024-12-14T03:35:41.179ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
23302024-12-14T03:35:41.179ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
23312024-12-14T03:35:41.179ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
23322024-12-14T03:35:41.179ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
23332024-12-14T03:35:41.179ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
23342024-12-14T03:35:41.179ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
23352024-12-14T03:35:41.180ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
23362024-12-14T03:35:41.181ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
23372024-12-14T03:35:41.182ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23382024-12-14T03:35:41.184ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
23392024-12-14T03:35:41.184ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
23402024-12-14T03:35:41.184ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
23412024-12-14T03:35:41.205ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23422024-12-14T03:35:41.208ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
23432024-12-14T03:35:41.214ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
23442024-12-14T03:35:41.214ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = c7a5bbe9-1af5-4e36-80b5-da9e0053b676 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
23452024-12-14T03:35:41.214ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
23462024-12-14T03:35:41.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
23472024-12-14T03:35:41.216ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23482024-12-14T03:35:41.216ZINFOnexus (BackgroundTasks): removed inventory collection background_task = inventory_collection collection_id = 31a9a568-b3f8-4460-96ea-3ad6407a415a file = nexus/db-queries/src/db/datastore/inventory.rs:1442 ncabooses = 12 nclickhouse_keeper_membership = 0 ncollections = 1 ndatasets = 0 nerrors = 0 nnics = 0 nnvme_disk_firmware = 0 nphysical_disks = 0 nrot_pages = 8 nrots = 2 nsled_agent_zones = 0 nsled_agents = 0 nsps = 2 nzones = 0 nzpools = 0
23492024-12-14T03:35:41.216ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
23502024-12-14T03:35:41.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
23512024-12-14T03:35:41.218ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
23522024-12-14T03:35:41.219ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
23532024-12-14T03:35:41.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
23542024-12-14T03:35:41.220ZDEBGnexus (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(4d99c1d3-3ed9-4e96-8a1e-fbb486858f71, 0), (685109b5-7be5-4359-9979-d56c9af49240, 0), (0b6b7861-d0fc-41e3-ad38-89d90540f360, 0)]
23552024-12-14T03:35:41.221ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-8d70e61c-94ed-41ce-b36c-cb904f92c534.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8d70e61c-94ed-41ce-b36c-cb904f92c534.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1147, tv_nsec: 541596003 } })
23562024-12-14T03:35:41.221ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = c7a5bbe9-1af5-4e36-80b5-da9e0053b676 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
23572024-12-14T03:35:41.221ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
23582024-12-14T03:35:41.221ZINFOnexus (BackgroundTasks): found latest generation (first find) background_task = dns_config_internal dns_group = internal file = nexus/src/app/background/tasks/dns_config.rs:87 generation = 1
23592024-12-14T03:35:41.221ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 53.612064ms iteration = 2 status = {"generation":1}
23602024-12-14T03:35:41.221ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 3 reason = Dependency
23612024-12-14T03:35:41.222ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
23622024-12-14T03:35:41.223ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
23632024-12-14T03:35:41.224ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
23642024-12-14T03:35:41.225ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
23652024-12-14T03:35:41.229ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (initial) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-14T03:34:54.541856Z, time_modified: 2024-12-14T03:34:54.541856Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, db_silo: Silo { identity: SiloIdentity { id: 578bc52c-ac81-41a6-a56b-dfc79805368e, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-14T03:35:40.848931Z, time_modified: 2024-12-14T03:35:40.848931Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(1)) }, tls_certs: [TlsCertificate { digest: "4dfc5e49ed154568e7a05c630983c79e7ad097d55e90f834bee8ffda0c5a5c9e" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, db_silo: Silo { identity: SiloIdentity { id: 578bc52c-ac81-41a6-a56b-dfc79805368e, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-14T03:35:40.848931Z, time_modified: 2024-12-14T03:35:40.848931Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(1)) }, tls_certs: [TlsCertificate { digest: "4dfc5e49ed154568e7a05c630983c79e7ad097d55e90f834bee8ffda0c5a5c9e" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:77
23662024-12-14T03:35:41.229ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 61.664945ms iteration = 2 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"578bc52c-ac81-41a6-a56b-dfc79805368e","tls_certs":["4dfc5e49ed154568e7a05c630983c79e7ad097d55e90f834bee8ffda0c5a5c9e"]}},"default_endpoint":{"silo_id":"578bc52c-ac81-41a6-a56b-dfc79805368e","tls_certs":["4dfc5e49ed154568e7a05c630983c79e7ad097d55e90f834bee8ffda0c5a5c9e"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
23672024-12-14T03:35:41.233ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23682024-12-14T03:35:41.236ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: a121ca05-bbee-41bf-b9db-9e03ff035200, lookup_type: ById(a121ca05-bbee-41bf-b9db-9e03ff035200) } result = Ok(())
23692024-12-14T03:35:41.236ZINFOnexus: Rack initialized file = nexus/src/app/rack.rs:765
23702024-12-14T03:35:41.236ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
23712024-12-14T03:35:41.236ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
23722024-12-14T03:35:41.238ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
23732024-12-14T03:35:41.238ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
23742024-12-14T03:35:41.241ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
23752024-12-14T03:35:41.241ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
23762024-12-14T03:35:41.241ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
23772024-12-14T03:35:41.241ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
23782024-12-14T03:35:41.241ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
23792024-12-14T03:35:41.241ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
23802024-12-14T03:35:41.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
23812024-12-14T03:35:41.243ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
23822024-12-14T03:35:41.243ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
23832024-12-14T03:35:41.243ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23842024-12-14T03:35:41.244ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
23852024-12-14T03:35:41.244ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
23862024-12-14T03:35:41.245ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
23872024-12-14T03:35:41.246ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
23882024-12-14T03:35:41.246ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
23892024-12-14T03:35:41.246ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
23902024-12-14T03:35:41.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
23912024-12-14T03:35:41.247ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23922024-12-14T03:35:41.248ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
23932024-12-14T03:35:41.248ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 51f6df17-b3b5-47fe-9a42-d8752f961c5e dns_zone_name = oxide.test found_so_far = 0 version = 2
23942024-12-14T03:35:41.248ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
23952024-12-14T03:35:41.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
23962024-12-14T03:35:41.251ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23972024-12-14T03:35:41.252ZDEBGnexus (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
23982024-12-14T03:35:41.252ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
23992024-12-14T03:35:41.252ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
24002024-12-14T03:35:41.253ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
24012024-12-14T03:35:41.253ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
24022024-12-14T03:35:41.254ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
24032024-12-14T03:35:41.254ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
24042024-12-14T03:35:41.254ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
24052024-12-14T03:35:41.255ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
24062024-12-14T03:35:41.255ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
24072024-12-14T03:35:41.256ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 51f6df17-b3b5-47fe-9a42-d8752f961c5e dns_zone_name = oxide.test found_so_far = 1 version = 2
24082024-12-14T03:35:41.256ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
24092024-12-14T03:35:41.256ZINFOnexus (BackgroundTasks): found latest generation (first find) background_task = dns_config_external dns_group = external file = nexus/src/app/background/tasks/dns_config.rs:87 generation = 2
24102024-12-14T03:35:41.256ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 89.016223ms iteration = 2 status = {"generation":2}
24112024-12-14T03:35:41.256ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 3 reason = Dependency
24122024-12-14T03:35:41.257ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24132024-12-14T03:35:41.260ZDEBGnexus (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
24142024-12-14T03:35:41.260ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
24152024-12-14T03:35:41.260ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
24162024-12-14T03:35:41.263ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
24172024-12-14T03:35:41.263ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
24182024-12-14T03:35:41.265ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
24192024-12-14T03:35:41.266ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
24202024-12-14T03:35:41.268ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
24212024-12-14T03:35:41.268ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
24222024-12-14T03:35:41.270ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
24232024-12-14T03:35:41.270ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
24242024-12-14T03:35:41.271ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
24252024-12-14T03:35:41.272ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
24262024-12-14T03:35:41.273ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
24272024-12-14T03:35:41.273ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
24282024-12-14T03:35:41.274ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24292024-12-14T03:35:41.278ZDEBGnexus (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
24302024-12-14T03:35:41.278ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
24312024-12-14T03:35:41.278ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
24322024-12-14T03:35:41.279ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
24332024-12-14T03:35:41.279ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
24342024-12-14T03:35:41.281ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
24352024-12-14T03:35:41.281ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
24362024-12-14T03:35:41.282ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
24372024-12-14T03:35:41.283ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
24382024-12-14T03:35:41.285ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
24392024-12-14T03:35:41.285ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
24402024-12-14T03:35:41.286ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
24412024-12-14T03:35:41.286ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
24422024-12-14T03:35:41.287ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
24432024-12-14T03:35:41.288ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
24442024-12-14T03:35:41.289ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24452024-12-14T03:35:41.292ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
24462024-12-14T03:35:41.293ZDEBGnexus (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
24472024-12-14T03:35:41.293ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
24482024-12-14T03:35:41.293ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
24492024-12-14T03:35:41.294ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
24502024-12-14T03:35:41.294ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
24512024-12-14T03:35:41.295ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
24522024-12-14T03:35:41.296ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
24532024-12-14T03:35:41.297ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24542024-12-14T03:35:41.299ZDEBGnexus (BackgroundTasks): begin collection background_task = inventory_collection
24552024-12-14T03:35:41.299ZDEBGnexus (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[fd00:1122:3344:101::2]:12225
24562024-12-14T03:35:41.299ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/ignition
24572024-12-14T03:35:41.299ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "c9dace86-30e0-4c84-a860-88e7c8f9ad5d", "content-length": "476", "date": "Sat, 14 Dec 2024 03:35:40 GMT"} })
24582024-12-14T03:35:41.299ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0
24592024-12-14T03:35:41.300ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "b6842aed-da92-4c18-aca1-859e21444050", "content-length": "734", "date": "Sat, 14 Dec 2024 03:35:40 GMT"} })
24602024-12-14T03:35:41.300ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0
24612024-12-14T03:35:41.300ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "83022c00-634f-4d77-85cd-b0c7e0f28a61", "content-length": "111", "date": "Sat, 14 Dec 2024 03:35:40 GMT"} })
24622024-12-14T03:35:41.300ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1
24632024-12-14T03:35:41.300ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "57a03a1f-2a48-4b19-9e47-c84be585fbf5", "content-length": "111", "date": "Sat, 14 Dec 2024 03:35:40 GMT"} })
24642024-12-14T03:35:41.300ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0
24652024-12-14T03:35:41.300ZDEBGnexus (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
24662024-12-14T03:35:41.300ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
24672024-12-14T03:35:41.300ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
24682024-12-14T03:35:41.300ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "efc390fe-93ef-4f6e-a6f6-5dad95abaf88", "content-length": "167", "date": "Sat, 14 Dec 2024 03:35:40 GMT"} })
24692024-12-14T03:35:41.300ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1
24702024-12-14T03:35:41.301ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "f5e27e64-f31a-4a08-b78b-97f0660e8379", "content-length": "167", "date": "Sat, 14 Dec 2024 03:35:40 GMT"} })
24712024-12-14T03:35:41.301ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0
24722024-12-14T03:35:41.301ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "3447b4d7-8016-41c6-8706-a9abea654737", "content-length": "175", "date": "Sat, 14 Dec 2024 03:35:40 GMT"} })
24732024-12-14T03:35:41.301ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1
24742024-12-14T03:35:41.301ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "1cb1dd7f-e545-47b9-b425-713191e7467d", "content-length": "175", "date": "Sat, 14 Dec 2024 03:35:40 GMT"} })
24752024-12-14T03:35:41.301ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa
24762024-12-14T03:35:41.301ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "46370cd1-b331-4f6f-a6de-6eb7de37532e", "content-length": "702", "date": "Sat, 14 Dec 2024 03:35:40 GMT"} })
24772024-12-14T03:35:41.301ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
24782024-12-14T03:35:41.302ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "9006a2f8-0b6e-4b0f-b18d-9c894bbb1820", "content-length": "727", "date": "Sat, 14 Dec 2024 03:35:40 GMT"} })
24792024-12-14T03:35:41.302ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
24802024-12-14T03:35:41.302ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "304d7af2-3a3e-4cb4-aec7-83aac98313ca", "content-length": "729", "date": "Sat, 14 Dec 2024 03:35:40 GMT"} })
24812024-12-14T03:35:41.302ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
24822024-12-14T03:35:41.302ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "bae99ee9-9604-489e-b838-748c5f1f9ff1", "content-length": "728", "date": "Sat, 14 Dec 2024 03:35:40 GMT"} })
24832024-12-14T03:35:41.302ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0
24842024-12-14T03:35:41.302ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "7c970169-27e7-4484-8e6d-ab2c0f4c0b68", "content-length": "722", "date": "Sat, 14 Dec 2024 03:35:40 GMT"} })
24852024-12-14T03:35:41.302ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0
24862024-12-14T03:35:41.302ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "82149d20-6e87-4ce3-b962-5e2f79bf57a9", "content-length": "109", "date": "Sat, 14 Dec 2024 03:35:40 GMT"} })
24872024-12-14T03:35:41.302ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1
24882024-12-14T03:35:41.303ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "fdd26c9f-8a61-46db-8ad8-7501cd45b3dd", "content-length": "109", "date": "Sat, 14 Dec 2024 03:35:40 GMT"} })
24892024-12-14T03:35:41.303ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0
24902024-12-14T03:35:41.303ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "c4e43cab-1705-410c-89a9-43886c2ccfd9", "content-length": "169", "date": "Sat, 14 Dec 2024 03:35:40 GMT"} })
24912024-12-14T03:35:41.303ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1
24922024-12-14T03:35:41.303ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "959b4332-2c11-4a17-8b9c-f8e5eab4edc5", "content-length": "169", "date": "Sat, 14 Dec 2024 03:35:40 GMT"} })
24932024-12-14T03:35:41.303ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0
24942024-12-14T03:35:41.303ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "1ed1aa5e-972b-4cc4-ad46-9994826f1c87", "content-length": "178", "date": "Sat, 14 Dec 2024 03:35:40 GMT"} })
24952024-12-14T03:35:41.303ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1
24962024-12-14T03:35:41.304ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "3faef379-6945-45ee-9319-4d17de71512d", "content-length": "178", "date": "Sat, 14 Dec 2024 03:35:40 GMT"} })
24972024-12-14T03:35:41.304ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa
24982024-12-14T03:35:41.304ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "1f874e9b-1e5f-466b-af52-60431539bf4d", "content-length": "702", "date": "Sat, 14 Dec 2024 03:35:40 GMT"} })
24992024-12-14T03:35:41.304ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
25002024-12-14T03:35:41.304ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "4c84f92d-0d19-48ac-b514-53de1b9e459a", "content-length": "727", "date": "Sat, 14 Dec 2024 03:35:40 GMT"} })
25012024-12-14T03:35:41.304ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
25022024-12-14T03:35:41.304ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "cbd86863-6d9e-42a8-880d-d1f5b4745b5e", "content-length": "729", "date": "Sat, 14 Dec 2024 03:35:40 GMT"} })
25032024-12-14T03:35:41.304ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
25042024-12-14T03:35:41.304ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "0b4159a8-1207-48db-8807-13382f774497", "content-length": "728", "date": "Sat, 14 Dec 2024 03:35:41 GMT"} })
25052024-12-14T03:35:41.304ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
25062024-12-14T03:35:41.305ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
25072024-12-14T03:35:41.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
25082024-12-14T03:35:41.305ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
25092024-12-14T03:35:41.306ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25102024-12-14T03:35:41.306ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
25112024-12-14T03:35:41.307ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
25122024-12-14T03:35:41.308ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
25132024-12-14T03:35:41.308ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
25142024-12-14T03:35:41.308ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
25152024-12-14T03:35:41.308ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
25162024-12-14T03:35:41.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
25172024-12-14T03:35:41.310ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
25182024-12-14T03:35:41.310ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
25192024-12-14T03:35:41.310ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25202024-12-14T03:35:41.312ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
25212024-12-14T03:35:41.312ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
25222024-12-14T03:35:41.312ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
25232024-12-14T03:35:41.312ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
25242024-12-14T03:35:41.313ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
25252024-12-14T03:35:41.313ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
25262024-12-14T03:35:41.313ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
25272024-12-14T03:35:41.314ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
25282024-12-14T03:35:41.314ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
25292024-12-14T03:35:41.314ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
25302024-12-14T03:35:41.316ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25312024-12-14T03:35:41.319ZDEBGnexus (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
25322024-12-14T03:35:41.319ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
25332024-12-14T03:35:41.320ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
25342024-12-14T03:35:41.321ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
25352024-12-14T03:35:41.321ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
25362024-12-14T03:35:41.322ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
25372024-12-14T03:35:41.322ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
25382024-12-14T03:35:41.350ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
25392024-12-14T03:35:41.386ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
25402024-12-14T03:35:41.391ZDEBGnexus (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[fd00:1122:3344:101::1]:12345
25412024-12-14T03:35:41.391ZDEBGnexus (BackgroundTasks): client request SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/inventory
25422024-12-14T03:35:41.393ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25432024-12-14T03:35:41.397ZDEBGnexus (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
25442024-12-14T03:35:41.397ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
25452024-12-14T03:35:41.397ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
25462024-12-14T03:35:41.407ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
25472024-12-14T03:35:41.411ZDEBGnexus (InternalApi): resolved names for firewall rules instance_interfaces = {} subnet_interfaces = {Name("nexus"): [NetworkInterface { id: 4f1fe649-79cb-49da-9215-8ff632ac6466, kind: Service { id: e8d9646f-a541-4c11-b5b2-f953427ca2f3 }, name: Name("nexus-e8d9646f-a541-4c11-b5b2-f953427ca2f3"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 170, 226])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 513aa8b2-d165-4db3-997f-2262204f1075, kind: Service { id: dc6862c8-90dd-40bf-a461-5b36c4239936 }, name: Name("nexus-dc6862c8-90dd-40bf-a461-5b36c4239936"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 182, 203])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 669bb0eb-969e-4430-94e4-187a825d1f3d, kind: Service { id: 5f2fe413-3c4a-4994-b4a0-995c1da486b1 }, name: Name("nexus-5f2fe413-3c4a-4994-b4a0-995c1da486b1"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 143, 224])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("external-dns"): [NetworkInterface { id: 0951ac68-a8db-47fb-ad0e-675cae6d693a, kind: Service { id: 28f528f1-3159-4fbc-9304-37b7e4a50ae8 }, name: Name("external-dns-28f528f1-3159-4fbc-9304-37b7e4a50ae8"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 140, 181])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cb55e4cb-e945-41d1-ba05-5e6f98df2e24, kind: Service { id: 7274e15f-a5f6-4975-bcdd-a2ef890c0230 }, name: Name("external-dns-7274e15f-a5f6-4975-bcdd-a2ef890c0230"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 190, 158])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })], Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })]} vpc_interfaces = {}
25482024-12-14T03:35:41.412ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
25492024-12-14T03:35:41.412ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
25502024-12-14T03:35:41.413ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25512024-12-14T03:35:41.416ZDEBGnexus (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Fleet result = Ok(())
25522024-12-14T03:35:41.416ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
25532024-12-14T03:35:41.416ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
25542024-12-14T03:35:41.418ZDEBGnexus (InternalApi): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified.
25552024-12-14T03:35:41.418ZDEBGnexus (InternalApi): resolved firewall rules for sled agents sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 0951ac68-a8db-47fb-ad0e-675cae6d693a, kind: Service { id: 28f528f1-3159-4fbc-9304-37b7e4a50ae8 }, name: Name("external-dns-28f528f1-3159-4fbc-9304-37b7e4a50ae8"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 140, 181])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cb55e4cb-e945-41d1-ba05-5e6f98df2e24, kind: Service { id: 7274e15f-a5f6-4975-bcdd-a2ef890c0230 }, name: Name("external-dns-7274e15f-a5f6-4975-bcdd-a2ef890c0230"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 190, 158])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 4f1fe649-79cb-49da-9215-8ff632ac6466, kind: Service { id: e8d9646f-a541-4c11-b5b2-f953427ca2f3 }, name: Name("nexus-e8d9646f-a541-4c11-b5b2-f953427ca2f3"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 170, 226])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 513aa8b2-d165-4db3-997f-2262204f1075, kind: Service { id: dc6862c8-90dd-40bf-a461-5b36c4239936 }, name: Name("nexus-dc6862c8-90dd-40bf-a461-5b36c4239936"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 182, 203])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 669bb0eb-969e-4430-94e4-187a825d1f3d, kind: Service { id: 5f2fe413-3c4a-4994-b4a0-995c1da486b1 }, name: Name("nexus-5f2fe413-3c4a-4994-b4a0-995c1da486b1"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 143, 224])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
25562024-12-14T03:35:41.418ZDEBGnexus (InternalApi): resolved 2 rules for sleds
25572024-12-14T03:35:41.426ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "1de3ab6e-cd18-414e-abe6-f16e5cee828e", "date": "Sat, 14 Dec 2024 03:35:41 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
25582024-12-14T03:35:41.426ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
25592024-12-14T03:35:41.427ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "19fe3f99-a7f0-4495-8241-39ac2490491b", "date": "Sat, 14 Dec 2024 03:35:41 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
25602024-12-14T03:35:41.427ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
25612024-12-14T03:35:41.428ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
25622024-12-14T03:35:41.428ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 171.658469ms iteration = 3 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
25632024-12-14T03:35:41.441ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "6b783b8a-4fe3-4ad1-ad96-f6680800d551", "date": "Sat, 14 Dec 2024 03:35:41 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
25642024-12-14T03:35:41.441ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
25652024-12-14T03:35:41.442ZDEBGnexus (InternalApi): resolved sleds for vpc oxide-services vpc_to_sled = [Sled { identity: SledIdentity { id: 8d70e61c-94ed-41ce-b36c-cb904f92c534, time_created: 2024-12-14T03:35:37.430597Z, time_modified: 2024-12-14T03:35:37.430597Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: a121ca05-bbee-41bf-b9db-9e03ff035200, is_scrimlet: true, serial_number: "buskin", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
25662024-12-14T03:35:41.442ZDEBGnexus (InternalApi): sending firewall rules to sled agents
25672024-12-14T03:35:41.442ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
25682024-12-14T03:35:41.443ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
25692024-12-14T03:35:41.445ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
25702024-12-14T03:35:41.445ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "ad2e09bc-fc3c-4bab-9832-1f6ed951ef04", "date": "Sat, 14 Dec 2024 03:35:41 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
25712024-12-14T03:35:41.445ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
25722024-12-14T03:35:41.445ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
25732024-12-14T03:35:41.447ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25742024-12-14T03:35:41.449ZDEBGnexus (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Sled { parent: Fleet, key: 8d70e61c-94ed-41ce-b36c-cb904f92c534, lookup_type: ById(8d70e61c-94ed-41ce-b36c-cb904f92c534) } result = Ok(())
25752024-12-14T03:35:41.450ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "f0e1b9cd-cd76-4aa9-9e08-a3c513ba71e3", "date": "Sat, 14 Dec 2024 03:35:41 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
25762024-12-14T03:35:41.450ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
25772024-12-14T03:35:41.451ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
25782024-12-14T03:35:41.451ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 229.698581ms iteration = 3 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
25792024-12-14T03:35:41.480ZDEBGnexus (InternalApi): client request SledAgent = 8d70e61c-94ed-41ce-b36c-cb904f92c534 body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
25802024-12-14T03:35:41.481ZDEBGnexus (InternalApi): client response SledAgent = 8d70e61c-94ed-41ce-b36c-cb904f92c534 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "b521a676-d69c-4e31-8882-fcf3ac3eb8e1", "date": "Sat, 14 Dec 2024 03:35:41 GMT"} })
25812024-12-14T03:35:41.481ZINFOnexus (InternalApi): updated firewall rules on 1 sleds file = nexus/networking/src/firewall_rules.rs:496
25822024-12-14T03:35:41.481ZINFOnexus: plumbed initial IP allowlist file = nexus/src/app/allow_list.rs:161
25832024-12-14T03:35:41.492ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = / versions = all
25842024-12-14T03:35:41.492ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /access versions = all
25852024-12-14T03:35:41.492ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /assets/{path} versions = all
25862024-12-14T03:35:41.492ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /device/auth versions = all
25872024-12-14T03:35:41.492ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /device/confirm versions = all
25882024-12-14T03:35:41.492ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /device/success versions = all
25892024-12-14T03:35:41.492ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /device/token versions = all
25902024-12-14T03:35:41.492ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /device/verify versions = all
25912024-12-14T03:35:41.492ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /experimental/v1/probes versions = all
25922024-12-14T03:35:41.492ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /experimental/v1/probes versions = all
25932024-12-14T03:35:41.492ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /experimental/v1/probes/{probe} versions = all
25942024-12-14T03:35:41.492ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /experimental/v1/probes/{probe} versions = all
25952024-12-14T03:35:41.492ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /images versions = all
25962024-12-14T03:35:41.492ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /login versions = all
25972024-12-14T03:35:41.492ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /login/{silo_name}/local versions = all
25982024-12-14T03:35:41.492ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /login/{silo_name}/saml/{provider_name} versions = all
25992024-12-14T03:35:41.492ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /login/{silo_name}/saml/{provider_name} versions = all
26002024-12-14T03:35:41.492ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /login/{silo_name}/saml/{provider_name}/redirect versions = all
26012024-12-14T03:35:41.492ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /lookup/{path} versions = all
26022024-12-14T03:35:41.492ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /projects/{path} versions = all
26032024-12-14T03:35:41.492ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /projects-new versions = all
26042024-12-14T03:35:41.492ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /settings/{path} versions = all
26052024-12-14T03:35:41.492ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /system/{path} versions = all
26062024-12-14T03:35:41.492ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /utilization versions = all
26072024-12-14T03:35:41.492ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/certificates versions = all
26082024-12-14T03:35:41.492ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/certificates versions = all
26092024-12-14T03:35:41.492ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/certificates/{certificate} versions = all
26102024-12-14T03:35:41.492ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/certificates/{certificate} versions = all
26112024-12-14T03:35:41.492ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/disks versions = all
26122024-12-14T03:35:41.492ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/disks versions = all
26132024-12-14T03:35:41.492ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/disks/{disk} versions = all
26142024-12-14T03:35:41.492ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/disks/{disk} versions = all
26152024-12-14T03:35:41.492ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/disks/{disk}/bulk-write versions = all
26162024-12-14T03:35:41.492ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/disks/{disk}/bulk-write-start versions = all
26172024-12-14T03:35:41.492ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/disks/{disk}/bulk-write-stop versions = all
26182024-12-14T03:35:41.492ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/disks/{disk}/finalize versions = all
26192024-12-14T03:35:41.492ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/disks/{disk}/metrics/{metric} versions = all
26202024-12-14T03:35:41.492ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/floating-ips versions = all
26212024-12-14T03:35:41.492ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/floating-ips versions = all
26222024-12-14T03:35:41.492ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/floating-ips/{floating_ip} versions = all
26232024-12-14T03:35:41.492ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/floating-ips/{floating_ip} versions = all
26242024-12-14T03:35:41.492ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/floating-ips/{floating_ip} versions = all
26252024-12-14T03:35:41.492ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/floating-ips/{floating_ip}/attach versions = all
26262024-12-14T03:35:41.492ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/floating-ips/{floating_ip}/detach versions = all
26272024-12-14T03:35:41.492ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/groups versions = all
26282024-12-14T03:35:41.492ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/groups/{group_id} versions = all
26292024-12-14T03:35:41.492ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/images versions = all
26302024-12-14T03:35:41.493ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/images versions = all
26312024-12-14T03:35:41.493ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/images/{image} versions = all
26322024-12-14T03:35:41.493ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/images/{image} versions = all
26332024-12-14T03:35:41.493ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/images/{image}/demote versions = all
26342024-12-14T03:35:41.493ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/images/{image}/promote versions = all
26352024-12-14T03:35:41.493ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/instances versions = all
26362024-12-14T03:35:41.493ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/instances versions = all
26372024-12-14T03:35:41.493ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/instances/{instance} versions = all
26382024-12-14T03:35:41.493ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/instances/{instance} versions = all
26392024-12-14T03:35:41.493ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/instances/{instance} versions = all
26402024-12-14T03:35:41.493ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/instances/{instance}/disks versions = all
26412024-12-14T03:35:41.493ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/instances/{instance}/disks/attach versions = all
26422024-12-14T03:35:41.493ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/instances/{instance}/disks/detach versions = all
26432024-12-14T03:35:41.493ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/instances/{instance}/external-ips versions = all
26442024-12-14T03:35:41.493ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/instances/{instance}/external-ips/ephemeral versions = all
26452024-12-14T03:35:41.493ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/instances/{instance}/external-ips/ephemeral versions = all
26462024-12-14T03:35:41.493ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/instances/{instance}/reboot versions = all
26472024-12-14T03:35:41.493ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/instances/{instance}/serial-console versions = all
26482024-12-14T03:35:41.493ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/instances/{instance}/serial-console/stream versions = all
26492024-12-14T03:35:41.493ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/instances/{instance}/ssh-public-keys versions = all
26502024-12-14T03:35:41.493ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/instances/{instance}/start versions = all
26512024-12-14T03:35:41.493ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/instances/{instance}/stop versions = all
26522024-12-14T03:35:41.493ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/internet-gateway-ip-addresses versions = all
26532024-12-14T03:35:41.493ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/internet-gateway-ip-addresses versions = all
26542024-12-14T03:35:41.493ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/internet-gateway-ip-addresses/{address} versions = all
26552024-12-14T03:35:41.493ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/internet-gateway-ip-pools versions = all
26562024-12-14T03:35:41.493ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/internet-gateway-ip-pools versions = all
26572024-12-14T03:35:41.493ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/internet-gateway-ip-pools/{pool} versions = all
26582024-12-14T03:35:41.493ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/internet-gateways versions = all
26592024-12-14T03:35:41.493ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/internet-gateways versions = all
26602024-12-14T03:35:41.493ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/internet-gateways/{gateway} versions = all
26612024-12-14T03:35:41.493ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/internet-gateways/{gateway} versions = all
26622024-12-14T03:35:41.493ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/ip-pools versions = all
26632024-12-14T03:35:41.493ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/ip-pools/{pool} versions = all
26642024-12-14T03:35:41.493ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/login/{silo_name}/local versions = all
26652024-12-14T03:35:41.493ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/logout versions = all
26662024-12-14T03:35:41.493ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/me versions = all
26672024-12-14T03:35:41.493ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/me/groups versions = all
26682024-12-14T03:35:41.493ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/me/ssh-keys versions = all
26692024-12-14T03:35:41.493ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/me/ssh-keys versions = all
26702024-12-14T03:35:41.493ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/me/ssh-keys/{ssh_key} versions = all
26712024-12-14T03:35:41.493ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/me/ssh-keys/{ssh_key} versions = all
26722024-12-14T03:35:41.493ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/metrics/{metric_name} versions = all
26732024-12-14T03:35:41.493ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/network-interfaces versions = all
26742024-12-14T03:35:41.493ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/network-interfaces versions = all
26752024-12-14T03:35:41.493ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/network-interfaces/{interface} versions = all
26762024-12-14T03:35:41.493ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/network-interfaces/{interface} versions = all
26772024-12-14T03:35:41.493ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/network-interfaces/{interface} versions = all
26782024-12-14T03:35:41.493ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/ping versions = all
26792024-12-14T03:35:41.493ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/policy versions = all
26802024-12-14T03:35:41.493ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/policy versions = all
26812024-12-14T03:35:41.493ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/projects versions = all
26822024-12-14T03:35:41.493ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/projects versions = all
26832024-12-14T03:35:41.493ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/projects/{project} versions = all
26842024-12-14T03:35:41.493ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/projects/{project} versions = all
26852024-12-14T03:35:41.493ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/projects/{project} versions = all
26862024-12-14T03:35:41.493ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/projects/{project}/policy versions = all
26872024-12-14T03:35:41.493ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/projects/{project}/policy versions = all
26882024-12-14T03:35:41.493ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/snapshots versions = all
26892024-12-14T03:35:41.493ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/snapshots versions = all
26902024-12-14T03:35:41.493ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/snapshots/{snapshot} versions = all
26912024-12-14T03:35:41.493ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/snapshots/{snapshot} versions = all
26922024-12-14T03:35:41.493ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/disks versions = all
26932024-12-14T03:35:41.493ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/disks/{disk_id} versions = all
26942024-12-14T03:35:41.493ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/racks versions = all
26952024-12-14T03:35:41.493ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/racks/{rack_id} versions = all
26962024-12-14T03:35:41.493ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/sleds versions = all
26972024-12-14T03:35:41.493ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/hardware/sleds versions = all
26982024-12-14T03:35:41.493ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/sleds/{sled_id} versions = all
26992024-12-14T03:35:41.493ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/sleds/{sled_id}/disks versions = all
27002024-12-14T03:35:41.493ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/sleds/{sled_id}/instances versions = all
27012024-12-14T03:35:41.493ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/system/hardware/sleds/{sled_id}/provision-policy versions = all
27022024-12-14T03:35:41.493ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/sleds-uninitialized versions = all
27032024-12-14T03:35:41.493ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/switch-port versions = all
27042024-12-14T03:35:41.493ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/system/hardware/switch-port/{port}/settings versions = all
27052024-12-14T03:35:41.493ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/hardware/switch-port/{port}/settings versions = all
27062024-12-14T03:35:41.493ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/switch-port/{port}/status versions = all
27072024-12-14T03:35:41.493ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/switches versions = all
27082024-12-14T03:35:41.493ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/switches/{switch_id} versions = all
27092024-12-14T03:35:41.493ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/identity-providers versions = all
27102024-12-14T03:35:41.493ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/identity-providers/local/users versions = all
27112024-12-14T03:35:41.493ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/system/identity-providers/local/users/{user_id} versions = all
27122024-12-14T03:35:41.493ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/identity-providers/local/users/{user_id}/set-password versions = all
27132024-12-14T03:35:41.493ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/identity-providers/saml versions = all
27142024-12-14T03:35:41.493ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/identity-providers/saml/{provider} versions = all
27152024-12-14T03:35:41.493ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/ip-pools versions = all
27162024-12-14T03:35:41.493ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/ip-pools versions = all
27172024-12-14T03:35:41.493ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/system/ip-pools/{pool} versions = all
27182024-12-14T03:35:41.493ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/ip-pools/{pool} versions = all
27192024-12-14T03:35:41.493ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/system/ip-pools/{pool} versions = all
27202024-12-14T03:35:41.493ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/ip-pools/{pool}/ranges versions = all
27212024-12-14T03:35:41.493ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/ip-pools/{pool}/ranges/add versions = all
27222024-12-14T03:35:41.493ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/ip-pools/{pool}/ranges/remove versions = all
27232024-12-14T03:35:41.493ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/ip-pools/{pool}/silos versions = all
27242024-12-14T03:35:41.493ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/ip-pools/{pool}/silos versions = all
27252024-12-14T03:35:41.493ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/system/ip-pools/{pool}/silos/{silo} versions = all
27262024-12-14T03:35:41.493ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/system/ip-pools/{pool}/silos/{silo} versions = all
27272024-12-14T03:35:41.493ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/ip-pools/{pool}/utilization versions = all
27282024-12-14T03:35:41.493ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/ip-pools-service versions = all
27292024-12-14T03:35:41.493ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/ip-pools-service/ranges versions = all
27302024-12-14T03:35:41.493ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/ip-pools-service/ranges/add versions = all
27312024-12-14T03:35:41.493ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/ip-pools-service/ranges/remove versions = all
27322024-12-14T03:35:41.493ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/metrics/{metric_name} versions = all
27332024-12-14T03:35:41.493ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/address-lot versions = all
27342024-12-14T03:35:41.493ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/networking/address-lot versions = all
27352024-12-14T03:35:41.493ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/system/networking/address-lot/{address_lot} versions = all
27362024-12-14T03:35:41.493ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/address-lot/{address_lot}/blocks versions = all
27372024-12-14T03:35:41.493ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/allow-list versions = all
27382024-12-14T03:35:41.493ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/system/networking/allow-list versions = all
27392024-12-14T03:35:41.493ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/networking/bfd-disable versions = all
27402024-12-14T03:35:41.493ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/networking/bfd-enable versions = all
27412024-12-14T03:35:41.493ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/bfd-status versions = all
27422024-12-14T03:35:41.493ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/system/networking/bgp versions = all
27432024-12-14T03:35:41.493ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/bgp versions = all
27442024-12-14T03:35:41.493ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/networking/bgp versions = all
27452024-12-14T03:35:41.493ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/bgp-announce-set versions = all
27462024-12-14T03:35:41.493ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/system/networking/bgp-announce-set versions = all
27472024-12-14T03:35:41.493ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/system/networking/bgp-announce-set/{announce_set} versions = all
27482024-12-14T03:35:41.493ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/bgp-announce-set/{announce_set}/announcement versions = all
27492024-12-14T03:35:41.493ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/bgp-exported versions = all
27502024-12-14T03:35:41.493ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/bgp-message-history versions = all
27512024-12-14T03:35:41.493ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/bgp-routes-ipv4 versions = all
27522024-12-14T03:35:41.493ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/bgp-status versions = all
27532024-12-14T03:35:41.493ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/loopback-address versions = all
27542024-12-14T03:35:41.493ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/networking/loopback-address versions = all
27552024-12-14T03:35:41.493ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/system/networking/loopback-address/{rack_id}/{switch_location}/{address}/{subnet_mask} versions = all
27562024-12-14T03:35:41.493ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/system/networking/switch-port-settings versions = all
27572024-12-14T03:35:41.493ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/switch-port-settings versions = all
27582024-12-14T03:35:41.493ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/networking/switch-port-settings versions = all
27592024-12-14T03:35:41.493ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/switch-port-settings/{port} versions = all
27602024-12-14T03:35:41.493ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/policy versions = all
27612024-12-14T03:35:41.493ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/system/policy versions = all
27622024-12-14T03:35:41.493ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/roles versions = all
27632024-12-14T03:35:41.493ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/roles/{role_name} versions = all
27642024-12-14T03:35:41.493ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/silo-quotas versions = all
27652024-12-14T03:35:41.493ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/silos versions = all
27662024-12-14T03:35:41.493ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/silos versions = all
27672024-12-14T03:35:41.493ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/system/silos/{silo} versions = all
27682024-12-14T03:35:41.493ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/silos/{silo} versions = all
27692024-12-14T03:35:41.494ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/silos/{silo}/ip-pools versions = all
27702024-12-14T03:35:41.494ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/silos/{silo}/policy versions = all
27712024-12-14T03:35:41.494ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/system/silos/{silo}/policy versions = all
27722024-12-14T03:35:41.494ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/silos/{silo}/quotas versions = all
27732024-12-14T03:35:41.494ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/system/silos/{silo}/quotas versions = all
27742024-12-14T03:35:41.494ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/timeseries/query versions = all
27752024-12-14T03:35:41.494ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/timeseries/schemas versions = all
27762024-12-14T03:35:41.494ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/system/update/repository versions = all
27772024-12-14T03:35:41.494ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/update/repository/{system_version} versions = all
27782024-12-14T03:35:41.494ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/users versions = all
27792024-12-14T03:35:41.494ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/users/{user_id} versions = all
27802024-12-14T03:35:41.494ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/users-builtin versions = all
27812024-12-14T03:35:41.494ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/users-builtin/{user} versions = all
27822024-12-14T03:35:41.494ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/utilization/silos versions = all
27832024-12-14T03:35:41.494ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/utilization/silos/{silo} versions = all
27842024-12-14T03:35:41.494ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/timeseries/query versions = all
27852024-12-14T03:35:41.494ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/users versions = all
27862024-12-14T03:35:41.494ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/utilization versions = all
27872024-12-14T03:35:41.494ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/vpc-firewall-rules versions = all
27882024-12-14T03:35:41.494ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/vpc-firewall-rules versions = all
27892024-12-14T03:35:41.494ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/vpc-router-routes versions = all
27902024-12-14T03:35:41.494ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/vpc-router-routes versions = all
27912024-12-14T03:35:41.494ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/vpc-router-routes/{route} versions = all
27922024-12-14T03:35:41.494ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/vpc-router-routes/{route} versions = all
27932024-12-14T03:35:41.494ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/vpc-router-routes/{route} versions = all
27942024-12-14T03:35:41.494ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/vpc-routers versions = all
27952024-12-14T03:35:41.494ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/vpc-routers versions = all
27962024-12-14T03:35:41.494ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/vpc-routers/{router} versions = all
27972024-12-14T03:35:41.494ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/vpc-routers/{router} versions = all
27982024-12-14T03:35:41.494ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/vpc-routers/{router} versions = all
27992024-12-14T03:35:41.494ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/vpc-subnets versions = all
28002024-12-14T03:35:41.494ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/vpc-subnets versions = all
28012024-12-14T03:35:41.494ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/vpc-subnets/{subnet} versions = all
28022024-12-14T03:35:41.494ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/vpc-subnets/{subnet} versions = all
28032024-12-14T03:35:41.494ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/vpc-subnets/{subnet} versions = all
28042024-12-14T03:35:41.494ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/vpc-subnets/{subnet}/network-interfaces versions = all
28052024-12-14T03:35:41.494ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/vpcs versions = all
28062024-12-14T03:35:41.494ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/vpcs versions = all
28072024-12-14T03:35:41.494ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/vpcs/{vpc} versions = all
28082024-12-14T03:35:41.494ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/vpcs/{vpc} versions = all
28092024-12-14T03:35:41.494ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/vpcs/{vpc} versions = all
28102024-12-14T03:35:41.494ZINFOnexus (dropshot_external): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = 172.30.2.6:443
28112024-12-14T03:35:41.494ZDEBGnexus (dropshot_external): successfully registered DTrace USDT probes local_addr = 172.30.2.6:443
28122024-12-14T03:35:41.498ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = / versions = all
28132024-12-14T03:35:41.498ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /access versions = all
28142024-12-14T03:35:41.498ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /assets/{path} versions = all
28152024-12-14T03:35:41.498ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /device/auth versions = all
28162024-12-14T03:35:41.498ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /device/confirm versions = all
28172024-12-14T03:35:41.498ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /device/success versions = all
28182024-12-14T03:35:41.498ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /device/token versions = all
28192024-12-14T03:35:41.498ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /device/verify versions = all
28202024-12-14T03:35:41.498ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /experimental/v1/probes versions = all
28212024-12-14T03:35:41.498ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /experimental/v1/probes versions = all
28222024-12-14T03:35:41.498ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /experimental/v1/probes/{probe} versions = all
28232024-12-14T03:35:41.498ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /experimental/v1/probes/{probe} versions = all
28242024-12-14T03:35:41.498ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /images versions = all
28252024-12-14T03:35:41.498ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /login versions = all
28262024-12-14T03:35:41.498ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /login/{silo_name}/local versions = all
28272024-12-14T03:35:41.498ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /login/{silo_name}/saml/{provider_name} versions = all
28282024-12-14T03:35:41.498ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /login/{silo_name}/saml/{provider_name} versions = all
28292024-12-14T03:35:41.498ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /login/{silo_name}/saml/{provider_name}/redirect versions = all
28302024-12-14T03:35:41.498ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /lookup/{path} versions = all
28312024-12-14T03:35:41.498ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /projects/{path} versions = all
28322024-12-14T03:35:41.498ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /projects-new versions = all
28332024-12-14T03:35:41.498ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /settings/{path} versions = all
28342024-12-14T03:35:41.498ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /system/{path} versions = all
28352024-12-14T03:35:41.498ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /utilization versions = all
28362024-12-14T03:35:41.498ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/certificates versions = all
28372024-12-14T03:35:41.498ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/certificates versions = all
28382024-12-14T03:35:41.498ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/certificates/{certificate} versions = all
28392024-12-14T03:35:41.498ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/certificates/{certificate} versions = all
28402024-12-14T03:35:41.498ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/disks versions = all
28412024-12-14T03:35:41.498ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/disks versions = all
28422024-12-14T03:35:41.498ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/disks/{disk} versions = all
28432024-12-14T03:35:41.498ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/disks/{disk} versions = all
28442024-12-14T03:35:41.498ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/disks/{disk}/bulk-write versions = all
28452024-12-14T03:35:41.498ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/disks/{disk}/bulk-write-start versions = all
28462024-12-14T03:35:41.498ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/disks/{disk}/bulk-write-stop versions = all
28472024-12-14T03:35:41.498ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/disks/{disk}/finalize versions = all
28482024-12-14T03:35:41.498ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/disks/{disk}/metrics/{metric} versions = all
28492024-12-14T03:35:41.498ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/floating-ips versions = all
28502024-12-14T03:35:41.498ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/floating-ips versions = all
28512024-12-14T03:35:41.498ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/floating-ips/{floating_ip} versions = all
28522024-12-14T03:35:41.498ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/floating-ips/{floating_ip} versions = all
28532024-12-14T03:35:41.498ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/floating-ips/{floating_ip} versions = all
28542024-12-14T03:35:41.498ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/floating-ips/{floating_ip}/attach versions = all
28552024-12-14T03:35:41.498ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/floating-ips/{floating_ip}/detach versions = all
28562024-12-14T03:35:41.498ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/groups versions = all
28572024-12-14T03:35:41.498ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/groups/{group_id} versions = all
28582024-12-14T03:35:41.498ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/images versions = all
28592024-12-14T03:35:41.498ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/images versions = all
28602024-12-14T03:35:41.498ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/images/{image} versions = all
28612024-12-14T03:35:41.498ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/images/{image} versions = all
28622024-12-14T03:35:41.498ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/images/{image}/demote versions = all
28632024-12-14T03:35:41.498ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/images/{image}/promote versions = all
28642024-12-14T03:35:41.498ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/instances versions = all
28652024-12-14T03:35:41.498ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/instances versions = all
28662024-12-14T03:35:41.498ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/instances/{instance} versions = all
28672024-12-14T03:35:41.498ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/instances/{instance} versions = all
28682024-12-14T03:35:41.498ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/instances/{instance} versions = all
28692024-12-14T03:35:41.498ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/instances/{instance}/disks versions = all
28702024-12-14T03:35:41.498ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/instances/{instance}/disks/attach versions = all
28712024-12-14T03:35:41.498ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/instances/{instance}/disks/detach versions = all
28722024-12-14T03:35:41.498ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/instances/{instance}/external-ips versions = all
28732024-12-14T03:35:41.498ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/instances/{instance}/external-ips/ephemeral versions = all
28742024-12-14T03:35:41.498ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/instances/{instance}/external-ips/ephemeral versions = all
28752024-12-14T03:35:41.498ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/instances/{instance}/reboot versions = all
28762024-12-14T03:35:41.498ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/instances/{instance}/serial-console versions = all
28772024-12-14T03:35:41.498ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/instances/{instance}/serial-console/stream versions = all
28782024-12-14T03:35:41.498ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/instances/{instance}/ssh-public-keys versions = all
28792024-12-14T03:35:41.498ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/instances/{instance}/start versions = all
28802024-12-14T03:35:41.498ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/instances/{instance}/stop versions = all
28812024-12-14T03:35:41.498ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/internet-gateway-ip-addresses versions = all
28822024-12-14T03:35:41.498ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/internet-gateway-ip-addresses versions = all
28832024-12-14T03:35:41.498ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/internet-gateway-ip-addresses/{address} versions = all
28842024-12-14T03:35:41.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/internet-gateway-ip-pools versions = all
28852024-12-14T03:35:41.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/internet-gateway-ip-pools versions = all
28862024-12-14T03:35:41.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/internet-gateway-ip-pools/{pool} versions = all
28872024-12-14T03:35:41.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/internet-gateways versions = all
28882024-12-14T03:35:41.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/internet-gateways versions = all
28892024-12-14T03:35:41.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/internet-gateways/{gateway} versions = all
28902024-12-14T03:35:41.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/internet-gateways/{gateway} versions = all
28912024-12-14T03:35:41.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/ip-pools versions = all
28922024-12-14T03:35:41.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/ip-pools/{pool} versions = all
28932024-12-14T03:35:41.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/login/{silo_name}/local versions = all
28942024-12-14T03:35:41.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/logout versions = all
28952024-12-14T03:35:41.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/me versions = all
28962024-12-14T03:35:41.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/me/groups versions = all
28972024-12-14T03:35:41.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/me/ssh-keys versions = all
28982024-12-14T03:35:41.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/me/ssh-keys versions = all
28992024-12-14T03:35:41.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/me/ssh-keys/{ssh_key} versions = all
29002024-12-14T03:35:41.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/me/ssh-keys/{ssh_key} versions = all
29012024-12-14T03:35:41.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/metrics/{metric_name} versions = all
29022024-12-14T03:35:41.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/network-interfaces versions = all
29032024-12-14T03:35:41.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/network-interfaces versions = all
29042024-12-14T03:35:41.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/network-interfaces/{interface} versions = all
29052024-12-14T03:35:41.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/network-interfaces/{interface} versions = all
29062024-12-14T03:35:41.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/network-interfaces/{interface} versions = all
29072024-12-14T03:35:41.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/ping versions = all
29082024-12-14T03:35:41.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/policy versions = all
29092024-12-14T03:35:41.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/policy versions = all
29102024-12-14T03:35:41.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/projects versions = all
29112024-12-14T03:35:41.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/projects versions = all
29122024-12-14T03:35:41.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/projects/{project} versions = all
29132024-12-14T03:35:41.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/projects/{project} versions = all
29142024-12-14T03:35:41.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/projects/{project} versions = all
29152024-12-14T03:35:41.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/projects/{project}/policy versions = all
29162024-12-14T03:35:41.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/projects/{project}/policy versions = all
29172024-12-14T03:35:41.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/snapshots versions = all
29182024-12-14T03:35:41.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/snapshots versions = all
29192024-12-14T03:35:41.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/snapshots/{snapshot} versions = all
29202024-12-14T03:35:41.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/snapshots/{snapshot} versions = all
29212024-12-14T03:35:41.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/disks versions = all
29222024-12-14T03:35:41.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/disks/{disk_id} versions = all
29232024-12-14T03:35:41.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/racks versions = all
29242024-12-14T03:35:41.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/racks/{rack_id} versions = all
29252024-12-14T03:35:41.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/sleds versions = all
29262024-12-14T03:35:41.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/hardware/sleds versions = all
29272024-12-14T03:35:41.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/sleds/{sled_id} versions = all
29282024-12-14T03:35:41.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/sleds/{sled_id}/disks versions = all
29292024-12-14T03:35:41.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/sleds/{sled_id}/instances versions = all
29302024-12-14T03:35:41.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/system/hardware/sleds/{sled_id}/provision-policy versions = all
29312024-12-14T03:35:41.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/sleds-uninitialized versions = all
29322024-12-14T03:35:41.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/switch-port versions = all
29332024-12-14T03:35:41.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/system/hardware/switch-port/{port}/settings versions = all
29342024-12-14T03:35:41.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/hardware/switch-port/{port}/settings versions = all
29352024-12-14T03:35:41.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/switch-port/{port}/status versions = all
29362024-12-14T03:35:41.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/switches versions = all
29372024-12-14T03:35:41.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/switches/{switch_id} versions = all
29382024-12-14T03:35:41.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/identity-providers versions = all
29392024-12-14T03:35:41.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/identity-providers/local/users versions = all
29402024-12-14T03:35:41.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/system/identity-providers/local/users/{user_id} versions = all
29412024-12-14T03:35:41.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/identity-providers/local/users/{user_id}/set-password versions = all
29422024-12-14T03:35:41.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/identity-providers/saml versions = all
29432024-12-14T03:35:41.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/identity-providers/saml/{provider} versions = all
29442024-12-14T03:35:41.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/ip-pools versions = all
29452024-12-14T03:35:41.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/ip-pools versions = all
29462024-12-14T03:35:41.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/system/ip-pools/{pool} versions = all
29472024-12-14T03:35:41.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/ip-pools/{pool} versions = all
29482024-12-14T03:35:41.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/system/ip-pools/{pool} versions = all
29492024-12-14T03:35:41.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/ip-pools/{pool}/ranges versions = all
29502024-12-14T03:35:41.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/ip-pools/{pool}/ranges/add versions = all
29512024-12-14T03:35:41.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/ip-pools/{pool}/ranges/remove versions = all
29522024-12-14T03:35:41.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/ip-pools/{pool}/silos versions = all
29532024-12-14T03:35:41.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/ip-pools/{pool}/silos versions = all
29542024-12-14T03:35:41.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/system/ip-pools/{pool}/silos/{silo} versions = all
29552024-12-14T03:35:41.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/system/ip-pools/{pool}/silos/{silo} versions = all
29562024-12-14T03:35:41.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/ip-pools/{pool}/utilization versions = all
29572024-12-14T03:35:41.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/ip-pools-service versions = all
29582024-12-14T03:35:41.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/ip-pools-service/ranges versions = all
29592024-12-14T03:35:41.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/ip-pools-service/ranges/add versions = all
29602024-12-14T03:35:41.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/ip-pools-service/ranges/remove versions = all
29612024-12-14T03:35:41.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/metrics/{metric_name} versions = all
29622024-12-14T03:35:41.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/address-lot versions = all
29632024-12-14T03:35:41.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/networking/address-lot versions = all
29642024-12-14T03:35:41.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/system/networking/address-lot/{address_lot} versions = all
29652024-12-14T03:35:41.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/address-lot/{address_lot}/blocks versions = all
29662024-12-14T03:35:41.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/allow-list versions = all
29672024-12-14T03:35:41.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/system/networking/allow-list versions = all
29682024-12-14T03:35:41.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/networking/bfd-disable versions = all
29692024-12-14T03:35:41.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/networking/bfd-enable versions = all
29702024-12-14T03:35:41.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/bfd-status versions = all
29712024-12-14T03:35:41.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/system/networking/bgp versions = all
29722024-12-14T03:35:41.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/bgp versions = all
29732024-12-14T03:35:41.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/networking/bgp versions = all
29742024-12-14T03:35:41.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/bgp-announce-set versions = all
29752024-12-14T03:35:41.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/system/networking/bgp-announce-set versions = all
29762024-12-14T03:35:41.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/system/networking/bgp-announce-set/{announce_set} versions = all
29772024-12-14T03:35:41.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/bgp-announce-set/{announce_set}/announcement versions = all
29782024-12-14T03:35:41.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/bgp-exported versions = all
29792024-12-14T03:35:41.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/bgp-message-history versions = all
29802024-12-14T03:35:41.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/bgp-routes-ipv4 versions = all
29812024-12-14T03:35:41.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/bgp-status versions = all
29822024-12-14T03:35:41.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/loopback-address versions = all
29832024-12-14T03:35:41.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/networking/loopback-address versions = all
29842024-12-14T03:35:41.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/system/networking/loopback-address/{rack_id}/{switch_location}/{address}/{subnet_mask} versions = all
29852024-12-14T03:35:41.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/system/networking/switch-port-settings versions = all
29862024-12-14T03:35:41.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/switch-port-settings versions = all
29872024-12-14T03:35:41.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/networking/switch-port-settings versions = all
29882024-12-14T03:35:41.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/switch-port-settings/{port} versions = all
29892024-12-14T03:35:41.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/policy versions = all
29902024-12-14T03:35:41.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/system/policy versions = all
29912024-12-14T03:35:41.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/roles versions = all
29922024-12-14T03:35:41.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/roles/{role_name} versions = all
29932024-12-14T03:35:41.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/silo-quotas versions = all
29942024-12-14T03:35:41.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/silos versions = all
29952024-12-14T03:35:41.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/silos versions = all
29962024-12-14T03:35:41.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/system/silos/{silo} versions = all
29972024-12-14T03:35:41.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/silos/{silo} versions = all
29982024-12-14T03:35:41.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/silos/{silo}/ip-pools versions = all
29992024-12-14T03:35:41.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/silos/{silo}/policy versions = all
30002024-12-14T03:35:41.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/system/silos/{silo}/policy versions = all
30012024-12-14T03:35:41.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/silos/{silo}/quotas versions = all
30022024-12-14T03:35:41.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/system/silos/{silo}/quotas versions = all
30032024-12-14T03:35:41.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/timeseries/query versions = all
30042024-12-14T03:35:41.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/timeseries/schemas versions = all
30052024-12-14T03:35:41.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/system/update/repository versions = all
30062024-12-14T03:35:41.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/update/repository/{system_version} versions = all
30072024-12-14T03:35:41.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/users versions = all
30082024-12-14T03:35:41.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/users/{user_id} versions = all
30092024-12-14T03:35:41.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/users-builtin versions = all
30102024-12-14T03:35:41.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/users-builtin/{user} versions = all
30112024-12-14T03:35:41.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/utilization/silos versions = all
30122024-12-14T03:35:41.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/utilization/silos/{silo} versions = all
30132024-12-14T03:35:41.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/timeseries/query versions = all
30142024-12-14T03:35:41.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/users versions = all
30152024-12-14T03:35:41.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/utilization versions = all
30162024-12-14T03:35:41.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/vpc-firewall-rules versions = all
30172024-12-14T03:35:41.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/vpc-firewall-rules versions = all
30182024-12-14T03:35:41.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/vpc-router-routes versions = all
30192024-12-14T03:35:41.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/vpc-router-routes versions = all
30202024-12-14T03:35:41.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/vpc-router-routes/{route} versions = all
30212024-12-14T03:35:41.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/vpc-router-routes/{route} versions = all
30222024-12-14T03:35:41.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/vpc-router-routes/{route} versions = all
30232024-12-14T03:35:41.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/vpc-routers versions = all
30242024-12-14T03:35:41.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/vpc-routers versions = all
30252024-12-14T03:35:41.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/vpc-routers/{router} versions = all
30262024-12-14T03:35:41.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/vpc-routers/{router} versions = all
30272024-12-14T03:35:41.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/vpc-routers/{router} versions = all
30282024-12-14T03:35:41.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/vpc-subnets versions = all
30292024-12-14T03:35:41.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/vpc-subnets versions = all
30302024-12-14T03:35:41.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/vpc-subnets/{subnet} versions = all
30312024-12-14T03:35:41.500ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/vpc-subnets/{subnet} versions = all
30322024-12-14T03:35:41.500ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/vpc-subnets/{subnet} versions = all
30332024-12-14T03:35:41.500ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/vpc-subnets/{subnet}/network-interfaces versions = all
30342024-12-14T03:35:41.500ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/vpcs versions = all
30352024-12-14T03:35:41.500ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/vpcs versions = all
30362024-12-14T03:35:41.500ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/vpcs/{vpc} versions = all
30372024-12-14T03:35:41.500ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/vpcs/{vpc} versions = all
30382024-12-14T03:35:41.500ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/vpcs/{vpc} versions = all
30392024-12-14T03:35:41.500ZINFOnexus (dropshot_external_techport): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::b]:12228
30402024-12-14T03:35:41.500ZDEBGnexus (dropshot_external_techport): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::b]:12228
30412024-12-14T03:35:41.501ZDEBGnexus (nexus-producer-server): registered DTrace probes
30422024-12-14T03:35:41.503ZDEBGnexus (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::b]:56585 method = GET path = /{producer_id} versions = all
30432024-12-14T03:35:41.504ZINFOnexus (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::b]:56585
30442024-12-14T03:35:41.504ZDEBGnexus (dropshot): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::b]:56585
30452024-12-14T03:35:41.504ZDEBGnexus (nexus-producer-server): Requested any available port, Dropshot server has been bound to [fd00:1122:3344:101::b]:56585
30462024-12-14T03:35:41.504ZDEBGnexus (nexus-producer-server): Nexus IP provided explicitly, will use it addr = [fd00:1122:3344:101::b]:12221
30472024-12-14T03:35:41.504ZDEBGnexus (nexus-producer-server): starting producer registration task
30482024-12-14T03:35:41.505ZINFOnexus (nexus-producer-server): starting oximeter metric producer server address = [fd00:1122:3344:101::b]:56585 file = oximeter/producer/src/lib.rs:279 interval = 10s producer_id = 5f2fe413-3c4a-4994-b4a0-995c1da486b1
30492024-12-14T03:35:41.505ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
30502024-12-14T03:35:41.505ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::b]:12221
30512024-12-14T03:35:41.535ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
30522024-12-14T03:35:41.535ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::b]:56607
30532024-12-14T03:35:41.535ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:56607 req_id = 4d9247cb-0caf-4f0f-b257-826cefb0fc30 roles = RoleSet { roles: {} } uri = /metrics/producers
30542024-12-14T03:35:41.536ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:56607 req_id = 4d9247cb-0caf-4f0f-b257-826cefb0fc30 resource = Database result = Ok(()) uri = /metrics/producers
30552024-12-14T03:35:41.571ZINFOnexus: assigned collector to new producer collector_id = a321e00a-3126-4ea4-b26d-c0e3eea69166 file = nexus/src/app/oximeter.rs:76 producer_id = 5f2fe413-3c4a-4994-b4a0-995c1da486b1
30562024-12-14T03:35:41.571ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 36119 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:56607 req_id = 4d9247cb-0caf-4f0f-b257-826cefb0fc30 response_code = 201 uri = /metrics/producers
30572024-12-14T03:35:41.571ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "4d9247cb-0caf-4f0f-b257-826cefb0fc30", "content-length": "41", "date": "Sat, 14 Dec 2024 03:35:41 GMT"} })
30582024-12-14T03:35:41.572ZDEBGnexus (producer-registration-task): registered with nexus successfully
30592024-12-14T03:35:41.572ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
30602024-12-14T03:35:41.583ZDEBGnexus (BackgroundTasks): client response SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "fc83a797-e4a7-48e9-8876-449b42e4c9fe", "content-length": "30413", "date": "Sat, 14 Dec 2024 03:35:41 GMT"} })
30612024-12-14T03:35:41.584ZDEBGnexus (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
30622024-12-14T03:35:41.584ZDEBGnexus (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
30632024-12-14T03:35:41.584ZDEBGnexus (BackgroundTasks): finished collection background_task = inventory_collection
30642024-12-14T03:35:41.586ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
30652024-12-14T03:35:41.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
30662024-12-14T03:35:41.588ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30672024-12-14T03:35:41.590ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
30682024-12-14T03:35:41.590ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
30692024-12-14T03:35:41.591ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
30702024-12-14T03:35:41.699ZINFOnexus (BackgroundTasks): inserted inventory collection background_task = inventory_collection collection_id = 0c1afe3f-64fc-4a70-bab2-386a5f289a1b file = nexus/db-queries/src/db/datastore/inventory.rs:1010
30712024-12-14T03:35:41.699ZDEBGnexus (BackgroundTasks): inventory collection complete background_task = inventory_collection collection_id = 0c1afe3f-64fc-4a70-bab2-386a5f289a1b time_started = 2024-12-14 03:35:41.299265 UTC
30722024-12-14T03:35:41.699ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 531.219463ms iteration = 2 status = {"collection_id":"0c1afe3f-64fc-4a70-bab2-386a5f289a1b","time_done":"2024-12-14 03:35:41.584709 UTC","time_started":"2024-12-14 03:35:41.299265 UTC"}
30732024-12-14T03:35:41.699ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 4 reason = Dependency
30742024-12-14T03:35:41.699ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
30752024-12-14T03:35:41.699ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
30762024-12-14T03:35:41.700ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30772024-12-14T03:35:41.702ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
30782024-12-14T03:35:41.702ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
30792024-12-14T03:35:41.702ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
30802024-12-14T03:35:41.705ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
30812024-12-14T03:35:41.705ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
30822024-12-14T03:35:41.707ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30832024-12-14T03:35:41.709ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
30842024-12-14T03:35:41.709ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
30852024-12-14T03:35:41.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
30862024-12-14T03:35:41.717ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 18.078452ms iteration = 4 status = {"physical_disks_added":0}
30872024-12-14T03:35:41.950ZDEBGnexus (NexusCertResolver): resolved TLS certificate certificate = TlsCertificate { digest: "4dfc5e49ed154568e7a05c630983c79e7ad097d55e90f834bee8ffda0c5a5c9e" } server_name = recovery.sys.oxide.test silo_id = 578bc52c-ac81-41a6-a56b-dfc79805368e
30882024-12-14T03:35:41.958ZINFOnexus (dropshot_external): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = 172.30.2.6:443 remote_addr = 10.151.1.100:56265
30892024-12-14T03:35:41.963ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
30902024-12-14T03:35:41.963ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
30912024-12-14T03:35:41.968ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
30922024-12-14T03:35:41.968ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
30932024-12-14T03:35:41.969ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
30942024-12-14T03:35:41.970ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
30952024-12-14T03:35:41.971ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
30962024-12-14T03:35:41.972ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 578bc52c-ac81-41a6-a56b-dfc79805368e, lookup_type: ByName("recovery") } result = Ok(())
30972024-12-14T03:35:41.972ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
30982024-12-14T03:35:41.972ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
30992024-12-14T03:35:41.974ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31002024-12-14T03:35:41.974ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31012024-12-14T03:35:41.976ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
31022024-12-14T03:35:41.978ZDEBGnexus (ExternalAuthn): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 578bc52c-ac81-41a6-a56b-dfc79805368e, lookup_type: ByName("recovery") } result = Ok(())
31032024-12-14T03:35:41.978ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31042024-12-14T03:35:41.978ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31052024-12-14T03:35:41.987ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31062024-12-14T03:35:41.988ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31072024-12-14T03:35:41.989ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31082024-12-14T03:35:41.989ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31092024-12-14T03:35:41.990ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
31102024-12-14T03:35:41.991ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 578bc52c-ac81-41a6-a56b-dfc79805368e, lookup_type: ByName("recovery") }, key: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, lookup_type: ByName("recovery") } result = Ok(())
31112024-12-14T03:35:41.991ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31122024-12-14T03:35:41.992ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31132024-12-14T03:35:42.675ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31142024-12-14T03:35:42.675ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31152024-12-14T03:35:42.678ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31162024-12-14T03:35:42.678ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31172024-12-14T03:35:42.680ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31182024-12-14T03:35:42.680ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31192024-12-14T03:35:42.682ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31202024-12-14T03:35:42.682ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31212024-12-14T03:35:42.684ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
31222024-12-14T03:35:42.685ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 578bc52c-ac81-41a6-a56b-dfc79805368e, lookup_type: ById(578bc52c-ac81-41a6-a56b-dfc79805368e) }, key: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, lookup_type: ById(6d1b4298-6f48-4e38-b4c6-02b2175d87a2) } result = Ok(())
31232024-12-14T03:35:42.685ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31242024-12-14T03:35:42.685ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31252024-12-14T03:35:42.687ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
31262024-12-14T03:35:42.688ZDEBGnexus (ExternalAuthn): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSessionList result = Ok(())
31272024-12-14T03:35:42.688ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31282024-12-14T03:35:42.688ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31292024-12-14T03:35:42.693ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 732676 local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56265 req_id = fcd6c27e-320e-402b-8e28-83285c4ce773 response_code = 204 uri = /v1/login/recovery/local
31302024-12-14T03:35:42.732ZDEBGnexus (NexusCertResolver): resolved TLS certificate certificate = TlsCertificate { digest: "4dfc5e49ed154568e7a05c630983c79e7ad097d55e90f834bee8ffda0c5a5c9e" } server_name = recovery.sys.oxide.test silo_id = 578bc52c-ac81-41a6-a56b-dfc79805368e
31312024-12-14T03:35:42.737ZINFOnexus (dropshot_external): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = 172.30.2.6:443 remote_addr = 10.151.1.100:34803
31322024-12-14T03:35:42.738ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31332024-12-14T03:35:42.738ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31342024-12-14T03:35:42.746ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31352024-12-14T03:35:42.746ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31362024-12-14T03:35:42.747ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
31372024-12-14T03:35:42.748ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "db95a822bf0fd07240bed3e48d369a3d91a78b45", lookup_type: ByCompositeId("token = \\"db95a822bf0fd07240bed3e48d369a3d91a78b45\\"") } result = Ok(())
31382024-12-14T03:35:42.748ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31392024-12-14T03:35:42.748ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31402024-12-14T03:35:42.750ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31412024-12-14T03:35:42.750ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31422024-12-14T03:35:42.752ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31432024-12-14T03:35:42.752ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31442024-12-14T03:35:42.753ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31452024-12-14T03:35:42.753ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31462024-12-14T03:35:42.755ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
31472024-12-14T03:35:42.756ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 578bc52c-ac81-41a6-a56b-dfc79805368e, lookup_type: ById(578bc52c-ac81-41a6-a56b-dfc79805368e) }, key: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, lookup_type: ById(6d1b4298-6f48-4e38-b4c6-02b2175d87a2) } result = Ok(())
31482024-12-14T03:35:42.756ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31492024-12-14T03:35:42.756ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31502024-12-14T03:35:42.757ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
31512024-12-14T03:35:42.758ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "db95a822bf0fd07240bed3e48d369a3d91a78b45", lookup_type: ByCompositeId("db95a822bf0fd07240bed3e48d369a3d91a78b45") } result = Ok(())
31522024-12-14T03:35:42.758ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31532024-12-14T03:35:42.758ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31542024-12-14T03:35:42.771ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31552024-12-14T03:35:42.771ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31562024-12-14T03:35:42.772ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31572024-12-14T03:35:42.773ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31582024-12-14T03:35:42.774ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31592024-12-14T03:35:42.775ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31602024-12-14T03:35:42.776ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31612024-12-14T03:35:42.776ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31622024-12-14T03:35:42.777ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
31632024-12-14T03:35:42.778ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 578bc52c-ac81-41a6-a56b-dfc79805368e, lookup_type: ById(578bc52c-ac81-41a6-a56b-dfc79805368e) }, key: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, lookup_type: ById(6d1b4298-6f48-4e38-b4c6-02b2175d87a2) } result = Ok(())
31642024-12-14T03:35:42.778ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31652024-12-14T03:35:42.778ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31662024-12-14T03:35:42.780ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31672024-12-14T03:35:42.780ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31682024-12-14T03:35:42.782ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31692024-12-14T03:35:42.782ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31702024-12-14T03:35:42.783ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
31712024-12-14T03:35:42.784ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 578bc52c-ac81-41a6-a56b-dfc79805368e, lookup_type: ById(578bc52c-ac81-41a6-a56b-dfc79805368e) } result = Ok(())
31722024-12-14T03:35:42.784ZDEBGnexus (dropshot_external): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = GET remote_addr = 10.151.1.100:34803 req_id = 6719413f-a9bc-47e2-8ea7-7ac38c7c747c roles = RoleSet { roles: {} } uri = /v1/projects
31732024-12-14T03:35:42.784ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = GET remote_addr = 10.151.1.100:34803 req_id = 6719413f-a9bc-47e2-8ea7-7ac38c7c747c resource = Database result = Ok(()) uri = /v1/projects
31742024-12-14T03:35:42.792ZDEBGnexus (dropshot_external): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = GET remote_addr = 10.151.1.100:34803 req_id = 6719413f-a9bc-47e2-8ea7-7ac38c7c747c roles = RoleSet { roles: {} } uri = /v1/projects
31752024-12-14T03:35:42.792ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = GET remote_addr = 10.151.1.100:34803 req_id = 6719413f-a9bc-47e2-8ea7-7ac38c7c747c resource = Database result = Ok(()) uri = /v1/projects
31762024-12-14T03:35:42.799ZDEBGnexus (dropshot_external): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = GET remote_addr = 10.151.1.100:34803 req_id = 6719413f-a9bc-47e2-8ea7-7ac38c7c747c roles = RoleSet { roles: {} } uri = /v1/projects
31772024-12-14T03:35:42.799ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = GET remote_addr = 10.151.1.100:34803 req_id = 6719413f-a9bc-47e2-8ea7-7ac38c7c747c resource = Database result = Ok(()) uri = /v1/projects
31782024-12-14T03:35:42.808ZDEBGnexus (dropshot_external): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = GET remote_addr = 10.151.1.100:34803 req_id = 6719413f-a9bc-47e2-8ea7-7ac38c7c747c roles = RoleSet { roles: {(Silo, 578bc52c-ac81-41a6-a56b-dfc79805368e, "admin")} } uri = /v1/projects
31792024-12-14T03:35:42.809ZDEBGnexus (dropshot_external): authorize result action = ListChildren actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = GET remote_addr = 10.151.1.100:34803 req_id = 6719413f-a9bc-47e2-8ea7-7ac38c7c747c resource = Silo { parent: Fleet, key: 578bc52c-ac81-41a6-a56b-dfc79805368e, lookup_type: ById(578bc52c-ac81-41a6-a56b-dfc79805368e) } result = Ok(()) uri = /v1/projects
31802024-12-14T03:35:42.809ZDEBGnexus (dropshot_external): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = GET remote_addr = 10.151.1.100:34803 req_id = 6719413f-a9bc-47e2-8ea7-7ac38c7c747c roles = RoleSet { roles: {} } uri = /v1/projects
31812024-12-14T03:35:42.809ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = GET remote_addr = 10.151.1.100:34803 req_id = 6719413f-a9bc-47e2-8ea7-7ac38c7c747c resource = Database result = Ok(()) uri = /v1/projects
31822024-12-14T03:35:42.811ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 73945 local_addr = 172.30.2.6:443 method = GET remote_addr = 10.151.1.100:34803 req_id = 6719413f-a9bc-47e2-8ea7-7ac38c7c747c response_code = 200 uri = /v1/projects
31832024-12-14T03:35:42.816ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31842024-12-14T03:35:42.816ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31852024-12-14T03:35:42.818ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31862024-12-14T03:35:42.818ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31872024-12-14T03:35:42.819ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
31882024-12-14T03:35:42.821ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "db95a822bf0fd07240bed3e48d369a3d91a78b45", lookup_type: ByCompositeId("token = \\"db95a822bf0fd07240bed3e48d369a3d91a78b45\\"") } result = Ok(())
31892024-12-14T03:35:42.821ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31902024-12-14T03:35:42.821ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31912024-12-14T03:35:42.822ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31922024-12-14T03:35:42.823ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31932024-12-14T03:35:42.824ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31942024-12-14T03:35:42.824ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31952024-12-14T03:35:42.825ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31962024-12-14T03:35:42.826ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31972024-12-14T03:35:42.827ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
31982024-12-14T03:35:42.828ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 578bc52c-ac81-41a6-a56b-dfc79805368e, lookup_type: ById(578bc52c-ac81-41a6-a56b-dfc79805368e) }, key: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, lookup_type: ById(6d1b4298-6f48-4e38-b4c6-02b2175d87a2) } result = Ok(())
31992024-12-14T03:35:42.828ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32002024-12-14T03:35:42.828ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32012024-12-14T03:35:42.829ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
32022024-12-14T03:35:42.830ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "db95a822bf0fd07240bed3e48d369a3d91a78b45", lookup_type: ByCompositeId("db95a822bf0fd07240bed3e48d369a3d91a78b45") } result = Ok(())
32032024-12-14T03:35:42.830ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32042024-12-14T03:35:42.831ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32052024-12-14T03:35:42.840ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32062024-12-14T03:35:42.840ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32072024-12-14T03:35:42.841ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32082024-12-14T03:35:42.841ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32092024-12-14T03:35:42.842ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32102024-12-14T03:35:42.842ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32112024-12-14T03:35:42.844ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32122024-12-14T03:35:42.844ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32132024-12-14T03:35:42.845ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
32142024-12-14T03:35:42.846ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 578bc52c-ac81-41a6-a56b-dfc79805368e, lookup_type: ById(578bc52c-ac81-41a6-a56b-dfc79805368e) }, key: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, lookup_type: ById(6d1b4298-6f48-4e38-b4c6-02b2175d87a2) } result = Ok(())
32152024-12-14T03:35:42.846ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32162024-12-14T03:35:42.846ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32172024-12-14T03:35:42.847ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32182024-12-14T03:35:42.848ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32192024-12-14T03:35:42.849ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32202024-12-14T03:35:42.849ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32212024-12-14T03:35:42.850ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
32222024-12-14T03:35:42.852ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 578bc52c-ac81-41a6-a56b-dfc79805368e, lookup_type: ById(578bc52c-ac81-41a6-a56b-dfc79805368e) } result = Ok(())
32232024-12-14T03:35:42.852ZDEBGnexus (dropshot_external): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:34803 req_id = 17a80194-6df9-4d8c-93de-16dcdd5c538a roles = RoleSet { roles: {} } uri = /v1/system/ip-pools
32242024-12-14T03:35:42.852ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:34803 req_id = 17a80194-6df9-4d8c-93de-16dcdd5c538a resource = Database result = Ok(()) uri = /v1/system/ip-pools
32252024-12-14T03:35:42.855ZDEBGnexus (dropshot_external): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:34803 req_id = 17a80194-6df9-4d8c-93de-16dcdd5c538a roles = RoleSet { roles: {} } uri = /v1/system/ip-pools
32262024-12-14T03:35:42.855ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:34803 req_id = 17a80194-6df9-4d8c-93de-16dcdd5c538a resource = Database result = Ok(()) uri = /v1/system/ip-pools
32272024-12-14T03:35:42.857ZDEBGnexus (dropshot_external): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:34803 req_id = 17a80194-6df9-4d8c-93de-16dcdd5c538a roles = RoleSet { roles: {(Silo, 578bc52c-ac81-41a6-a56b-dfc79805368e, "admin")} } uri = /v1/system/ip-pools
32282024-12-14T03:35:42.859ZDEBGnexus (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:34803 req_id = 17a80194-6df9-4d8c-93de-16dcdd5c538a resource = IpPoolList result = Ok(()) uri = /v1/system/ip-pools
32292024-12-14T03:35:42.859ZDEBGnexus (dropshot_external): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:34803 req_id = 17a80194-6df9-4d8c-93de-16dcdd5c538a roles = RoleSet { roles: {} } uri = /v1/system/ip-pools
32302024-12-14T03:35:42.859ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:34803 req_id = 17a80194-6df9-4d8c-93de-16dcdd5c538a resource = Database result = Ok(()) uri = /v1/system/ip-pools
32312024-12-14T03:35:42.864ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 48146 local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:34803 req_id = 17a80194-6df9-4d8c-93de-16dcdd5c538a response_code = 201 uri = /v1/system/ip-pools
32322024-12-14T03:35:42.866ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32332024-12-14T03:35:42.866ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32342024-12-14T03:35:42.867ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32352024-12-14T03:35:42.868ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32362024-12-14T03:35:42.869ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
32372024-12-14T03:35:42.870ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "db95a822bf0fd07240bed3e48d369a3d91a78b45", lookup_type: ByCompositeId("token = \\"db95a822bf0fd07240bed3e48d369a3d91a78b45\\"") } result = Ok(())
32382024-12-14T03:35:42.870ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32392024-12-14T03:35:42.870ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32402024-12-14T03:35:42.871ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32412024-12-14T03:35:42.872ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32422024-12-14T03:35:42.873ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32432024-12-14T03:35:42.873ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32442024-12-14T03:35:42.874ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32452024-12-14T03:35:42.874ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32462024-12-14T03:35:42.875ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
32472024-12-14T03:35:42.877ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 578bc52c-ac81-41a6-a56b-dfc79805368e, lookup_type: ById(578bc52c-ac81-41a6-a56b-dfc79805368e) }, key: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, lookup_type: ById(6d1b4298-6f48-4e38-b4c6-02b2175d87a2) } result = Ok(())
32482024-12-14T03:35:42.877ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32492024-12-14T03:35:42.877ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32502024-12-14T03:35:42.878ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
32512024-12-14T03:35:42.879ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "db95a822bf0fd07240bed3e48d369a3d91a78b45", lookup_type: ByCompositeId("db95a822bf0fd07240bed3e48d369a3d91a78b45") } result = Ok(())
32522024-12-14T03:35:42.879ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32532024-12-14T03:35:42.879ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32542024-12-14T03:35:42.884ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32552024-12-14T03:35:42.884ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32562024-12-14T03:35:42.885ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32572024-12-14T03:35:42.885ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32582024-12-14T03:35:42.887ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32592024-12-14T03:35:42.887ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32602024-12-14T03:35:42.888ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32612024-12-14T03:35:42.888ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32622024-12-14T03:35:42.890ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
32632024-12-14T03:35:42.891ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 578bc52c-ac81-41a6-a56b-dfc79805368e, lookup_type: ById(578bc52c-ac81-41a6-a56b-dfc79805368e) }, key: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, lookup_type: ById(6d1b4298-6f48-4e38-b4c6-02b2175d87a2) } result = Ok(())
32642024-12-14T03:35:42.891ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32652024-12-14T03:35:42.891ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32662024-12-14T03:35:42.892ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32672024-12-14T03:35:42.892ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32682024-12-14T03:35:42.894ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32692024-12-14T03:35:42.894ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32702024-12-14T03:35:42.895ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
32712024-12-14T03:35:42.896ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 578bc52c-ac81-41a6-a56b-dfc79805368e, lookup_type: ById(578bc52c-ac81-41a6-a56b-dfc79805368e) } result = Ok(())
32722024-12-14T03:35:42.896ZDEBGnexus (dropshot_external): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:34803 req_id = d97656d4-9eef-4598-8573-e5d5bd812460 roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/silos
32732024-12-14T03:35:42.896ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:34803 req_id = d97656d4-9eef-4598-8573-e5d5bd812460 resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/silos
32742024-12-14T03:35:42.898ZDEBGnexus (dropshot_external): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:34803 req_id = d97656d4-9eef-4598-8573-e5d5bd812460 roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/silos
32752024-12-14T03:35:42.898ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:34803 req_id = d97656d4-9eef-4598-8573-e5d5bd812460 resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/silos
32762024-12-14T03:35:42.907ZDEBGnexus (dropshot_external): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:34803 req_id = d97656d4-9eef-4598-8573-e5d5bd812460 roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/silos
32772024-12-14T03:35:42.907ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:34803 req_id = d97656d4-9eef-4598-8573-e5d5bd812460 resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/silos
32782024-12-14T03:35:42.910ZDEBGnexus (dropshot_external): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:34803 req_id = d97656d4-9eef-4598-8573-e5d5bd812460 roles = RoleSet { roles: {(Silo, 578bc52c-ac81-41a6-a56b-dfc79805368e, "admin")} } uri = /v1/system/ip-pools/default/silos
32792024-12-14T03:35:42.912ZDEBGnexus (dropshot_external): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:34803 req_id = d97656d4-9eef-4598-8573-e5d5bd812460 resource = IpPool { parent: Fleet, key: c8a62522-9fac-42f9-9670-6cf7e7111ef5, lookup_type: ByName("default") } result = Ok(()) uri = /v1/system/ip-pools/default/silos
32802024-12-14T03:35:42.912ZDEBGnexus (dropshot_external): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:34803 req_id = d97656d4-9eef-4598-8573-e5d5bd812460 roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/silos
32812024-12-14T03:35:42.912ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:34803 req_id = d97656d4-9eef-4598-8573-e5d5bd812460 resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/silos
32822024-12-14T03:35:42.914ZDEBGnexus (dropshot_external): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:34803 req_id = d97656d4-9eef-4598-8573-e5d5bd812460 roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/silos
32832024-12-14T03:35:42.914ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:34803 req_id = d97656d4-9eef-4598-8573-e5d5bd812460 resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/silos
32842024-12-14T03:35:42.917ZDEBGnexus (dropshot_external): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:34803 req_id = d97656d4-9eef-4598-8573-e5d5bd812460 roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/silos
32852024-12-14T03:35:42.917ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:34803 req_id = d97656d4-9eef-4598-8573-e5d5bd812460 resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/silos
32862024-12-14T03:35:42.919ZDEBGnexus (dropshot_external): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:34803 req_id = d97656d4-9eef-4598-8573-e5d5bd812460 roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/silos
32872024-12-14T03:35:42.919ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:34803 req_id = d97656d4-9eef-4598-8573-e5d5bd812460 resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/silos
32882024-12-14T03:35:42.921ZDEBGnexus (dropshot_external): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:34803 req_id = d97656d4-9eef-4598-8573-e5d5bd812460 roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/silos
32892024-12-14T03:35:42.921ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:34803 req_id = d97656d4-9eef-4598-8573-e5d5bd812460 resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/silos
32902024-12-14T03:35:42.923ZDEBGnexus (dropshot_external): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:34803 req_id = d97656d4-9eef-4598-8573-e5d5bd812460 roles = RoleSet { roles: {(Silo, 578bc52c-ac81-41a6-a56b-dfc79805368e, "admin")} } uri = /v1/system/ip-pools/default/silos
32912024-12-14T03:35:42.924ZDEBGnexus (dropshot_external): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:34803 req_id = d97656d4-9eef-4598-8573-e5d5bd812460 resource = Silo { parent: Fleet, key: 578bc52c-ac81-41a6-a56b-dfc79805368e, lookup_type: ByName("recovery") } result = Ok(()) uri = /v1/system/ip-pools/default/silos
32922024-12-14T03:35:42.924ZDEBGnexus (dropshot_external): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:34803 req_id = d97656d4-9eef-4598-8573-e5d5bd812460 roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/silos
32932024-12-14T03:35:42.924ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:34803 req_id = d97656d4-9eef-4598-8573-e5d5bd812460 resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/silos
32942024-12-14T03:35:42.926ZDEBGnexus (dropshot_external): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:34803 req_id = d97656d4-9eef-4598-8573-e5d5bd812460 roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/silos
32952024-12-14T03:35:42.927ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:34803 req_id = d97656d4-9eef-4598-8573-e5d5bd812460 resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/silos
32962024-12-14T03:35:42.928ZDEBGnexus (dropshot_external): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:34803 req_id = d97656d4-9eef-4598-8573-e5d5bd812460 roles = RoleSet { roles: {(Silo, 578bc52c-ac81-41a6-a56b-dfc79805368e, "admin")} } uri = /v1/system/ip-pools/default/silos
32972024-12-14T03:35:42.930ZDEBGnexus (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:34803 req_id = d97656d4-9eef-4598-8573-e5d5bd812460 resource = IpPoolList result = Ok(()) uri = /v1/system/ip-pools/default/silos
32982024-12-14T03:35:42.931ZDEBGnexus (dropshot_external): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:34803 req_id = d97656d4-9eef-4598-8573-e5d5bd812460 roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/silos
32992024-12-14T03:35:42.931ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:34803 req_id = d97656d4-9eef-4598-8573-e5d5bd812460 resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/silos
33002024-12-14T03:35:42.980ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 115104 local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:34803 req_id = d97656d4-9eef-4598-8573-e5d5bd812460 response_code = 201 uri = /v1/system/ip-pools/default/silos
33012024-12-14T03:35:42.982ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
33022024-12-14T03:35:42.982ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
33032024-12-14T03:35:42.990ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
33042024-12-14T03:35:42.990ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
33052024-12-14T03:35:42.991ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
33062024-12-14T03:35:42.992ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "db95a822bf0fd07240bed3e48d369a3d91a78b45", lookup_type: ByCompositeId("token = \\"db95a822bf0fd07240bed3e48d369a3d91a78b45\\"") } result = Ok(())
33072024-12-14T03:35:42.992ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
33082024-12-14T03:35:42.992ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
33092024-12-14T03:35:42.994ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
33102024-12-14T03:35:42.994ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
33112024-12-14T03:35:42.996ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
33122024-12-14T03:35:42.996ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
33132024-12-14T03:35:42.997ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
33142024-12-14T03:35:42.997ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
33152024-12-14T03:35:42.998ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
33162024-12-14T03:35:43.000ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 578bc52c-ac81-41a6-a56b-dfc79805368e, lookup_type: ById(578bc52c-ac81-41a6-a56b-dfc79805368e) }, key: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, lookup_type: ById(6d1b4298-6f48-4e38-b4c6-02b2175d87a2) } result = Ok(())
33172024-12-14T03:35:43.000ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
33182024-12-14T03:35:43.000ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
33192024-12-14T03:35:43.001ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
33202024-12-14T03:35:43.002ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "db95a822bf0fd07240bed3e48d369a3d91a78b45", lookup_type: ByCompositeId("db95a822bf0fd07240bed3e48d369a3d91a78b45") } result = Ok(())
33212024-12-14T03:35:43.002ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
33222024-12-14T03:35:43.003ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
33232024-12-14T03:35:43.006ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
33242024-12-14T03:35:43.006ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
33252024-12-14T03:35:43.007ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
33262024-12-14T03:35:43.008ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
33272024-12-14T03:35:43.009ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
33282024-12-14T03:35:43.009ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
33292024-12-14T03:35:43.010ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
33302024-12-14T03:35:43.010ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
33312024-12-14T03:35:43.012ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
33322024-12-14T03:35:43.013ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 578bc52c-ac81-41a6-a56b-dfc79805368e, lookup_type: ById(578bc52c-ac81-41a6-a56b-dfc79805368e) }, key: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, lookup_type: ById(6d1b4298-6f48-4e38-b4c6-02b2175d87a2) } result = Ok(())
33332024-12-14T03:35:43.013ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
33342024-12-14T03:35:43.013ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
33352024-12-14T03:35:43.014ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
33362024-12-14T03:35:43.014ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
33372024-12-14T03:35:43.015ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
33382024-12-14T03:35:43.015ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
33392024-12-14T03:35:43.017ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
33402024-12-14T03:35:43.018ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 578bc52c-ac81-41a6-a56b-dfc79805368e, lookup_type: ById(578bc52c-ac81-41a6-a56b-dfc79805368e) } result = Ok(())
33412024-12-14T03:35:43.018ZDEBGnexus (dropshot_external): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:34803 req_id = 4b733962-be19-4959-b2e8-b70ce2b47ad3 roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/ranges/add
33422024-12-14T03:35:43.018ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:34803 req_id = 4b733962-be19-4959-b2e8-b70ce2b47ad3 resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/ranges/add
33432024-12-14T03:35:43.020ZDEBGnexus (dropshot_external): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:34803 req_id = 4b733962-be19-4959-b2e8-b70ce2b47ad3 roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/ranges/add
33442024-12-14T03:35:43.020ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:34803 req_id = 4b733962-be19-4959-b2e8-b70ce2b47ad3 resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/ranges/add
33452024-12-14T03:35:43.022ZDEBGnexus (dropshot_external): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:34803 req_id = 4b733962-be19-4959-b2e8-b70ce2b47ad3 roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/ranges/add
33462024-12-14T03:35:43.022ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:34803 req_id = 4b733962-be19-4959-b2e8-b70ce2b47ad3 resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/ranges/add
33472024-12-14T03:35:43.024ZDEBGnexus (dropshot_external): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:34803 req_id = 4b733962-be19-4959-b2e8-b70ce2b47ad3 roles = RoleSet { roles: {(Silo, 578bc52c-ac81-41a6-a56b-dfc79805368e, "admin")} } uri = /v1/system/ip-pools/default/ranges/add
33482024-12-14T03:35:43.026ZDEBGnexus (dropshot_external): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:34803 req_id = 4b733962-be19-4959-b2e8-b70ce2b47ad3 resource = IpPool { parent: Fleet, key: c8a62522-9fac-42f9-9670-6cf7e7111ef5, lookup_type: ByName("default") } result = Ok(()) uri = /v1/system/ip-pools/default/ranges/add
33492024-12-14T03:35:43.026ZDEBGnexus (dropshot_external): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:34803 req_id = 4b733962-be19-4959-b2e8-b70ce2b47ad3 roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/ranges/add
33502024-12-14T03:35:43.027ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:34803 req_id = 4b733962-be19-4959-b2e8-b70ce2b47ad3 resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/ranges/add
33512024-12-14T03:35:43.028ZDEBGnexus (dropshot_external): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:34803 req_id = 4b733962-be19-4959-b2e8-b70ce2b47ad3 roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/ranges/add
33522024-12-14T03:35:43.029ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:34803 req_id = 4b733962-be19-4959-b2e8-b70ce2b47ad3 resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/ranges/add
33532024-12-14T03:35:43.029ZDEBGnexus (dropshot_external): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:34803 req_id = 4b733962-be19-4959-b2e8-b70ce2b47ad3 roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/ranges/add
33542024-12-14T03:35:43.029ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:34803 req_id = 4b733962-be19-4959-b2e8-b70ce2b47ad3 resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/ranges/add
33552024-12-14T03:35:43.031ZDEBGnexus (dropshot_external): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:34803 req_id = 4b733962-be19-4959-b2e8-b70ce2b47ad3 roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/ranges/add
33562024-12-14T03:35:43.031ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:34803 req_id = 4b733962-be19-4959-b2e8-b70ce2b47ad3 resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/ranges/add
33572024-12-14T03:35:43.034ZDEBGnexus (dropshot_external): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:34803 req_id = 4b733962-be19-4959-b2e8-b70ce2b47ad3 roles = RoleSet { roles: {(Silo, 578bc52c-ac81-41a6-a56b-dfc79805368e, "admin")} } uri = /v1/system/ip-pools/default/ranges/add
33582024-12-14T03:35:43.035ZDEBGnexus (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:34803 req_id = 4b733962-be19-4959-b2e8-b70ce2b47ad3 resource = IpPool { parent: Fleet, key: c8a62522-9fac-42f9-9670-6cf7e7111ef5, lookup_type: ByName("default") } result = Ok(()) uri = /v1/system/ip-pools/default/ranges/add
33592024-12-14T03:35:43.043ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 61528 local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:34803 req_id = 4b733962-be19-4959-b2e8-b70ce2b47ad3 response_code = 201 uri = /v1/system/ip-pools/default/ranges/add
33602024-12-14T03:35:43.045ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
33612024-12-14T03:35:43.045ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
33622024-12-14T03:35:43.046ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
33632024-12-14T03:35:43.047ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
33642024-12-14T03:35:43.047ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
33652024-12-14T03:35:43.049ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "db95a822bf0fd07240bed3e48d369a3d91a78b45", lookup_type: ByCompositeId("token = \\"db95a822bf0fd07240bed3e48d369a3d91a78b45\\"") } result = Ok(())
33662024-12-14T03:35:43.049ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
33672024-12-14T03:35:43.049ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
33682024-12-14T03:35:43.050ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
33692024-12-14T03:35:43.050ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
33702024-12-14T03:35:43.051ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
33712024-12-14T03:35:43.051ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
33722024-12-14T03:35:43.053ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
33732024-12-14T03:35:43.053ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
33742024-12-14T03:35:43.054ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
33752024-12-14T03:35:43.055ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 578bc52c-ac81-41a6-a56b-dfc79805368e, lookup_type: ById(578bc52c-ac81-41a6-a56b-dfc79805368e) }, key: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, lookup_type: ById(6d1b4298-6f48-4e38-b4c6-02b2175d87a2) } result = Ok(())
33762024-12-14T03:35:43.055ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
33772024-12-14T03:35:43.055ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
33782024-12-14T03:35:43.056ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
33792024-12-14T03:35:43.057ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "db95a822bf0fd07240bed3e48d369a3d91a78b45", lookup_type: ByCompositeId("db95a822bf0fd07240bed3e48d369a3d91a78b45") } result = Ok(())
33802024-12-14T03:35:43.057ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
33812024-12-14T03:35:43.058ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
33822024-12-14T03:35:43.061ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
33832024-12-14T03:35:43.061ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
33842024-12-14T03:35:43.062ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
33852024-12-14T03:35:43.062ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
33862024-12-14T03:35:43.063ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
33872024-12-14T03:35:43.064ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
33882024-12-14T03:35:43.065ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
33892024-12-14T03:35:43.065ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
33902024-12-14T03:35:43.066ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
33912024-12-14T03:35:43.067ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 578bc52c-ac81-41a6-a56b-dfc79805368e, lookup_type: ById(578bc52c-ac81-41a6-a56b-dfc79805368e) }, key: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, lookup_type: ById(6d1b4298-6f48-4e38-b4c6-02b2175d87a2) } result = Ok(())
33922024-12-14T03:35:43.067ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
33932024-12-14T03:35:43.067ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
33942024-12-14T03:35:43.068ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
33952024-12-14T03:35:43.068ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
33962024-12-14T03:35:43.069ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
33972024-12-14T03:35:43.070ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
33982024-12-14T03:35:43.071ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
33992024-12-14T03:35:43.072ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 578bc52c-ac81-41a6-a56b-dfc79805368e, lookup_type: ById(578bc52c-ac81-41a6-a56b-dfc79805368e) } result = Ok(())
34002024-12-14T03:35:43.072ZDEBGnexus (dropshot_external): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = PUT remote_addr = 10.151.1.100:34803 req_id = 28e84289-7d2c-4cf6-8b1a-509161d125ba roles = RoleSet { roles: {} } uri = /v1/system/silos/recovery/quotas
34012024-12-14T03:35:43.072ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = PUT remote_addr = 10.151.1.100:34803 req_id = 28e84289-7d2c-4cf6-8b1a-509161d125ba resource = Database result = Ok(()) uri = /v1/system/silos/recovery/quotas
34022024-12-14T03:35:43.074ZDEBGnexus (dropshot_external): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = PUT remote_addr = 10.151.1.100:34803 req_id = 28e84289-7d2c-4cf6-8b1a-509161d125ba roles = RoleSet { roles: {} } uri = /v1/system/silos/recovery/quotas
34032024-12-14T03:35:43.074ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = PUT remote_addr = 10.151.1.100:34803 req_id = 28e84289-7d2c-4cf6-8b1a-509161d125ba resource = Database result = Ok(()) uri = /v1/system/silos/recovery/quotas
34042024-12-14T03:35:43.076ZDEBGnexus (dropshot_external): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = PUT remote_addr = 10.151.1.100:34803 req_id = 28e84289-7d2c-4cf6-8b1a-509161d125ba roles = RoleSet { roles: {} } uri = /v1/system/silos/recovery/quotas
34052024-12-14T03:35:43.076ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = PUT remote_addr = 10.151.1.100:34803 req_id = 28e84289-7d2c-4cf6-8b1a-509161d125ba resource = Database result = Ok(()) uri = /v1/system/silos/recovery/quotas
34062024-12-14T03:35:43.078ZDEBGnexus (dropshot_external): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = PUT remote_addr = 10.151.1.100:34803 req_id = 28e84289-7d2c-4cf6-8b1a-509161d125ba roles = RoleSet { roles: {} } uri = /v1/system/silos/recovery/quotas
34072024-12-14T03:35:43.078ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = PUT remote_addr = 10.151.1.100:34803 req_id = 28e84289-7d2c-4cf6-8b1a-509161d125ba resource = Database result = Ok(()) uri = /v1/system/silos/recovery/quotas
34082024-12-14T03:35:43.081ZDEBGnexus (dropshot_external): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = PUT remote_addr = 10.151.1.100:34803 req_id = 28e84289-7d2c-4cf6-8b1a-509161d125ba roles = RoleSet { roles: {(Silo, 578bc52c-ac81-41a6-a56b-dfc79805368e, "admin")} } uri = /v1/system/silos/recovery/quotas
34092024-12-14T03:35:43.082ZDEBGnexus (dropshot_external): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = PUT remote_addr = 10.151.1.100:34803 req_id = 28e84289-7d2c-4cf6-8b1a-509161d125ba resource = Silo { parent: Fleet, key: 578bc52c-ac81-41a6-a56b-dfc79805368e, lookup_type: ByName("recovery") } result = Ok(()) uri = /v1/system/silos/recovery/quotas
34102024-12-14T03:35:43.082ZDEBGnexus (dropshot_external): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = PUT remote_addr = 10.151.1.100:34803 req_id = 28e84289-7d2c-4cf6-8b1a-509161d125ba roles = RoleSet { roles: {} } uri = /v1/system/silos/recovery/quotas
34112024-12-14T03:35:43.082ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = PUT remote_addr = 10.151.1.100:34803 req_id = 28e84289-7d2c-4cf6-8b1a-509161d125ba resource = Database result = Ok(()) uri = /v1/system/silos/recovery/quotas
34122024-12-14T03:35:43.084ZDEBGnexus (dropshot_external): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = PUT remote_addr = 10.151.1.100:34803 req_id = 28e84289-7d2c-4cf6-8b1a-509161d125ba roles = RoleSet { roles: {} } uri = /v1/system/silos/recovery/quotas
34132024-12-14T03:35:43.084ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = PUT remote_addr = 10.151.1.100:34803 req_id = 28e84289-7d2c-4cf6-8b1a-509161d125ba resource = Database result = Ok(()) uri = /v1/system/silos/recovery/quotas
34142024-12-14T03:35:43.086ZDEBGnexus (dropshot_external): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = PUT remote_addr = 10.151.1.100:34803 req_id = 28e84289-7d2c-4cf6-8b1a-509161d125ba roles = RoleSet { roles: {} } uri = /v1/system/silos/recovery/quotas
34152024-12-14T03:35:43.086ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = PUT remote_addr = 10.151.1.100:34803 req_id = 28e84289-7d2c-4cf6-8b1a-509161d125ba resource = Database result = Ok(()) uri = /v1/system/silos/recovery/quotas
34162024-12-14T03:35:43.088ZDEBGnexus (dropshot_external): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = PUT remote_addr = 10.151.1.100:34803 req_id = 28e84289-7d2c-4cf6-8b1a-509161d125ba roles = RoleSet { roles: {(Silo, 578bc52c-ac81-41a6-a56b-dfc79805368e, "admin")} } uri = /v1/system/silos/recovery/quotas
34172024-12-14T03:35:43.089ZDEBGnexus (dropshot_external): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = PUT remote_addr = 10.151.1.100:34803 req_id = 28e84289-7d2c-4cf6-8b1a-509161d125ba resource = Silo { parent: Fleet, key: 578bc52c-ac81-41a6-a56b-dfc79805368e, lookup_type: ByName("recovery") } result = Ok(()) uri = /v1/system/silos/recovery/quotas
34182024-12-14T03:35:43.089ZDEBGnexus (dropshot_external): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = PUT remote_addr = 10.151.1.100:34803 req_id = 28e84289-7d2c-4cf6-8b1a-509161d125ba roles = RoleSet { roles: {} } uri = /v1/system/silos/recovery/quotas
34192024-12-14T03:35:43.090ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = PUT remote_addr = 10.151.1.100:34803 req_id = 28e84289-7d2c-4cf6-8b1a-509161d125ba resource = Database result = Ok(()) uri = /v1/system/silos/recovery/quotas
34202024-12-14T03:35:43.100ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 55339 local_addr = 172.30.2.6:443 method = PUT remote_addr = 10.151.1.100:34803 req_id = 28e84289-7d2c-4cf6-8b1a-509161d125ba response_code = 200 uri = /v1/system/silos/recovery/quotas
34212024-12-14T03:35:43.102ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
34222024-12-14T03:35:43.103ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
34232024-12-14T03:35:43.104ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
34242024-12-14T03:35:43.104ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
34252024-12-14T03:35:43.105ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
34262024-12-14T03:35:43.106ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "db95a822bf0fd07240bed3e48d369a3d91a78b45", lookup_type: ByCompositeId("token = \\"db95a822bf0fd07240bed3e48d369a3d91a78b45\\"") } result = Ok(())
34272024-12-14T03:35:43.106ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
34282024-12-14T03:35:43.106ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
34292024-12-14T03:35:43.108ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
34302024-12-14T03:35:43.108ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
34312024-12-14T03:35:43.109ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
34322024-12-14T03:35:43.109ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
34332024-12-14T03:35:43.111ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
34342024-12-14T03:35:43.111ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
34352024-12-14T03:35:43.112ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
34362024-12-14T03:35:43.113ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 578bc52c-ac81-41a6-a56b-dfc79805368e, lookup_type: ById(578bc52c-ac81-41a6-a56b-dfc79805368e) }, key: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, lookup_type: ById(6d1b4298-6f48-4e38-b4c6-02b2175d87a2) } result = Ok(())
34372024-12-14T03:35:43.113ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
34382024-12-14T03:35:43.113ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
34392024-12-14T03:35:43.114ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
34402024-12-14T03:35:43.116ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "db95a822bf0fd07240bed3e48d369a3d91a78b45", lookup_type: ByCompositeId("db95a822bf0fd07240bed3e48d369a3d91a78b45") } result = Ok(())
34412024-12-14T03:35:43.116ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
34422024-12-14T03:35:43.116ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
34432024-12-14T03:35:43.119ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
34442024-12-14T03:35:43.119ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
34452024-12-14T03:35:43.120ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
34462024-12-14T03:35:43.120ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
34472024-12-14T03:35:43.121ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
34482024-12-14T03:35:43.122ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
34492024-12-14T03:35:43.123ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
34502024-12-14T03:35:43.123ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
34512024-12-14T03:35:43.124ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
34522024-12-14T03:35:43.126ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 578bc52c-ac81-41a6-a56b-dfc79805368e, lookup_type: ById(578bc52c-ac81-41a6-a56b-dfc79805368e) }, key: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, lookup_type: ById(6d1b4298-6f48-4e38-b4c6-02b2175d87a2) } result = Ok(())
34532024-12-14T03:35:43.126ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
34542024-12-14T03:35:43.126ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
34552024-12-14T03:35:43.127ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
34562024-12-14T03:35:43.127ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
34572024-12-14T03:35:43.128ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
34582024-12-14T03:35:43.128ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
34592024-12-14T03:35:43.129ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
34602024-12-14T03:35:43.131ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 578bc52c-ac81-41a6-a56b-dfc79805368e, lookup_type: ById(578bc52c-ac81-41a6-a56b-dfc79805368e) } result = Ok(())
34612024-12-14T03:35:43.131ZDEBGnexus (dropshot_external): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:34803 req_id = 4d658d6f-2637-4b64-8bbc-4cda9b47f916 roles = RoleSet { roles: {} } uri = /v1/projects
34622024-12-14T03:35:43.131ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:34803 req_id = 4d658d6f-2637-4b64-8bbc-4cda9b47f916 resource = Database result = Ok(()) uri = /v1/projects
34632024-12-14T03:35:43.133ZDEBGnexus (dropshot_external): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:34803 req_id = 4d658d6f-2637-4b64-8bbc-4cda9b47f916 roles = RoleSet { roles: {} } uri = /v1/projects
34642024-12-14T03:35:43.133ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:34803 req_id = 4d658d6f-2637-4b64-8bbc-4cda9b47f916 resource = Database result = Ok(()) uri = /v1/projects
34652024-12-14T03:35:43.135ZDEBGnexus (dropshot_external): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:34803 req_id = 4d658d6f-2637-4b64-8bbc-4cda9b47f916 roles = RoleSet { roles: {} } uri = /v1/projects
34662024-12-14T03:35:43.135ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:34803 req_id = 4d658d6f-2637-4b64-8bbc-4cda9b47f916 resource = Database result = Ok(()) uri = /v1/projects
34672024-12-14T03:35:43.138ZDEBGnexus (dropshot_external): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:34803 req_id = 4d658d6f-2637-4b64-8bbc-4cda9b47f916 roles = RoleSet { roles: {(Silo, 578bc52c-ac81-41a6-a56b-dfc79805368e, "admin")} } uri = /v1/projects
34682024-12-14T03:35:43.139ZDEBGnexus (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:34803 req_id = 4d658d6f-2637-4b64-8bbc-4cda9b47f916 resource = Silo { parent: Fleet, key: 578bc52c-ac81-41a6-a56b-dfc79805368e, lookup_type: ById(578bc52c-ac81-41a6-a56b-dfc79805368e) } result = Ok(()) uri = /v1/projects
34692024-12-14T03:35:43.139ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1 saga_name = project-create
34702024-12-14T03:35:43.139ZINFOnexus (SEC): saga create dag = {"end_node":19,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[3,4,null],[4,5,null],[5,6,null],[6,7,null],[7,8,null],[8,9,null],[9,10,null],[10,11,null],[11,12,null],[12,13,null],[13,14,null],[14,15,null],[15,16,null],[2,3,null],[16,17,null],[18,0,null],[17,19,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"project_create.project_create_record","label":"ProjectCreateRecord","name":"project"}},{"Action":{"action_name":"project_create.project_create_vpc_params","label":"ProjectCreateVpcParams","name":"vpc_create_params"}},{"SubsagaStart":{"params_node_name":"vpc_create_params","saga_name":"vpc-create"}},{"Action":{"action_name":"common.uuid_generate","label":"GenerateVpcId","name":"vpc_id"}},{"Action":{"action_name":"common.uuid_generate","label":"GenerateSystemRouterId","name":"system_router_id"}},{"Action":{"action_name":"common.uuid_generate","label":"GenerateDefaultV4RouteId","name":"default_v4_route_id"}},{"Action":{"action_name":"common.uuid_generate","label":"GenerateDefaultV6RouteId","name":"default_v6_route_id"}},{"Action":{"action_name":"common.uuid_generate","label":"GenerateDefaultSubnetId","name":"default_subnet_id"}},{"Action":{"action_name":"common.uuid_generate","label":"GenerateDefaultInternetGatewayId","name":"default_internet_gateway_id"}},{"Action":{"action_name":"vpc_create.vpc_create_vpc","label":"VpcCreateVpc","name":"vpc"}},{"Action":{"action_name":"vpc_create.vpc_create_router","label":"VpcCreateRouter","name":"router"}},{"Action":{"action_name":"vpc_create.vpc_create_v4_route","label":"VpcCreateV4Route","name":"route4"}},{"Action":{"action_name":"vpc_create.vpc_create_v6_route","label":"VpcCreateV6Route","name":"route6"}},{"Action":{"action_name":"vpc_create.vpc_create_subnet","label":"VpcCreateSubnet","name":"subnet"}},{"Action":{"action_name":"vpc_create.vpc_update_firewall","label":"VpcUpdateFirewall","name":"firewall"}},{"Action":{"action_name":"vpc_create.vpc_create_gateway","label":"VpcCreateGateway","name":"gateway"}},{"Action":{"action_name":"vpc_create.vpc_notify_sleds","label":"VpcNotifySleds","name":"no_result"}},{"SubsagaEnd":{"name":"vpc"}},{"Start":{"params":{"authz_silo":{"key":"578bc52c-ac81-41a6-a56b-dfc79805368e","lookup_type":{"ById":"578bc52c-ac81-41a6-a56b-dfc79805368e"},"parent":null},"project_create":{"description":"","name":"proj-9c0961bf572"},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"SiloUser":{"silo_id":"578bc52c-ac81-41a6-a56b-dfc79805368e","silo_user_id":"6d1b4298-6f48-4e38-b4c6-02b2175d87a2"}}},{"mapped_fleet_roles":{"admin":["admin"]}}]}}}}},"End"]},"saga_name":"project-create","start_node":18} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1 saga_name = project-create sec_id = 5f2fe413-3c4a-4994-b4a0-995c1da486b1
34712024-12-14T03:35:43.139ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1 saga_name = project-create
34722024-12-14T03:35:43.176ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1 saga_name = project-create
34732024-12-14T03:35:43.176ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1 saga_name = project-create sec_id = 5f2fe413-3c4a-4994-b4a0-995c1da486b1
34742024-12-14T03:35:43.178ZDEBGnexus (SEC): saga log event new_state = N018 started sec_id = 5f2fe413-3c4a-4994-b4a0-995c1da486b1
34752024-12-14T03:35:43.178ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 18 saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1
34762024-12-14T03:35:43.189ZDEBGnexus (SEC): saga log event new_state = N018 succeeded sec_id = 5f2fe413-3c4a-4994-b4a0-995c1da486b1
34772024-12-14T03:35:43.189ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 18 saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1
34782024-12-14T03:35:43.198ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 5f2fe413-3c4a-4994-b4a0-995c1da486b1
34792024-12-14T03:35:43.198ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1
34802024-12-14T03:35:43.204ZDEBGnexus (SagaExecutor): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true roles = RoleSet { roles: {} } saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1 saga_name = project-create saga_node = ProjectCreateRecord
34812024-12-14T03:35:43.204ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true resource = Database result = Ok(()) saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1 saga_name = project-create saga_node = ProjectCreateRecord
34822024-12-14T03:35:43.207ZDEBGnexus (SagaExecutor): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true roles = RoleSet { roles: {} } saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1 saga_name = project-create saga_node = ProjectCreateRecord
34832024-12-14T03:35:43.207ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true resource = Database result = Ok(()) saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1 saga_name = project-create saga_node = ProjectCreateRecord
34842024-12-14T03:35:43.209ZDEBGnexus (SagaExecutor): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true roles = RoleSet { roles: {} } saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1 saga_name = project-create saga_node = ProjectCreateRecord
34852024-12-14T03:35:43.209ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true resource = Database result = Ok(()) saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1 saga_name = project-create saga_node = ProjectCreateRecord
34862024-12-14T03:35:43.211ZDEBGnexus (SagaExecutor): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true roles = RoleSet { roles: {(Silo, 578bc52c-ac81-41a6-a56b-dfc79805368e, "admin")} } saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1 saga_name = project-create saga_node = ProjectCreateRecord
34872024-12-14T03:35:43.212ZDEBGnexus (SagaExecutor): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true resource = Silo { parent: Fleet, key: 578bc52c-ac81-41a6-a56b-dfc79805368e, lookup_type: ById(578bc52c-ac81-41a6-a56b-dfc79805368e) } result = Ok(()) saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1 saga_name = project-create saga_node = ProjectCreateRecord
34882024-12-14T03:35:43.212ZDEBGnexus (SagaExecutor): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true roles = RoleSet { roles: {} } saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1 saga_name = project-create saga_node = ProjectCreateRecord
34892024-12-14T03:35:43.212ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true resource = Database result = Ok(()) saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1 saga_name = project-create saga_node = ProjectCreateRecord
34902024-12-14T03:35:43.223ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 5f2fe413-3c4a-4994-b4a0-995c1da486b1
34912024-12-14T03:35:43.223ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Array [Object {"key": String("8aed7aa9-b517-4399-811c-bfaf9b226118"), "lookup_type": Object {"ByName": String("proj-9c0961bf572")}, "parent": Object {"key": String("578bc52c-ac81-41a6-a56b-dfc79805368e"), "lookup_type": Object {"ById": String("578bc52c-ac81-41a6-a56b-dfc79805368e")}, "parent": Null}}, Object {"identity": Object {"description": String(""), "id": String("8aed7aa9-b517-4399-811c-bfaf9b226118"), "name": String("proj-9c0961bf572"), "time_created": String("2024-12-14T03:35:43.204454Z"), "time_deleted": Null, "time_modified": String("2024-12-14T03:35:43.204454Z")}, "rcgen": Number(1), "silo_id": String("578bc52c-ac81-41a6-a56b-dfc79805368e")}]) node_id = 0 saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1
34922024-12-14T03:35:43.227ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 5f2fe413-3c4a-4994-b4a0-995c1da486b1
34932024-12-14T03:35:43.227ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1
34942024-12-14T03:35:43.236ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 5f2fe413-3c4a-4994-b4a0-995c1da486b1
34952024-12-14T03:35:43.236ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"authz_project": Object {"key": String("8aed7aa9-b517-4399-811c-bfaf9b226118"), "lookup_type": Object {"ByName": String("proj-9c0961bf572")}, "parent": Object {"key": String("578bc52c-ac81-41a6-a56b-dfc79805368e"), "lookup_type": Object {"ById": String("578bc52c-ac81-41a6-a56b-dfc79805368e")}, "parent": Null}}, "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"SiloUser": Object {"silo_id": String("578bc52c-ac81-41a6-a56b-dfc79805368e"), "silo_user_id": String("6d1b4298-6f48-4e38-b4c6-02b2175d87a2")}}}, Object {"mapped_fleet_roles": Object {"admin": Array [String("admin")]}}]}}, "vpc_create": Object {"description": String("Default VPC"), "dns_name": String("default"), "ipv6_prefix": String("fd10:261c:f22c::/48"), "name": String("default")}}) node_id = 1 saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1
34962024-12-14T03:35:43.244ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 5f2fe413-3c4a-4994-b4a0-995c1da486b1
34972024-12-14T03:35:43.244ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1
34982024-12-14T03:35:43.247ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 5f2fe413-3c4a-4994-b4a0-995c1da486b1
34992024-12-14T03:35:43.247ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 2 saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1
35002024-12-14T03:35:43.250ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 5f2fe413-3c4a-4994-b4a0-995c1da486b1
35012024-12-14T03:35:43.250ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1
35022024-12-14T03:35:43.254ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 5f2fe413-3c4a-4994-b4a0-995c1da486b1
35032024-12-14T03:35:43.254ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("43bb0c4f-fec6-478e-864a-67e6dec06f39")) node_id = 3 saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1
35042024-12-14T03:35:43.257ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 5f2fe413-3c4a-4994-b4a0-995c1da486b1
35052024-12-14T03:35:43.257ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1
35062024-12-14T03:35:43.261ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 5f2fe413-3c4a-4994-b4a0-995c1da486b1
35072024-12-14T03:35:43.261ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("09bbd44b-923c-40e4-a154-80660c9d794e")) node_id = 4 saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1
35082024-12-14T03:35:43.264ZDEBGnexus (SEC): saga log event new_state = N005 started sec_id = 5f2fe413-3c4a-4994-b4a0-995c1da486b1
35092024-12-14T03:35:43.264ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 5 saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1
35102024-12-14T03:35:43.267ZDEBGnexus (SEC): saga log event new_state = N005 succeeded sec_id = 5f2fe413-3c4a-4994-b4a0-995c1da486b1
35112024-12-14T03:35:43.267ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("e58dde20-ea05-401b-8e67-69dddb18fb8c")) node_id = 5 saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1
35122024-12-14T03:35:43.270ZDEBGnexus (SEC): saga log event new_state = N006 started sec_id = 5f2fe413-3c4a-4994-b4a0-995c1da486b1
35132024-12-14T03:35:43.270ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 6 saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1
35142024-12-14T03:35:43.274ZDEBGnexus (SEC): saga log event new_state = N006 succeeded sec_id = 5f2fe413-3c4a-4994-b4a0-995c1da486b1
35152024-12-14T03:35:43.274ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("c699eb8b-715b-4605-a17a-f90eec60f292")) node_id = 6 saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1
35162024-12-14T03:35:43.277ZDEBGnexus (SEC): saga log event new_state = N007 started sec_id = 5f2fe413-3c4a-4994-b4a0-995c1da486b1
35172024-12-14T03:35:43.277ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 7 saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1
35182024-12-14T03:35:43.280ZDEBGnexus (SEC): saga log event new_state = N007 succeeded sec_id = 5f2fe413-3c4a-4994-b4a0-995c1da486b1
35192024-12-14T03:35:43.280ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("df878936-0bd3-498e-8a58-fd6b370cf975")) node_id = 7 saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1
35202024-12-14T03:35:43.285ZDEBGnexus (SEC): saga log event new_state = N008 started sec_id = 5f2fe413-3c4a-4994-b4a0-995c1da486b1
35212024-12-14T03:35:43.285ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 8 saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1
35222024-12-14T03:35:43.291ZDEBGnexus (SEC): saga log event new_state = N008 succeeded sec_id = 5f2fe413-3c4a-4994-b4a0-995c1da486b1
35232024-12-14T03:35:43.291ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("5b7779bc-ff32-48de-b1c6-d4f4ba96c533")) node_id = 8 saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1
35242024-12-14T03:35:43.294ZDEBGnexus (SEC): saga log event new_state = N009 started sec_id = 5f2fe413-3c4a-4994-b4a0-995c1da486b1
35252024-12-14T03:35:43.294ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 9 saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1
35262024-12-14T03:35:43.298ZDEBGnexus (SagaExecutor): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true roles = RoleSet { roles: {} } saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1 saga_name = project-create saga_node = VpcCreateVpc
35272024-12-14T03:35:43.298ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true resource = Database result = Ok(()) saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1 saga_name = project-create saga_node = VpcCreateVpc
35282024-12-14T03:35:43.301ZDEBGnexus (SagaExecutor): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true roles = RoleSet { roles: {} } saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1 saga_name = project-create saga_node = VpcCreateVpc
35292024-12-14T03:35:43.301ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true resource = Database result = Ok(()) saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1 saga_name = project-create saga_node = VpcCreateVpc
35302024-12-14T03:35:43.303ZDEBGnexus (SagaExecutor): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true roles = RoleSet { roles: {} } saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1 saga_name = project-create saga_node = VpcCreateVpc
35312024-12-14T03:35:43.304ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true resource = Database result = Ok(()) saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1 saga_name = project-create saga_node = VpcCreateVpc
35322024-12-14T03:35:43.306ZDEBGnexus (SagaExecutor): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true roles = RoleSet { roles: {} } saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1 saga_name = project-create saga_node = VpcCreateVpc
35332024-12-14T03:35:43.306ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true resource = Database result = Ok(()) saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1 saga_name = project-create saga_node = VpcCreateVpc
35342024-12-14T03:35:43.309ZDEBGnexus (SagaExecutor): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true roles = RoleSet { roles: {(Silo, 578bc52c-ac81-41a6-a56b-dfc79805368e, "admin")} } saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1 saga_name = project-create saga_node = VpcCreateVpc
35352024-12-14T03:35:43.311ZDEBGnexus (SagaExecutor): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true resource = Project { parent: Silo { parent: Fleet, key: 578bc52c-ac81-41a6-a56b-dfc79805368e, lookup_type: ById(578bc52c-ac81-41a6-a56b-dfc79805368e) }, key: 8aed7aa9-b517-4399-811c-bfaf9b226118, lookup_type: ByName("proj-9c0961bf572") } result = Ok(()) saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1 saga_name = project-create saga_node = VpcCreateVpc
35362024-12-14T03:35:43.311ZDEBGnexus (SagaExecutor): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true roles = RoleSet { roles: {} } saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1 saga_name = project-create saga_node = VpcCreateVpc
35372024-12-14T03:35:43.311ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true resource = Database result = Ok(()) saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1 saga_name = project-create saga_node = VpcCreateVpc
35382024-12-14T03:35:43.321ZDEBGnexus (SEC): saga log event new_state = N009 succeeded sec_id = 5f2fe413-3c4a-4994-b4a0-995c1da486b1
35392024-12-14T03:35:43.321ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Array [Object {"key": String("43bb0c4f-fec6-478e-864a-67e6dec06f39"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("8aed7aa9-b517-4399-811c-bfaf9b226118"), "lookup_type": Object {"ByName": String("proj-9c0961bf572")}, "parent": Object {"key": String("578bc52c-ac81-41a6-a56b-dfc79805368e"), "lookup_type": Object {"ById": String("578bc52c-ac81-41a6-a56b-dfc79805368e")}, "parent": Null}}}, Object {"dns_name": String("default"), "firewall_gen": Number(1), "identity": Object {"description": String("Default VPC"), "id": String("43bb0c4f-fec6-478e-864a-67e6dec06f39"), "name": String("default"), "time_created": String("2024-12-14T03:35:43.298538Z"), "time_deleted": Null, "time_modified": String("2024-12-14T03:35:43.298538Z")}, "ipv6_prefix": String("fd10:261c:f22c::/48"), "project_id": String("8aed7aa9-b517-4399-811c-bfaf9b226118"), "subnet_gen": Number(1), "system_router_id": String("09bbd44b-923c-40e4-a154-80660c9d794e"), "vni": Number(11342096)}]) node_id = 9 saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1
35402024-12-14T03:35:43.325ZDEBGnexus (SEC): saga log event new_state = N010 started sec_id = 5f2fe413-3c4a-4994-b4a0-995c1da486b1
35412024-12-14T03:35:43.325ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 10 saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1
35422024-12-14T03:35:43.328ZDEBGnexus (SagaExecutor): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true roles = RoleSet { roles: {} } saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1 saga_name = project-create saga_node = VpcCreateRouter
35432024-12-14T03:35:43.328ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true resource = Database result = Ok(()) saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1 saga_name = project-create saga_node = VpcCreateRouter
35442024-12-14T03:35:43.330ZDEBGnexus (SagaExecutor): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true roles = RoleSet { roles: {} } saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1 saga_name = project-create saga_node = VpcCreateRouter
35452024-12-14T03:35:43.331ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true resource = Database result = Ok(()) saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1 saga_name = project-create saga_node = VpcCreateRouter
35462024-12-14T03:35:43.333ZDEBGnexus (SagaExecutor): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true roles = RoleSet { roles: {} } saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1 saga_name = project-create saga_node = VpcCreateRouter
35472024-12-14T03:35:43.333ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true resource = Database result = Ok(()) saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1 saga_name = project-create saga_node = VpcCreateRouter
35482024-12-14T03:35:43.334ZDEBGnexus (SagaExecutor): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true roles = RoleSet { roles: {} } saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1 saga_name = project-create saga_node = VpcCreateRouter
35492024-12-14T03:35:43.335ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true resource = Database result = Ok(()) saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1 saga_name = project-create saga_node = VpcCreateRouter
35502024-12-14T03:35:43.337ZDEBGnexus (SagaExecutor): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true roles = RoleSet { roles: {(Silo, 578bc52c-ac81-41a6-a56b-dfc79805368e, "admin")} } saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1 saga_name = project-create saga_node = VpcCreateRouter
35512024-12-14T03:35:43.340ZDEBGnexus (SagaExecutor): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 578bc52c-ac81-41a6-a56b-dfc79805368e, lookup_type: ById(578bc52c-ac81-41a6-a56b-dfc79805368e) }, key: 8aed7aa9-b517-4399-811c-bfaf9b226118, lookup_type: ByName("proj-9c0961bf572") }, key: 43bb0c4f-fec6-478e-864a-67e6dec06f39, lookup_type: ByName("default") } result = Ok(()) saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1 saga_name = project-create saga_node = VpcCreateRouter
35522024-12-14T03:35:43.340ZDEBGnexus (SagaExecutor): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true roles = RoleSet { roles: {} } saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1 saga_name = project-create saga_node = VpcCreateRouter
35532024-12-14T03:35:43.340ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true resource = Database result = Ok(()) saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1 saga_name = project-create saga_node = VpcCreateRouter
35542024-12-14T03:35:43.371ZDEBGnexus (SEC): saga log event new_state = N010 succeeded sec_id = 5f2fe413-3c4a-4994-b4a0-995c1da486b1
35552024-12-14T03:35:43.371ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"key": String("09bbd44b-923c-40e4-a154-80660c9d794e"), "lookup_type": Object {"ById": String("09bbd44b-923c-40e4-a154-80660c9d794e")}, "parent": Object {"key": String("43bb0c4f-fec6-478e-864a-67e6dec06f39"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("8aed7aa9-b517-4399-811c-bfaf9b226118"), "lookup_type": Object {"ByName": String("proj-9c0961bf572")}, "parent": Object {"key": String("578bc52c-ac81-41a6-a56b-dfc79805368e"), "lookup_type": Object {"ById": String("578bc52c-ac81-41a6-a56b-dfc79805368e")}, "parent": Null}}}}) node_id = 10 saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1
35562024-12-14T03:35:43.374ZDEBGnexus (SEC): saga log event new_state = N011 started sec_id = 5f2fe413-3c4a-4994-b4a0-995c1da486b1
35572024-12-14T03:35:43.374ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 11 saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1
35582024-12-14T03:35:43.378ZDEBGnexus (SagaExecutor): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true roles = RoleSet { roles: {} } saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1 saga_name = project-create saga_node = VpcCreateV4Route
35592024-12-14T03:35:43.378ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true resource = Database result = Ok(()) saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1 saga_name = project-create saga_node = VpcCreateV4Route
35602024-12-14T03:35:43.380ZDEBGnexus (SagaExecutor): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true roles = RoleSet { roles: {} } saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1 saga_name = project-create saga_node = VpcCreateV4Route
35612024-12-14T03:35:43.380ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true resource = Database result = Ok(()) saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1 saga_name = project-create saga_node = VpcCreateV4Route
35622024-12-14T03:35:43.382ZDEBGnexus (SagaExecutor): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true roles = RoleSet { roles: {} } saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1 saga_name = project-create saga_node = VpcCreateV4Route
35632024-12-14T03:35:43.382ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true resource = Database result = Ok(()) saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1 saga_name = project-create saga_node = VpcCreateV4Route
35642024-12-14T03:35:43.385ZDEBGnexus (SagaExecutor): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true roles = RoleSet { roles: {} } saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1 saga_name = project-create saga_node = VpcCreateV4Route
35652024-12-14T03:35:43.385ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true resource = Database result = Ok(()) saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1 saga_name = project-create saga_node = VpcCreateV4Route
35662024-12-14T03:35:43.387ZDEBGnexus (SagaExecutor): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true roles = RoleSet { roles: {(Silo, 578bc52c-ac81-41a6-a56b-dfc79805368e, "admin")} } saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1 saga_name = project-create saga_node = VpcCreateV4Route
35672024-12-14T03:35:43.390ZDEBGnexus (SagaExecutor): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 578bc52c-ac81-41a6-a56b-dfc79805368e, lookup_type: ById(578bc52c-ac81-41a6-a56b-dfc79805368e) }, key: 8aed7aa9-b517-4399-811c-bfaf9b226118, lookup_type: ByName("proj-9c0961bf572") }, key: 43bb0c4f-fec6-478e-864a-67e6dec06f39, lookup_type: ByName("default") }, key: 09bbd44b-923c-40e4-a154-80660c9d794e, lookup_type: ById(09bbd44b-923c-40e4-a154-80660c9d794e) } result = Ok(()) saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1 saga_name = project-create saga_node = VpcCreateV4Route
35682024-12-14T03:35:43.390ZDEBGnexus (SagaExecutor): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true roles = RoleSet { roles: {} } saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1 saga_name = project-create saga_node = VpcCreateV4Route
35692024-12-14T03:35:43.390ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true resource = Database result = Ok(()) saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1 saga_name = project-create saga_node = VpcCreateV4Route
35702024-12-14T03:35:43.427ZDEBGnexus (SEC): saga log event new_state = N011 succeeded sec_id = 5f2fe413-3c4a-4994-b4a0-995c1da486b1
35712024-12-14T03:35:43.427ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 11 saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1
35722024-12-14T03:35:43.431ZDEBGnexus (SEC): saga log event new_state = N012 started sec_id = 5f2fe413-3c4a-4994-b4a0-995c1da486b1
35732024-12-14T03:35:43.431ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 12 saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1
35742024-12-14T03:35:43.434ZDEBGnexus (SagaExecutor): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true roles = RoleSet { roles: {} } saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1 saga_name = project-create saga_node = VpcCreateV6Route
35752024-12-14T03:35:43.434ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true resource = Database result = Ok(()) saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1 saga_name = project-create saga_node = VpcCreateV6Route
35762024-12-14T03:35:43.437ZDEBGnexus (SagaExecutor): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true roles = RoleSet { roles: {} } saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1 saga_name = project-create saga_node = VpcCreateV6Route
35772024-12-14T03:35:43.437ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true resource = Database result = Ok(()) saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1 saga_name = project-create saga_node = VpcCreateV6Route
35782024-12-14T03:35:43.439ZDEBGnexus (SagaExecutor): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true roles = RoleSet { roles: {} } saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1 saga_name = project-create saga_node = VpcCreateV6Route
35792024-12-14T03:35:43.439ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true resource = Database result = Ok(()) saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1 saga_name = project-create saga_node = VpcCreateV6Route
35802024-12-14T03:35:43.441ZDEBGnexus (SagaExecutor): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true roles = RoleSet { roles: {} } saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1 saga_name = project-create saga_node = VpcCreateV6Route
35812024-12-14T03:35:43.441ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true resource = Database result = Ok(()) saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1 saga_name = project-create saga_node = VpcCreateV6Route
35822024-12-14T03:35:43.443ZDEBGnexus (SagaExecutor): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true roles = RoleSet { roles: {(Silo, 578bc52c-ac81-41a6-a56b-dfc79805368e, "admin")} } saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1 saga_name = project-create saga_node = VpcCreateV6Route
35832024-12-14T03:35:43.446ZDEBGnexus (SagaExecutor): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 578bc52c-ac81-41a6-a56b-dfc79805368e, lookup_type: ById(578bc52c-ac81-41a6-a56b-dfc79805368e) }, key: 8aed7aa9-b517-4399-811c-bfaf9b226118, lookup_type: ByName("proj-9c0961bf572") }, key: 43bb0c4f-fec6-478e-864a-67e6dec06f39, lookup_type: ByName("default") }, key: 09bbd44b-923c-40e4-a154-80660c9d794e, lookup_type: ById(09bbd44b-923c-40e4-a154-80660c9d794e) } result = Ok(()) saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1 saga_name = project-create saga_node = VpcCreateV6Route
35842024-12-14T03:35:43.446ZDEBGnexus (SagaExecutor): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true roles = RoleSet { roles: {} } saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1 saga_name = project-create saga_node = VpcCreateV6Route
35852024-12-14T03:35:43.446ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true resource = Database result = Ok(()) saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1 saga_name = project-create saga_node = VpcCreateV6Route
35862024-12-14T03:35:43.486ZDEBGnexus (SEC): saga log event new_state = N012 succeeded sec_id = 5f2fe413-3c4a-4994-b4a0-995c1da486b1
35872024-12-14T03:35:43.486ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 12 saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1
35882024-12-14T03:35:43.490ZDEBGnexus (SEC): saga log event new_state = N013 started sec_id = 5f2fe413-3c4a-4994-b4a0-995c1da486b1
35892024-12-14T03:35:43.490ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 13 saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1
35902024-12-14T03:35:43.494ZDEBGnexus (SagaExecutor): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true roles = RoleSet { roles: {} } saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1 saga_name = project-create saga_node = VpcCreateSubnet
35912024-12-14T03:35:43.495ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true resource = Database result = Ok(()) saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1 saga_name = project-create saga_node = VpcCreateSubnet
35922024-12-14T03:35:43.497ZDEBGnexus (SagaExecutor): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true roles = RoleSet { roles: {} } saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1 saga_name = project-create saga_node = VpcCreateSubnet
35932024-12-14T03:35:43.497ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true resource = Database result = Ok(()) saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1 saga_name = project-create saga_node = VpcCreateSubnet
35942024-12-14T03:35:43.499ZDEBGnexus (SagaExecutor): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true roles = RoleSet { roles: {} } saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1 saga_name = project-create saga_node = VpcCreateSubnet
35952024-12-14T03:35:43.499ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true resource = Database result = Ok(()) saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1 saga_name = project-create saga_node = VpcCreateSubnet
35962024-12-14T03:35:43.501ZDEBGnexus (SagaExecutor): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true roles = RoleSet { roles: {} } saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1 saga_name = project-create saga_node = VpcCreateSubnet
35972024-12-14T03:35:43.502ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true resource = Database result = Ok(()) saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1 saga_name = project-create saga_node = VpcCreateSubnet
35982024-12-14T03:35:43.504ZDEBGnexus (SagaExecutor): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true roles = RoleSet { roles: {(Silo, 578bc52c-ac81-41a6-a56b-dfc79805368e, "admin")} } saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1 saga_name = project-create saga_node = VpcCreateSubnet
35992024-12-14T03:35:43.506ZDEBGnexus (SagaExecutor): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 578bc52c-ac81-41a6-a56b-dfc79805368e, lookup_type: ById(578bc52c-ac81-41a6-a56b-dfc79805368e) }, key: 8aed7aa9-b517-4399-811c-bfaf9b226118, lookup_type: ByName("proj-9c0961bf572") }, key: 43bb0c4f-fec6-478e-864a-67e6dec06f39, lookup_type: ByName("default") } result = Ok(()) saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1 saga_name = project-create saga_node = VpcCreateSubnet
36002024-12-14T03:35:43.512ZDEBGnexus (SagaExecutor): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true roles = RoleSet { roles: {} } saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1 saga_name = project-create saga_node = VpcCreateSubnet
36012024-12-14T03:35:43.513ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true resource = Database result = Ok(()) saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1 saga_name = project-create saga_node = VpcCreateSubnet
36022024-12-14T03:35:43.527ZDEBGnexus (SagaExecutor): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true roles = RoleSet { roles: {} } saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1 saga_name = project-create saga_node = VpcCreateSubnet
36032024-12-14T03:35:43.527ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true resource = Database result = Ok(()) saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1 saga_name = project-create saga_node = VpcCreateSubnet
36042024-12-14T03:35:43.531ZDEBGnexus (SEC): saga log event new_state = N013 succeeded sec_id = 5f2fe413-3c4a-4994-b4a0-995c1da486b1
36052024-12-14T03:35:43.531ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Array [Object {"key": String("df878936-0bd3-498e-8a58-fd6b370cf975"), "lookup_type": Object {"ById": String("df878936-0bd3-498e-8a58-fd6b370cf975")}, "parent": Object {"key": String("43bb0c4f-fec6-478e-864a-67e6dec06f39"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("8aed7aa9-b517-4399-811c-bfaf9b226118"), "lookup_type": Object {"ByName": String("proj-9c0961bf572")}, "parent": Object {"key": String("578bc52c-ac81-41a6-a56b-dfc79805368e"), "lookup_type": Object {"ById": String("578bc52c-ac81-41a6-a56b-dfc79805368e")}, "parent": Null}}}}, Object {"custom_router_id": Null, "identity": Object {"description": String("The default subnet for default"), "id": String("df878936-0bd3-498e-8a58-fd6b370cf975"), "name": String("default"), "time_created": String("2024-12-14T03:35:43.494884Z"), "time_deleted": Null, "time_modified": String("2024-12-14T03:35:43.494884Z")}, "ipv4_block": String("172.30.0.0/22"), "ipv6_block": String("fd10:261c:f22c::/64"), "rcgen": Number(1), "vpc_id": String("43bb0c4f-fec6-478e-864a-67e6dec06f39")}]) node_id = 13 saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1
36062024-12-14T03:35:43.534ZDEBGnexus (SEC): saga log event new_state = N014 started sec_id = 5f2fe413-3c4a-4994-b4a0-995c1da486b1
36072024-12-14T03:35:43.534ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 14 saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1
36082024-12-14T03:35:43.538ZDEBGnexus: default firewall rules for vpc default rules = [VpcFirewallRule { identity: VpcFirewallRuleIdentity { id: 38270ab6-432d-4bcf-93c5-d7c2e788902c, name: Name(Name("allow-internal-inbound")), description: "allow inbound traffic to all instances within the VPC if originated within the VPC", time_created: 2024-12-14T03:35:43.538272719Z, time_modified: 2024-12-14T03:35:43.538272719Z, time_deleted: None }, vpc_id: 43bb0c4f-fec6-478e-864a-67e6dec06f39, status: VpcFirewallRuleStatus(Enabled), direction: VpcFirewallRuleDirection(Inbound), targets: [VpcFirewallRuleTarget(Vpc(Name("default")))], filter_hosts: Some([VpcFirewallRuleHostFilter(Vpc(Name("default")))]), filter_ports: None, filter_protocols: None, action: VpcFirewallRuleAction(Allow), priority: VpcFirewallRulePriority(VpcFirewallRulePriority(65534)) }, VpcFirewallRule { identity: VpcFirewallRuleIdentity { id: 19006a6a-d25d-4c0f-8503-442509e0bddf, name: Name(Name("allow-ssh")), description: "allow inbound TCP connections on port 22 from anywhere", time_created: 2024-12-14T03:35:43.538274589Z, time_modified: 2024-12-14T03:35:43.538274589Z, time_deleted: None }, vpc_id: 43bb0c4f-fec6-478e-864a-67e6dec06f39, status: VpcFirewallRuleStatus(Enabled), direction: VpcFirewallRuleDirection(Inbound), targets: [VpcFirewallRuleTarget(Vpc(Name("default")))], filter_hosts: None, filter_ports: Some([L4PortRange(L4PortRange { first: L4Port(22), last: L4Port(22) })]), filter_protocols: Some([VpcFirewallRuleProtocol(Tcp)]), action: VpcFirewallRuleAction(Allow), priority: VpcFirewallRulePriority(VpcFirewallRulePriority(65534)) }, VpcFirewallRule { identity: VpcFirewallRuleIdentity { id: 9d39d0dd-174b-4e2e-a034-5ae0195f3f1f, name: Name(Name("allow-icmp")), description: "allow inbound ICMP traffic from anywhere", time_created: 2024-12-14T03:35:43.538275419Z, time_modified: 2024-12-14T03:35:43.538275419Z, time_deleted: None }, vpc_id: 43bb0c4f-fec6-478e-864a-67e6dec06f39, status: VpcFirewallRuleStatus(Enabled), direction: VpcFirewallRuleDirection(Inbound), targets: [VpcFirewallRuleTarget(Vpc(Name("default")))], filter_hosts: None, filter_ports: None, filter_protocols: Some([VpcFirewallRuleProtocol(Icmp)]), action: VpcFirewallRuleAction(Allow), priority: VpcFirewallRulePriority(VpcFirewallRulePriority(65534)) }]
36092024-12-14T03:35:43.538ZDEBGnexus (SagaExecutor): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true roles = RoleSet { roles: {} } saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1 saga_name = project-create saga_node = VpcUpdateFirewall
36102024-12-14T03:35:43.538ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true resource = Database result = Ok(()) saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1 saga_name = project-create saga_node = VpcUpdateFirewall
36112024-12-14T03:35:43.540ZDEBGnexus (SagaExecutor): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true roles = RoleSet { roles: {} } saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1 saga_name = project-create saga_node = VpcUpdateFirewall
36122024-12-14T03:35:43.541ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true resource = Database result = Ok(()) saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1 saga_name = project-create saga_node = VpcUpdateFirewall
36132024-12-14T03:35:43.543ZDEBGnexus (SagaExecutor): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true roles = RoleSet { roles: {} } saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1 saga_name = project-create saga_node = VpcUpdateFirewall
36142024-12-14T03:35:43.543ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true resource = Database result = Ok(()) saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1 saga_name = project-create saga_node = VpcUpdateFirewall
36152024-12-14T03:35:43.545ZDEBGnexus (SagaExecutor): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true roles = RoleSet { roles: {} } saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1 saga_name = project-create saga_node = VpcUpdateFirewall
36162024-12-14T03:35:43.545ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true resource = Database result = Ok(()) saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1 saga_name = project-create saga_node = VpcUpdateFirewall
36172024-12-14T03:35:43.547ZDEBGnexus (SagaExecutor): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true roles = RoleSet { roles: {(Silo, 578bc52c-ac81-41a6-a56b-dfc79805368e, "admin")} } saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1 saga_name = project-create saga_node = VpcUpdateFirewall
36182024-12-14T03:35:43.550ZDEBGnexus (SagaExecutor): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 578bc52c-ac81-41a6-a56b-dfc79805368e, lookup_type: ById(578bc52c-ac81-41a6-a56b-dfc79805368e) }, key: 8aed7aa9-b517-4399-811c-bfaf9b226118, lookup_type: ByName("proj-9c0961bf572") }, key: 43bb0c4f-fec6-478e-864a-67e6dec06f39, lookup_type: ByName("default") } result = Ok(()) saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1 saga_name = project-create saga_node = VpcUpdateFirewall
36192024-12-14T03:35:43.550ZDEBGnexus (SagaExecutor): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true roles = RoleSet { roles: {} } saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1 saga_name = project-create saga_node = VpcUpdateFirewall
36202024-12-14T03:35:43.550ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true resource = Database result = Ok(()) saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1 saga_name = project-create saga_node = VpcUpdateFirewall
36212024-12-14T03:35:43.601ZDEBGnexus (SEC): saga log event new_state = N014 succeeded sec_id = 5f2fe413-3c4a-4994-b4a0-995c1da486b1
36222024-12-14T03:35:43.601ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Array [Object {"action": String("allow"), "direction": String("inbound"), "filter_hosts": Array [Object {"type": String("vpc"), "value": String("default")}], "filter_ports": Null, "filter_protocols": Null, "identity": Object {"description": String("allow inbound traffic to all instances within the VPC if originated within the VPC"), "id": String("38270ab6-432d-4bcf-93c5-d7c2e788902c"), "name": String("allow-internal-inbound"), "time_created": String("2024-12-14T03:35:43.538272719Z"), "time_deleted": Null, "time_modified": String("2024-12-14T03:35:43.538272719Z")}, "priority": Number(65534), "status": String("enabled"), "targets": Array [Object {"type": String("vpc"), "value": String("default")}], "vpc_id": String("43bb0c4f-fec6-478e-864a-67e6dec06f39")}, Object {"action": String("allow"), "direction": String("inbound"), "filter_hosts": Null, "filter_ports": Array [String("22")], "filter_protocols": Array [String("TCP")], "identity": Object {"description": String("allow inbound TCP connections on port 22 from anywhere"), "id": String("19006a6a-d25d-4c0f-8503-442509e0bddf"), "name": String("allow-ssh"), "time_created": String("2024-12-14T03:35:43.538274589Z"), "time_deleted": Null, "time_modified": String("2024-12-14T03:35:43.538274589Z")}, "priority": Number(65534), "status": String("enabled"), "targets": Array [Object {"type": String("vpc"), "value": String("default")}], "vpc_id": String("43bb0c4f-fec6-478e-864a-67e6dec06f39")}, Object {"action": String("allow"), "direction": String("inbound"), "filter_hosts": Null, "filter_ports": Null, "filter_protocols": Array [String("ICMP")], "identity": Object {"description": String("allow inbound ICMP traffic from anywhere"), "id": String("9d39d0dd-174b-4e2e-a034-5ae0195f3f1f"), "name": String("allow-icmp"), "time_created": String("2024-12-14T03:35:43.538275419Z"), "time_deleted": Null, "time_modified": String("2024-12-14T03:35:43.538275419Z")}, "priority": Number(65534), "status": String("enabled"), "targets": Array [Object {"type": String("vpc"), "value": String("default")}], "vpc_id": String("43bb0c4f-fec6-478e-864a-67e6dec06f39")}]) node_id = 14 saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1
36232024-12-14T03:35:43.605ZDEBGnexus (SEC): saga log event new_state = N015 started sec_id = 5f2fe413-3c4a-4994-b4a0-995c1da486b1
36242024-12-14T03:35:43.605ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 15 saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1
36252024-12-14T03:35:43.609ZDEBGnexus (SagaExecutor): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true roles = RoleSet { roles: {} } saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1 saga_name = project-create saga_node = VpcCreateGateway
36262024-12-14T03:35:43.609ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true resource = Database result = Ok(()) saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1 saga_name = project-create saga_node = VpcCreateGateway
36272024-12-14T03:35:43.611ZDEBGnexus (SagaExecutor): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true roles = RoleSet { roles: {} } saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1 saga_name = project-create saga_node = VpcCreateGateway
36282024-12-14T03:35:43.611ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true resource = Database result = Ok(()) saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1 saga_name = project-create saga_node = VpcCreateGateway
36292024-12-14T03:35:43.614ZDEBGnexus (SagaExecutor): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true roles = RoleSet { roles: {} } saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1 saga_name = project-create saga_node = VpcCreateGateway
36302024-12-14T03:35:43.614ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true resource = Database result = Ok(()) saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1 saga_name = project-create saga_node = VpcCreateGateway
36312024-12-14T03:35:43.616ZDEBGnexus (SagaExecutor): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true roles = RoleSet { roles: {} } saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1 saga_name = project-create saga_node = VpcCreateGateway
36322024-12-14T03:35:43.616ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true resource = Database result = Ok(()) saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1 saga_name = project-create saga_node = VpcCreateGateway
36332024-12-14T03:35:43.619ZDEBGnexus (SagaExecutor): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true roles = RoleSet { roles: {(Silo, 578bc52c-ac81-41a6-a56b-dfc79805368e, "admin")} } saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1 saga_name = project-create saga_node = VpcCreateGateway
36342024-12-14T03:35:43.621ZDEBGnexus (SagaExecutor): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 578bc52c-ac81-41a6-a56b-dfc79805368e, lookup_type: ById(578bc52c-ac81-41a6-a56b-dfc79805368e) }, key: 8aed7aa9-b517-4399-811c-bfaf9b226118, lookup_type: ByName("proj-9c0961bf572") }, key: 43bb0c4f-fec6-478e-864a-67e6dec06f39, lookup_type: ByName("default") } result = Ok(()) saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1 saga_name = project-create saga_node = VpcCreateGateway
36352024-12-14T03:35:43.621ZDEBGnexus (SagaExecutor): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true roles = RoleSet { roles: {} } saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1 saga_name = project-create saga_node = VpcCreateGateway
36362024-12-14T03:35:43.621ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true resource = Database result = Ok(()) saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1 saga_name = project-create saga_node = VpcCreateGateway
36372024-12-14T03:35:43.625ZDEBGnexus (SagaExecutor): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true roles = RoleSet { roles: {} } saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1 saga_name = project-create saga_node = VpcCreateGateway
36382024-12-14T03:35:43.625ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true resource = Database result = Ok(()) saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1 saga_name = project-create saga_node = VpcCreateGateway
36392024-12-14T03:35:43.630ZDEBGnexus (SagaExecutor): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true roles = RoleSet { roles: {} } saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1 saga_name = project-create saga_node = VpcCreateGateway
36402024-12-14T03:35:43.631ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true resource = Database result = Ok(()) saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1 saga_name = project-create saga_node = VpcCreateGateway
36412024-12-14T03:35:43.634ZDEBGnexus (SagaExecutor): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true roles = RoleSet { roles: {} } saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1 saga_name = project-create saga_node = VpcCreateGateway
36422024-12-14T03:35:43.634ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true resource = Database result = Ok(()) saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1 saga_name = project-create saga_node = VpcCreateGateway
36432024-12-14T03:35:43.636ZDEBGnexus (SagaExecutor): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true roles = RoleSet { roles: {} } saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1 saga_name = project-create saga_node = VpcCreateGateway
36442024-12-14T03:35:43.636ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true resource = Database result = Ok(()) saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1 saga_name = project-create saga_node = VpcCreateGateway
36452024-12-14T03:35:43.639ZDEBGnexus (SagaExecutor): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true roles = RoleSet { roles: {} } saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1 saga_name = project-create saga_node = VpcCreateGateway
36462024-12-14T03:35:43.639ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true resource = Database result = Ok(()) saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1 saga_name = project-create saga_node = VpcCreateGateway
36472024-12-14T03:35:43.641ZDEBGnexus (SagaExecutor): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true roles = RoleSet { roles: {} } saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1 saga_name = project-create saga_node = VpcCreateGateway
36482024-12-14T03:35:43.641ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true resource = Database result = Ok(()) saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1 saga_name = project-create saga_node = VpcCreateGateway
36492024-12-14T03:35:43.643ZDEBGnexus (SagaExecutor): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true roles = RoleSet { roles: {(Silo, 578bc52c-ac81-41a6-a56b-dfc79805368e, "admin")} } saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1 saga_name = project-create saga_node = VpcCreateGateway
36502024-12-14T03:35:43.646ZDEBGnexus (SagaExecutor): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true resource = InternetGateway { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 578bc52c-ac81-41a6-a56b-dfc79805368e, lookup_type: ById(578bc52c-ac81-41a6-a56b-dfc79805368e) }, key: 8aed7aa9-b517-4399-811c-bfaf9b226118, lookup_type: ByName("proj-9c0961bf572") }, key: 43bb0c4f-fec6-478e-864a-67e6dec06f39, lookup_type: ByName("default") }, key: 5b7779bc-ff32-48de-b1c6-d4f4ba96c533, lookup_type: ById(5b7779bc-ff32-48de-b1c6-d4f4ba96c533) } result = Ok(()) saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1 saga_name = project-create saga_node = VpcCreateGateway
36512024-12-14T03:35:43.646ZDEBGnexus (SagaExecutor): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true roles = RoleSet { roles: {} } saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1 saga_name = project-create saga_node = VpcCreateGateway
36522024-12-14T03:35:43.646ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true resource = Database result = Ok(()) saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1 saga_name = project-create saga_node = VpcCreateGateway
36532024-12-14T03:35:43.664ZDEBGnexus (SEC): saga log event new_state = N015 succeeded sec_id = 5f2fe413-3c4a-4994-b4a0-995c1da486b1
36542024-12-14T03:35:43.664ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"key": String("5b7779bc-ff32-48de-b1c6-d4f4ba96c533"), "lookup_type": Object {"ById": String("5b7779bc-ff32-48de-b1c6-d4f4ba96c533")}, "parent": Object {"key": String("43bb0c4f-fec6-478e-864a-67e6dec06f39"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("8aed7aa9-b517-4399-811c-bfaf9b226118"), "lookup_type": Object {"ByName": String("proj-9c0961bf572")}, "parent": Object {"key": String("578bc52c-ac81-41a6-a56b-dfc79805368e"), "lookup_type": Object {"ById": String("578bc52c-ac81-41a6-a56b-dfc79805368e")}, "parent": Null}}}}) node_id = 15 saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1
36552024-12-14T03:35:43.668ZDEBGnexus (SEC): saga log event new_state = N016 started sec_id = 5f2fe413-3c4a-4994-b4a0-995c1da486b1
36562024-12-14T03:35:43.668ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 16 saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1
36572024-12-14T03:35:43.673ZDEBGnexus (SagaExecutor): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true roles = RoleSet { roles: {} } saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1 saga_name = project-create saga_node = VpcNotifySleds
36582024-12-14T03:35:43.673ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true resource = Database result = Ok(()) saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1 saga_name = project-create saga_node = VpcNotifySleds
36592024-12-14T03:35:43.674ZDEBGnexus (SagaExecutor): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true roles = RoleSet { roles: {} } saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1 saga_name = project-create saga_node = VpcNotifySleds
36602024-12-14T03:35:43.674ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true resource = Database result = Ok(()) saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1 saga_name = project-create saga_node = VpcNotifySleds
36612024-12-14T03:35:43.675ZDEBGnexus (SagaExecutor): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true roles = RoleSet { roles: {} } saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1 saga_name = project-create saga_node = VpcNotifySleds
36622024-12-14T03:35:43.676ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true resource = Database result = Ok(()) saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1 saga_name = project-create saga_node = VpcNotifySleds
36632024-12-14T03:35:43.677ZDEBGnexus (SagaExecutor): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true roles = RoleSet { roles: {} } saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1 saga_name = project-create saga_node = VpcNotifySleds
36642024-12-14T03:35:43.677ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true resource = Database result = Ok(()) saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1 saga_name = project-create saga_node = VpcNotifySleds
36652024-12-14T03:35:43.680ZDEBGnexus (SagaExecutor): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true roles = RoleSet { roles: {} } saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1 saga_name = project-create saga_node = VpcNotifySleds
36662024-12-14T03:35:43.680ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true resource = Database result = Ok(()) saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1 saga_name = project-create saga_node = VpcNotifySleds
36672024-12-14T03:35:43.682ZDEBGnexus (SagaExecutor): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true roles = RoleSet { roles: {} } saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1 saga_name = project-create saga_node = VpcNotifySleds
36682024-12-14T03:35:43.682ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true resource = Database result = Ok(()) saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1 saga_name = project-create saga_node = VpcNotifySleds
36692024-12-14T03:35:43.684ZDEBGnexus (SagaExecutor): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true roles = RoleSet { roles: {} } saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1 saga_name = project-create saga_node = VpcNotifySleds
36702024-12-14T03:35:43.684ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true resource = Database result = Ok(()) saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1 saga_name = project-create saga_node = VpcNotifySleds
36712024-12-14T03:35:43.686ZDEBGnexus (SagaExecutor): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true roles = RoleSet { roles: {(Silo, 578bc52c-ac81-41a6-a56b-dfc79805368e, "admin")} } saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1 saga_name = project-create saga_node = VpcNotifySleds
36722024-12-14T03:35:43.689ZDEBGnexus (SagaExecutor): authorize result action = ListChildren actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 578bc52c-ac81-41a6-a56b-dfc79805368e, lookup_type: ById(578bc52c-ac81-41a6-a56b-dfc79805368e) }, key: 8aed7aa9-b517-4399-811c-bfaf9b226118, lookup_type: ById(8aed7aa9-b517-4399-811c-bfaf9b226118) }, key: 43bb0c4f-fec6-478e-864a-67e6dec06f39, lookup_type: ByName("default") } result = Ok(()) saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1 saga_name = project-create saga_node = VpcNotifySleds
36732024-12-14T03:35:43.689ZDEBGnexus (SagaExecutor): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true roles = RoleSet { roles: {} } saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1 saga_name = project-create saga_node = VpcNotifySleds
36742024-12-14T03:35:43.689ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true resource = Database result = Ok(()) saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1 saga_name = project-create saga_node = VpcNotifySleds
36752024-12-14T03:35:43.691ZDEBGnexus (SagaExecutor): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true roles = RoleSet { roles: {} } saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1 saga_name = project-create saga_node = VpcNotifySleds
36762024-12-14T03:35:43.691ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true resource = Database result = Ok(()) saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1 saga_name = project-create saga_node = VpcNotifySleds
36772024-12-14T03:35:43.693ZDEBGnexus (SagaExecutor): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true roles = RoleSet { roles: {} } saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1 saga_name = project-create saga_node = VpcNotifySleds
36782024-12-14T03:35:43.694ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true resource = Database result = Ok(()) saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1 saga_name = project-create saga_node = VpcNotifySleds
36792024-12-14T03:35:43.696ZDEBGnexus (SagaExecutor): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true roles = RoleSet { roles: {} } saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1 saga_name = project-create saga_node = VpcNotifySleds
36802024-12-14T03:35:43.696ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true resource = Database result = Ok(()) saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1 saga_name = project-create saga_node = VpcNotifySleds
36812024-12-14T03:35:43.698ZDEBGnexus (SagaExecutor): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true roles = RoleSet { roles: {(Silo, 578bc52c-ac81-41a6-a56b-dfc79805368e, "admin")} } saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1 saga_name = project-create saga_node = VpcNotifySleds
36822024-12-14T03:35:43.701ZDEBGnexus (SagaExecutor): authorize result action = ListChildren actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 578bc52c-ac81-41a6-a56b-dfc79805368e, lookup_type: ById(578bc52c-ac81-41a6-a56b-dfc79805368e) }, key: 8aed7aa9-b517-4399-811c-bfaf9b226118, lookup_type: ById(8aed7aa9-b517-4399-811c-bfaf9b226118) }, key: 43bb0c4f-fec6-478e-864a-67e6dec06f39, lookup_type: ByName("default") } result = Ok(()) saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1 saga_name = project-create saga_node = VpcNotifySleds
36832024-12-14T03:35:43.701ZDEBGnexus (SagaExecutor): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true roles = RoleSet { roles: {} } saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1 saga_name = project-create saga_node = VpcNotifySleds
36842024-12-14T03:35:43.701ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true resource = Database result = Ok(()) saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1 saga_name = project-create saga_node = VpcNotifySleds
36852024-12-14T03:35:43.706ZDEBGnexus: resolved names for firewall rules instance_interfaces = {} subnet_interfaces = {} subnet_networks = {} vpc_interfaces = {}
36862024-12-14T03:35:43.706ZDEBGnexus: resolved firewall rules for sled agents sled_agent_rules = []
36872024-12-14T03:35:43.706ZDEBGnexus: resolved 0 rules for sleds
36882024-12-14T03:35:43.734ZDEBGnexus: resolved sleds for vpc default vpc_to_sled = []
36892024-12-14T03:35:43.734ZDEBGnexus: sending firewall rules to sled agents
36902024-12-14T03:35:43.734ZINFOnexus: updated firewall rules on 0 sleds file = nexus/networking/src/firewall_rules.rs:496
36912024-12-14T03:35:43.734ZDEBGnexus (SEC): saga log event new_state = N016 succeeded sec_id = 5f2fe413-3c4a-4994-b4a0-995c1da486b1
36922024-12-14T03:35:43.734ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 16 saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1
36932024-12-14T03:35:43.738ZDEBGnexus (SEC): saga log event new_state = N017 started sec_id = 5f2fe413-3c4a-4994-b4a0-995c1da486b1
36942024-12-14T03:35:43.738ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 17 saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1
36952024-12-14T03:35:43.741ZDEBGnexus (SEC): saga log event new_state = N017 succeeded sec_id = 5f2fe413-3c4a-4994-b4a0-995c1da486b1
36962024-12-14T03:35:43.741ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 17 saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1
36972024-12-14T03:35:43.745ZDEBGnexus (SEC): saga log event new_state = N019 started sec_id = 5f2fe413-3c4a-4994-b4a0-995c1da486b1
36982024-12-14T03:35:43.745ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 19 saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1
36992024-12-14T03:35:43.748ZDEBGnexus (SEC): saga log event new_state = N019 succeeded sec_id = 5f2fe413-3c4a-4994-b4a0-995c1da486b1
37002024-12-14T03:35:43.748ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 19 saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1
37012024-12-14T03:35:43.752ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1 sec_id = 5f2fe413-3c4a-4994-b4a0-995c1da486b1
37022024-12-14T03:35:43.752ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1
37032024-12-14T03:35:43.797ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1 saga_name = project-create sec_id = 5f2fe413-3c4a-4994-b4a0-995c1da486b1
37042024-12-14T03:35:43.797ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1 saga_name = project-create saga_result = SagaResult { saga_id: a0b37f3b-74c0-46c4-8674-e043c1d3fea1, saga_log: SagaLog { saga_id: a0b37f3b-74c0-46c4-8674-e043c1d3fea1, unwinding: false, events: [N018 started, N018 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N003 started, N003 succeeded, N004 started, N004 succeeded, N005 started, N005 succeeded, N006 started, N006 succeeded, N007 started, N007 succeeded, N008 started, N008 succeeded, N009 started, N009 succeeded, N010 started, N010 succeeded, N011 started, N011 succeeded, N012 started, N012 succeeded, N013 started, N013 succeeded, N014 started, N014 succeeded, N015 started, N015 succeeded, N016 started, N016 succeeded, N017 started, N017 succeeded, N019 started, N019 succeeded], node_status: {0: Succeeded(Array [Object {"key": String("8aed7aa9-b517-4399-811c-bfaf9b226118"), "lookup_type": Object {"ByName": String("proj-9c0961bf572")}, "parent": Object {"key": String("578bc52c-ac81-41a6-a56b-dfc79805368e"), "lookup_type": Object {"ById": String("578bc52c-ac81-41a6-a56b-dfc79805368e")}, "parent": Null}}, Object {"identity": Object {"description": String(""), "id": String("8aed7aa9-b517-4399-811c-bfaf9b226118"), "name": String("proj-9c0961bf572"), "time_created": String("2024-12-14T03:35:43.204454Z"), "time_deleted": Null, "time_modified": String("2024-12-14T03:35:43.204454Z")}, "rcgen": Number(1), "silo_id": String("578bc52c-ac81-41a6-a56b-dfc79805368e")}]), 1: Succeeded(Object {"authz_project": Object {"key": String("8aed7aa9-b517-4399-811c-bfaf9b226118"), "lookup_type": Object {"ByName": String("proj-9c0961bf572")}, "parent": Object {"key": String("578bc52c-ac81-41a6-a56b-dfc79805368e"), "lookup_type": Object {"ById": String("578bc52c-ac81-41a6-a56b-dfc79805368e")}, "parent": Null}}, "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"SiloUser": Object {"silo_id": String("578bc52c-ac81-41a6-a56b-dfc79805368e"), "silo_user_id": String("6d1b4298-6f48-4e38-b4c6-02b2175d87a2")}}}, Object {"mapped_fleet_roles": Object {"admin": Array [String("admin")]}}]}}, "vpc_create": Object {"description": String("Default VPC"), "dns_name": String("default"), "ipv6_prefix": String("fd10:261c:f22c::/48"), "name": String("default")}}), 2: Succeeded(Null), 3: Succeeded(String("43bb0c4f-fec6-478e-864a-67e6dec06f39")), 4: Succeeded(String("09bbd44b-923c-40e4-a154-80660c9d794e")), 5: Succeeded(String("e58dde20-ea05-401b-8e67-69dddb18fb8c")), 6: Succeeded(String("c699eb8b-715b-4605-a17a-f90eec60f292")), 7: Succeeded(String("df878936-0bd3-498e-8a58-fd6b370cf975")), 8: Succeeded(String("5b7779bc-ff32-48de-b1c6-d4f4ba96c533")), 9: Succeeded(Array [Object {"key": String("43bb0c4f-fec6-478e-864a-67e6dec06f39"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("8aed7aa9-b517-4399-811c-bfaf9b226118"), "lookup_type": Object {"ByName": String("proj-9c0961bf572")}, "parent": Object {"key": String("578bc52c-ac81-41a6-a56b-dfc79805368e"), "lookup_type": Object {"ById": String("578bc52c-ac81-41a6-a56b-dfc79805368e")}, "parent": Null}}}, Object {"dns_name": String("default"), "firewall_gen": Number(1), "identity": Object {"description": String("Default VPC"), "id": String("43bb0c4f-fec6-478e-864a-67e6dec06f39"), "name": String("default"), "time_created": String("2024-12-14T03:35:43.298538Z"), "time_deleted": Null, "time_modified": String("2024-12-14T03:35:43.298538Z")}, "ipv6_prefix": String("fd10:261c:f22c::/48"), "project_id": String("8aed7aa9-b517-4399-811c-bfaf9b226118"), "subnet_gen": Number(1), "system_router_id": String("09bbd44b-923c-40e4-a154-80660c9d794e"), "vni": Number(11342096)}]), 10: Succeeded(Object {"key": String("09bbd44b-923c-40e4-a154-80660c9d794e"), "lookup_type": Object {"ById": String("09bbd44b-923c-40e4-a154-80660c9d794e")}, "parent": Object {"key": String("43bb0c4f-fec6-478e-864a-67e6dec06f39"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("8aed7aa9-b517-4399-811c-bfaf9b226118"), "lookup_type": Object {"ByName": String("proj-9c0961bf572")}, "parent": Object {"key": String("578bc52c-ac81-41a6-a56b-dfc79805368e"), "lookup_type": Object {"ById": String("578bc52c-ac81-41a6-a56b-dfc79805368e")}, "parent": Null}}}}), 11: Succeeded(Null), 12: Succeeded(Null), 13: Succeeded(Array [Object {"key": String("df878936-0bd3-498e-8a58-fd6b370cf975"), "lookup_type": Object {"ById": String("df878936-0bd3-498e-8a58-fd6b370cf975")}, "parent": Object {"key": String("43bb0c4f-fec6-478e-864a-67e6dec06f39"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("8aed7aa9-b517-4399-811c-bfaf9b226118"), "lookup_type": Object {"ByName": String("proj-9c0961bf572")}, "parent": Object {"key": String("578bc52c-ac81-41a6-a56b-dfc79805368e"), "lookup_type": Object {"ById": String("578bc52c-ac81-41a6-a56b-dfc79805368e")}, "parent": Null}}}}, Object {"custom_router_id": Null, "identity": Object {"description": String("The default subnet for default"), "id": String("df878936-0bd3-498e-8a58-fd6b370cf975"), "name": String("default"), "time_created": String("2024-12-14T03:35:43.494884Z"), "time_deleted": Null, "time_modified": String("2024-12-14T03:35:43.494884Z")}, "ipv4_block": String("172.30.0.0/22"), "ipv6_block": String("fd10:261c:f22c::/64"), "rcgen": Number(1), "vpc_id": String("43bb0c4f-fec6-478e-864a-67e6dec06f39")}]), 14: Succeeded(Array [Object {"action": String("allow"), "direction": String("inbound"), "filter_hosts": Array [Object {"type": String("vpc"), "value": String("default")}], "filter_ports": Null, "filter_protocols": Null, "identity": Object {"description": String("allow inbound traffic to all instances within the VPC if originated within the VPC"), "id": String("38270ab6-432d-4bcf-93c5-d7c2e788902c"), "name": String("allow-internal-inbound"), "time_created": String("2024-12-14T03:35:43.538272719Z"), "time_deleted": Null, "time_modified": String("2024-12-14T03:35:43.538272719Z")}, "priority": Number(65534), "status": String("enabled"), "targets": Array [Object {"type": String("vpc"), "value": String("default")}], "vpc_id": String("43bb0c4f-fec6-478e-864a-67e6dec06f39")}, Object {"action": String("allow"), "direction": String("inbound"), "filter_hosts": Null, "filter_ports": Array [String("22")], "filter_protocols": Array [String("TCP")], "identity": Object {"description": String("allow inbound TCP connections on port 22 from anywhere"), "id": String("19006a6a-d25d-4c0f-8503-442509e0bddf"), "name": String("allow-ssh"), "time_created": String("2024-12-14T03:35:43.538274589Z"), "time_deleted": Null, "time_modified": String("2024-12-14T03:35:43.538274589Z")}, "priority": Number(65534), "status": String("enabled"), "targets": Array [Object {"type": String("vpc"), "value": String("default")}], "vpc_id": String("43bb0c4f-fec6-478e-864a-67e6dec06f39")}, Object {"action": String("allow"), "direction": String("inbound"), "filter_hosts": Null, "filter_ports": Null, "filter_protocols": Array [String("ICMP")], "identity": Object {"description": String("allow inbound ICMP traffic from anywhere"), "id": String("9d39d0dd-174b-4e2e-a034-5ae0195f3f1f"), "name": String("allow-icmp"), "time_created": String("2024-12-14T03:35:43.538275419Z"), "time_deleted": Null, "time_modified": String("2024-12-14T03:35:43.538275419Z")}, "priority": Number(65534), "status": String("enabled"), "targets": Array [Object {"type": String("vpc"), "value": String("default")}], "vpc_id": String("43bb0c4f-fec6-478e-864a-67e6dec06f39")}]), 15: Succeeded(Object {"key": String("5b7779bc-ff32-48de-b1c6-d4f4ba96c533"), "lookup_type": Object {"ById": String("5b7779bc-ff32-48de-b1c6-d4f4ba96c533")}, "parent": Object {"key": String("43bb0c4f-fec6-478e-864a-67e6dec06f39"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("8aed7aa9-b517-4399-811c-bfaf9b226118"), "lookup_type": Object {"ByName": String("proj-9c0961bf572")}, "parent": Object {"key": String("578bc52c-ac81-41a6-a56b-dfc79805368e"), "lookup_type": Object {"ById": String("578bc52c-ac81-41a6-a56b-dfc79805368e")}, "parent": Null}}}}), 16: Succeeded(Null), 17: Succeeded(Null), 18: Succeeded(Null), 19: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"default_internet_gateway_id": String("5b7779bc-ff32-48de-b1c6-d4f4ba96c533"), "default_subnet_id": String("df878936-0bd3-498e-8a58-fd6b370cf975"), "default_v4_route_id": String("e58dde20-ea05-401b-8e67-69dddb18fb8c"), "default_v6_route_id": String("c699eb8b-715b-4605-a17a-f90eec60f292"), "firewall": Array [Object {"action": String("allow"), "direction": String("inbound"), "filter_hosts": Array [Object {"type": String("vpc"), "value": String("default")}], "filter_ports": Null, "filter_protocols": Null, "identity": Object {"description": String("allow inbound traffic to all instances within the VPC if originated within the VPC"), "id": String("38270ab6-432d-4bcf-93c5-d7c2e788902c"), "name": String("allow-internal-inbound"), "time_created": String("2024-12-14T03:35:43.538272719Z"), "time_deleted": Null, "time_modified": String("2024-12-14T03:35:43.538272719Z")}, "priority": Number(65534), "status": String("enabled"), "targets": Array [Object {"type": String("vpc"), "value": String("default")}], "vpc_id": String("43bb0c4f-fec6-478e-864a-67e6dec06f39")}, Object {"action": String("allow"), "direction": String("inbound"), "filter_hosts": Null, "filter_ports": Array [String("22")], "filter_protocols": Array [String("TCP")], "identity": Object {"description": String("allow inbound TCP connections on port 22 from anywhere"), "id": String("19006a6a-d25d-4c0f-8503-442509e0bddf"), "name": String("allow-ssh"), "time_created": String("2024-12-14T03:35:43.538274589Z"), "time_deleted": Null, "time_modified": String("2024-12-14T03:35:43.538274589Z")}, "priority": Number(65534), "status": String("enabled"), "targets": Array [Object {"type": String("vpc"), "value": String("default")}], "vpc_id": String("43bb0c4f-fec6-478e-864a-67e6dec06f39")}, Object {"action": String("allow"), "direction": String("inbound"), "filter_hosts": Null, "filter_ports": Null, "filter_protocols": Array [String("ICMP")], "identity": Object {"description": String("allow inbound ICMP traffic from anywhere"), "id": String("9d39d0dd-174b-4e2e-a034-5ae0195f3f1f"), "name": String("allow-icmp"), "time_created": String("2024-12-14T03:35:43.538275419Z"), "time_deleted": Null, "time_modified": String("2024-12-14T03:35:43.538275419Z")}, "priority": Number(65534), "status": String("enabled"), "targets": Array [Object {"type": String("vpc"), "value": String("default")}], "vpc_id": String("43bb0c4f-fec6-478e-864a-67e6dec06f39")}], "gateway": Object {"key": String("5b7779bc-ff32-48de-b1c6-d4f4ba96c533"), "lookup_type": Object {"ById": String("5b7779bc-ff32-48de-b1c6-d4f4ba96c533")}, "parent": Object {"key": String("43bb0c4f-fec6-478e-864a-67e6dec06f39"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("8aed7aa9-b517-4399-811c-bfaf9b226118"), "lookup_type": Object {"ByName": String("proj-9c0961bf572")}, "parent": Object {"key": String("578bc52c-ac81-41a6-a56b-dfc79805368e"), "lookup_type": Object {"ById": String("578bc52c-ac81-41a6-a56b-dfc79805368e")}, "parent": Null}}}}, "no_result": Null, "project": Array [Object {"key": String("8aed7aa9-b517-4399-811c-bfaf9b226118"), "lookup_type": Object {"ByName": String("proj-9c0961bf572")}, "parent": Object {"key": String("578bc52c-ac81-41a6-a56b-dfc79805368e"), "lookup_type": Object {"ById": String("578bc52c-ac81-41a6-a56b-dfc79805368e")}, "parent": Null}}, Object {"identity": Object {"description": String(""), "id": String("8aed7aa9-b517-4399-811c-bfaf9b226118"), "name": String("proj-9c0961bf572"), "time_created": String("2024-12-14T03:35:43.204454Z"), "time_deleted": Null, "time_modified": String("2024-12-14T03:35:43.204454Z")}, "rcgen": Number(1), "silo_id": String("578bc52c-ac81-41a6-a56b-dfc79805368e")}], "route4": Null, "route6": Null, "router": Object {"key": String("09bbd44b-923c-40e4-a154-80660c9d794e"), "lookup_type": Object {"ById": String("09bbd44b-923c-40e4-a154-80660c9d794e")}, "parent": Object {"key": String("43bb0c4f-fec6-478e-864a-67e6dec06f39"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("8aed7aa9-b517-4399-811c-bfaf9b226118"), "lookup_type": Object {"ByName": String("proj-9c0961bf572")}, "parent": Object {"key": String("578bc52c-ac81-41a6-a56b-dfc79805368e"), "lookup_type": Object {"ById": String("578bc52c-ac81-41a6-a56b-dfc79805368e")}, "parent": Null}}}}, "subnet": Array [Object {"key": String("df878936-0bd3-498e-8a58-fd6b370cf975"), "lookup_type": Object {"ById": String("df878936-0bd3-498e-8a58-fd6b370cf975")}, "parent": Object {"key": String("43bb0c4f-fec6-478e-864a-67e6dec06f39"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("8aed7aa9-b517-4399-811c-bfaf9b226118"), "lookup_type": Object {"ByName": String("proj-9c0961bf572")}, "parent": Object {"key": String("578bc52c-ac81-41a6-a56b-dfc79805368e"), "lookup_type": Object {"ById": String("578bc52c-ac81-41a6-a56b-dfc79805368e")}, "parent": Null}}}}, Object {"custom_router_id": Null, "identity": Object {"description": String("The default subnet for default"), "id": String("df878936-0bd3-498e-8a58-fd6b370cf975"), "name": String("default"), "time_created": String("2024-12-14T03:35:43.494884Z"), "time_deleted": Null, "time_modified": String("2024-12-14T03:35:43.494884Z")}, "ipv4_block": String("172.30.0.0/22"), "ipv6_block": String("fd10:261c:f22c::/64"), "rcgen": Number(1), "vpc_id": String("43bb0c4f-fec6-478e-864a-67e6dec06f39")}], "system_router_id": String("09bbd44b-923c-40e4-a154-80660c9d794e"), "vpc": Null, "vpc_create_params": Object {"authz_project": Object {"key": String("8aed7aa9-b517-4399-811c-bfaf9b226118"), "lookup_type": Object {"ByName": String("proj-9c0961bf572")}, "parent": Object {"key": String("578bc52c-ac81-41a6-a56b-dfc79805368e"), "lookup_type": Object {"ById": String("578bc52c-ac81-41a6-a56b-dfc79805368e")}, "parent": Null}}, "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"SiloUser": Object {"silo_id": String("578bc52c-ac81-41a6-a56b-dfc79805368e"), "silo_user_id": String("6d1b4298-6f48-4e38-b4c6-02b2175d87a2")}}}, Object {"mapped_fleet_roles": Object {"admin": Array [String("admin")]}}]}}, "vpc_create": Object {"description": String("Default VPC"), "dns_name": String("default"), "ipv6_prefix": String("fd10:261c:f22c::/48"), "name": String("default")}}, "vpc_id": String("43bb0c4f-fec6-478e-864a-67e6dec06f39")} }) }
37052024-12-14T03:35:43.797ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 695039 local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:34803 req_id = 4d658d6f-2637-4b64-8bbc-4cda9b47f916 response_code = 201 uri = /v1/projects
37062024-12-14T03:35:43.799ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
37072024-12-14T03:35:43.799ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
37082024-12-14T03:35:43.801ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
37092024-12-14T03:35:43.801ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
37102024-12-14T03:35:43.802ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
37112024-12-14T03:35:43.804ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "db95a822bf0fd07240bed3e48d369a3d91a78b45", lookup_type: ByCompositeId("token = \\"db95a822bf0fd07240bed3e48d369a3d91a78b45\\"") } result = Ok(())
37122024-12-14T03:35:43.804ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
37132024-12-14T03:35:43.804ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
37142024-12-14T03:35:43.805ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
37152024-12-14T03:35:43.805ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
37162024-12-14T03:35:43.807ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
37172024-12-14T03:35:43.807ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
37182024-12-14T03:35:43.808ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
37192024-12-14T03:35:43.808ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
37202024-12-14T03:35:43.810ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
37212024-12-14T03:35:43.811ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 578bc52c-ac81-41a6-a56b-dfc79805368e, lookup_type: ById(578bc52c-ac81-41a6-a56b-dfc79805368e) }, key: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, lookup_type: ById(6d1b4298-6f48-4e38-b4c6-02b2175d87a2) } result = Ok(())
37222024-12-14T03:35:43.811ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
37232024-12-14T03:35:43.811ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
37242024-12-14T03:35:43.813ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
37252024-12-14T03:35:43.814ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "db95a822bf0fd07240bed3e48d369a3d91a78b45", lookup_type: ByCompositeId("db95a822bf0fd07240bed3e48d369a3d91a78b45") } result = Ok(())
37262024-12-14T03:35:43.814ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
37272024-12-14T03:35:43.814ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
37282024-12-14T03:35:43.818ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
37292024-12-14T03:35:43.818ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
37302024-12-14T03:35:43.819ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
37312024-12-14T03:35:43.820ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
37322024-12-14T03:35:43.821ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
37332024-12-14T03:35:43.821ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
37342024-12-14T03:35:43.822ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
37352024-12-14T03:35:43.823ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
37362024-12-14T03:35:43.824ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
37372024-12-14T03:35:43.825ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 578bc52c-ac81-41a6-a56b-dfc79805368e, lookup_type: ById(578bc52c-ac81-41a6-a56b-dfc79805368e) }, key: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, lookup_type: ById(6d1b4298-6f48-4e38-b4c6-02b2175d87a2) } result = Ok(())
37382024-12-14T03:35:43.825ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
37392024-12-14T03:35:43.825ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
37402024-12-14T03:35:43.826ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
37412024-12-14T03:35:43.827ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
37422024-12-14T03:35:43.828ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
37432024-12-14T03:35:43.828ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
37442024-12-14T03:35:43.829ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
37452024-12-14T03:35:43.831ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 578bc52c-ac81-41a6-a56b-dfc79805368e, lookup_type: ById(578bc52c-ac81-41a6-a56b-dfc79805368e) } result = Ok(())
37462024-12-14T03:35:43.831ZDEBGnexus (dropshot_external): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:34803 req_id = 5889db46-1584-403d-830c-54d0fdaf1415 roles = RoleSet { roles: {} } uri = /v1/disks?project=proj-9c0961bf572
37472024-12-14T03:35:43.831ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:34803 req_id = 5889db46-1584-403d-830c-54d0fdaf1415 resource = Database result = Ok(()) uri = /v1/disks?project=proj-9c0961bf572
37482024-12-14T03:35:43.832ZDEBGnexus (dropshot_external): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:34803 req_id = 5889db46-1584-403d-830c-54d0fdaf1415 roles = RoleSet { roles: {} } uri = /v1/disks?project=proj-9c0961bf572
37492024-12-14T03:35:43.832ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:34803 req_id = 5889db46-1584-403d-830c-54d0fdaf1415 resource = Database result = Ok(()) uri = /v1/disks?project=proj-9c0961bf572
37502024-12-14T03:35:43.834ZDEBGnexus (dropshot_external): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:34803 req_id = 5889db46-1584-403d-830c-54d0fdaf1415 roles = RoleSet { roles: {} } uri = /v1/disks?project=proj-9c0961bf572
37512024-12-14T03:35:43.834ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:34803 req_id = 5889db46-1584-403d-830c-54d0fdaf1415 resource = Database result = Ok(()) uri = /v1/disks?project=proj-9c0961bf572
37522024-12-14T03:35:43.836ZDEBGnexus (dropshot_external): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:34803 req_id = 5889db46-1584-403d-830c-54d0fdaf1415 roles = RoleSet { roles: {} } uri = /v1/disks?project=proj-9c0961bf572
37532024-12-14T03:35:43.837ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:34803 req_id = 5889db46-1584-403d-830c-54d0fdaf1415 resource = Database result = Ok(()) uri = /v1/disks?project=proj-9c0961bf572
37542024-12-14T03:35:43.839ZDEBGnexus (dropshot_external): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:34803 req_id = 5889db46-1584-403d-830c-54d0fdaf1415 roles = RoleSet { roles: {} } uri = /v1/disks?project=proj-9c0961bf572
37552024-12-14T03:35:43.839ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:34803 req_id = 5889db46-1584-403d-830c-54d0fdaf1415 resource = Database result = Ok(()) uri = /v1/disks?project=proj-9c0961bf572
37562024-12-14T03:35:43.841ZDEBGnexus (dropshot_external): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:34803 req_id = 5889db46-1584-403d-830c-54d0fdaf1415 roles = RoleSet { roles: {} } uri = /v1/disks?project=proj-9c0961bf572
37572024-12-14T03:35:43.841ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:34803 req_id = 5889db46-1584-403d-830c-54d0fdaf1415 resource = Database result = Ok(()) uri = /v1/disks?project=proj-9c0961bf572
37582024-12-14T03:35:43.843ZDEBGnexus (dropshot_external): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:34803 req_id = 5889db46-1584-403d-830c-54d0fdaf1415 roles = RoleSet { roles: {(Silo, 578bc52c-ac81-41a6-a56b-dfc79805368e, "admin")} } uri = /v1/disks?project=proj-9c0961bf572
37592024-12-14T03:35:43.845ZDEBGnexus (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:34803 req_id = 5889db46-1584-403d-830c-54d0fdaf1415 resource = Project { parent: Silo { parent: Fleet, key: 578bc52c-ac81-41a6-a56b-dfc79805368e, lookup_type: ById(578bc52c-ac81-41a6-a56b-dfc79805368e) }, key: 8aed7aa9-b517-4399-811c-bfaf9b226118, lookup_type: ByName("proj-9c0961bf572") } result = Ok(()) uri = /v1/disks?project=proj-9c0961bf572
37602024-12-14T03:35:43.846ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = e1d583cf-78a1-4cd8-971c-17df5f9fc5bf saga_name = disk-create
37612024-12-14T03:35:43.846ZINFOnexus (SEC): saga create dag = {"end_node":10,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[2,3,null],[3,4,null],[4,5,null],[5,6,null],[6,7,null],[7,8,null],[9,0,null],[8,10,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateDiskId","name":"disk_id"}},{"Action":{"action_name":"common.uuid_generate","label":"GenerateVolumeId","name":"volume_id"}},{"Action":{"action_name":"disk_create.create_disk_record","label":"CreateDiskRecord","name":"created_disk"}},{"Action":{"action_name":"disk_create.regions_alloc","label":"RegionsAlloc","name":"datasets_and_regions"}},{"Action":{"action_name":"disk_create.space_account","label":"SpaceAccount","name":"no_result"}},{"Action":{"action_name":"disk_create.regions_ensure_undo","label":"RegionsEnsureUndo","name":"regions_ensure_undo"}},{"Action":{"action_name":"disk_create.regions_ensure","label":"RegionsEnsure","name":"regions_ensure"}},{"Action":{"action_name":"disk_create.create_volume_record","label":"CreateVolumeRecord","name":"created_volume"}},{"Action":{"action_name":"disk_create.finalize_disk_record","label":"FinalizeDiskRecord","name":"disk_runtime"}},{"Start":{"params":{"create_params":{"description":"","disk_source":{"block_size":512,"type":"blank"},"name":"disk-3d3717ae006","size":1073741824},"project_id":"8aed7aa9-b517-4399-811c-bfaf9b226118","serialized_authn":{"kind":{"Authenticated":[{"actor":{"SiloUser":{"silo_id":"578bc52c-ac81-41a6-a56b-dfc79805368e","silo_user_id":"6d1b4298-6f48-4e38-b4c6-02b2175d87a2"}}},{"mapped_fleet_roles":{"admin":["admin"]}}]}}}}},"End"]},"saga_name":"disk-create","start_node":9} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = e1d583cf-78a1-4cd8-971c-17df5f9fc5bf saga_name = disk-create sec_id = 5f2fe413-3c4a-4994-b4a0-995c1da486b1
37622024-12-14T03:35:43.846ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = e1d583cf-78a1-4cd8-971c-17df5f9fc5bf saga_name = disk-create
37632024-12-14T03:35:43.850ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = e1d583cf-78a1-4cd8-971c-17df5f9fc5bf saga_name = disk-create
37642024-12-14T03:35:43.850ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = e1d583cf-78a1-4cd8-971c-17df5f9fc5bf saga_name = disk-create sec_id = 5f2fe413-3c4a-4994-b4a0-995c1da486b1
37652024-12-14T03:35:43.850ZDEBGnexus (SEC): saga log event new_state = N009 started sec_id = 5f2fe413-3c4a-4994-b4a0-995c1da486b1
37662024-12-14T03:35:43.850ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 9 saga_id = e1d583cf-78a1-4cd8-971c-17df5f9fc5bf
37672024-12-14T03:35:43.853ZDEBGnexus (SEC): saga log event new_state = N009 succeeded sec_id = 5f2fe413-3c4a-4994-b4a0-995c1da486b1
37682024-12-14T03:35:43.853ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 9 saga_id = e1d583cf-78a1-4cd8-971c-17df5f9fc5bf
37692024-12-14T03:35:43.857ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 5f2fe413-3c4a-4994-b4a0-995c1da486b1
37702024-12-14T03:35:43.857ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = e1d583cf-78a1-4cd8-971c-17df5f9fc5bf
37712024-12-14T03:35:43.862ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 5f2fe413-3c4a-4994-b4a0-995c1da486b1
37722024-12-14T03:35:43.862ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("74670848-5d44-4852-bc5d-e46c97b1e097")) node_id = 0 saga_id = e1d583cf-78a1-4cd8-971c-17df5f9fc5bf
37732024-12-14T03:35:43.865ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 5f2fe413-3c4a-4994-b4a0-995c1da486b1
37742024-12-14T03:35:43.865ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = e1d583cf-78a1-4cd8-971c-17df5f9fc5bf
37752024-12-14T03:35:43.868ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 5f2fe413-3c4a-4994-b4a0-995c1da486b1
37762024-12-14T03:35:43.868ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("3aead670-8c03-462f-add7-e5e70903aeeb")) node_id = 1 saga_id = e1d583cf-78a1-4cd8-971c-17df5f9fc5bf
37772024-12-14T03:35:43.871ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 5f2fe413-3c4a-4994-b4a0-995c1da486b1
37782024-12-14T03:35:43.871ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = e1d583cf-78a1-4cd8-971c-17df5f9fc5bf
37792024-12-14T03:35:43.874ZDEBGnexus (SagaExecutor): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true roles = RoleSet { roles: {} } saga_id = e1d583cf-78a1-4cd8-971c-17df5f9fc5bf saga_name = disk-create saga_node = CreateDiskRecord
37802024-12-14T03:35:43.874ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true resource = Database result = Ok(()) saga_id = e1d583cf-78a1-4cd8-971c-17df5f9fc5bf saga_name = disk-create saga_node = CreateDiskRecord
37812024-12-14T03:35:43.875ZDEBGnexus (SagaExecutor): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true roles = RoleSet { roles: {} } saga_id = e1d583cf-78a1-4cd8-971c-17df5f9fc5bf saga_name = disk-create saga_node = CreateDiskRecord
37822024-12-14T03:35:43.875ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true resource = Database result = Ok(()) saga_id = e1d583cf-78a1-4cd8-971c-17df5f9fc5bf saga_name = disk-create saga_node = CreateDiskRecord
37832024-12-14T03:35:43.877ZDEBGnexus (SagaExecutor): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true roles = RoleSet { roles: {} } saga_id = e1d583cf-78a1-4cd8-971c-17df5f9fc5bf saga_name = disk-create saga_node = CreateDiskRecord
37842024-12-14T03:35:43.877ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true resource = Database result = Ok(()) saga_id = e1d583cf-78a1-4cd8-971c-17df5f9fc5bf saga_name = disk-create saga_node = CreateDiskRecord
37852024-12-14T03:35:43.879ZDEBGnexus (SagaExecutor): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true roles = RoleSet { roles: {} } saga_id = e1d583cf-78a1-4cd8-971c-17df5f9fc5bf saga_name = disk-create saga_node = CreateDiskRecord
37862024-12-14T03:35:43.879ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true resource = Database result = Ok(()) saga_id = e1d583cf-78a1-4cd8-971c-17df5f9fc5bf saga_name = disk-create saga_node = CreateDiskRecord
37872024-12-14T03:35:43.881ZDEBGnexus (SagaExecutor): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true roles = RoleSet { roles: {} } saga_id = e1d583cf-78a1-4cd8-971c-17df5f9fc5bf saga_name = disk-create saga_node = CreateDiskRecord
37882024-12-14T03:35:43.881ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true resource = Database result = Ok(()) saga_id = e1d583cf-78a1-4cd8-971c-17df5f9fc5bf saga_name = disk-create saga_node = CreateDiskRecord
37892024-12-14T03:35:43.883ZDEBGnexus (SagaExecutor): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true roles = RoleSet { roles: {} } saga_id = e1d583cf-78a1-4cd8-971c-17df5f9fc5bf saga_name = disk-create saga_node = CreateDiskRecord
37902024-12-14T03:35:43.883ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true resource = Database result = Ok(()) saga_id = e1d583cf-78a1-4cd8-971c-17df5f9fc5bf saga_name = disk-create saga_node = CreateDiskRecord
37912024-12-14T03:35:43.886ZDEBGnexus (SagaExecutor): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true roles = RoleSet { roles: {(Silo, 578bc52c-ac81-41a6-a56b-dfc79805368e, "admin")} } saga_id = e1d583cf-78a1-4cd8-971c-17df5f9fc5bf saga_name = disk-create saga_node = CreateDiskRecord
37922024-12-14T03:35:43.888ZDEBGnexus (SagaExecutor): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true resource = Project { parent: Silo { parent: Fleet, key: 578bc52c-ac81-41a6-a56b-dfc79805368e, lookup_type: ById(578bc52c-ac81-41a6-a56b-dfc79805368e) }, key: 8aed7aa9-b517-4399-811c-bfaf9b226118, lookup_type: ById(8aed7aa9-b517-4399-811c-bfaf9b226118) } result = Ok(()) saga_id = e1d583cf-78a1-4cd8-971c-17df5f9fc5bf saga_name = disk-create saga_node = CreateDiskRecord
37932024-12-14T03:35:43.888ZDEBGnexus (SagaExecutor): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true roles = RoleSet { roles: {} } saga_id = e1d583cf-78a1-4cd8-971c-17df5f9fc5bf saga_name = disk-create saga_node = CreateDiskRecord
37942024-12-14T03:35:43.888ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true resource = Database result = Ok(()) saga_id = e1d583cf-78a1-4cd8-971c-17df5f9fc5bf saga_name = disk-create saga_node = CreateDiskRecord
37952024-12-14T03:35:43.890ZDEBGnexus (SagaExecutor): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true roles = RoleSet { roles: {} } saga_id = e1d583cf-78a1-4cd8-971c-17df5f9fc5bf saga_name = disk-create saga_node = CreateDiskRecord
37962024-12-14T03:35:43.890ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true resource = Database result = Ok(()) saga_id = e1d583cf-78a1-4cd8-971c-17df5f9fc5bf saga_name = disk-create saga_node = CreateDiskRecord
37972024-12-14T03:35:43.892ZDEBGnexus (SagaExecutor): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true roles = RoleSet { roles: {} } saga_id = e1d583cf-78a1-4cd8-971c-17df5f9fc5bf saga_name = disk-create saga_node = CreateDiskRecord
37982024-12-14T03:35:43.892ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true resource = Database result = Ok(()) saga_id = e1d583cf-78a1-4cd8-971c-17df5f9fc5bf saga_name = disk-create saga_node = CreateDiskRecord
37992024-12-14T03:35:43.894ZDEBGnexus (SagaExecutor): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true roles = RoleSet { roles: {} } saga_id = e1d583cf-78a1-4cd8-971c-17df5f9fc5bf saga_name = disk-create saga_node = CreateDiskRecord
38002024-12-14T03:35:43.895ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true resource = Database result = Ok(()) saga_id = e1d583cf-78a1-4cd8-971c-17df5f9fc5bf saga_name = disk-create saga_node = CreateDiskRecord
38012024-12-14T03:35:43.896ZDEBGnexus (SagaExecutor): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true roles = RoleSet { roles: {(Silo, 578bc52c-ac81-41a6-a56b-dfc79805368e, "admin")} } saga_id = e1d583cf-78a1-4cd8-971c-17df5f9fc5bf saga_name = disk-create saga_node = CreateDiskRecord
38022024-12-14T03:35:43.899ZDEBGnexus (SagaExecutor): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true resource = Project { parent: Silo { parent: Fleet, key: 578bc52c-ac81-41a6-a56b-dfc79805368e, lookup_type: ById(578bc52c-ac81-41a6-a56b-dfc79805368e) }, key: 8aed7aa9-b517-4399-811c-bfaf9b226118, lookup_type: ById(8aed7aa9-b517-4399-811c-bfaf9b226118) } result = Ok(()) saga_id = e1d583cf-78a1-4cd8-971c-17df5f9fc5bf saga_name = disk-create saga_node = CreateDiskRecord
38032024-12-14T03:35:43.899ZDEBGnexus (SagaExecutor): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true roles = RoleSet { roles: {} } saga_id = e1d583cf-78a1-4cd8-971c-17df5f9fc5bf saga_name = disk-create saga_node = CreateDiskRecord
38042024-12-14T03:35:43.899ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true resource = Database result = Ok(()) saga_id = e1d583cf-78a1-4cd8-971c-17df5f9fc5bf saga_name = disk-create saga_node = CreateDiskRecord
38052024-12-14T03:35:43.936ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 5f2fe413-3c4a-4994-b4a0-995c1da486b1
38062024-12-14T03:35:43.936ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"block_size": String("Traditional"), "create_image_id": Null, "create_snapshot_id": Null, "identity": Object {"description": String(""), "id": String("74670848-5d44-4852-bc5d-e46c97b1e097"), "name": String("disk-3d3717ae006"), "time_created": String("2024-12-14T03:35:43.874294Z"), "time_deleted": Null, "time_modified": String("2024-12-14T03:35:43.874294Z")}, "pantry_address": Null, "project_id": String("8aed7aa9-b517-4399-811c-bfaf9b226118"), "rcgen": Number(1), "runtime_state": Object {"attach_instance_id": Null, "disk_state": String("creating"), "gen": Number(1), "time_updated": String("2024-12-14T03:35:43.874293Z")}, "size": Number(1073741824), "slot": Null, "volume_id": String("3aead670-8c03-462f-add7-e5e70903aeeb")}) node_id = 2 saga_id = e1d583cf-78a1-4cd8-971c-17df5f9fc5bf
38072024-12-14T03:35:43.940ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 5f2fe413-3c4a-4994-b4a0-995c1da486b1
38082024-12-14T03:35:43.940ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = e1d583cf-78a1-4cd8-971c-17df5f9fc5bf
38092024-12-14T03:35:43.943ZDEBGnexus (SagaExecutor): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true roles = RoleSet { roles: {} } saga_id = e1d583cf-78a1-4cd8-971c-17df5f9fc5bf saga_name = disk-create saga_node = RegionsAlloc
38102024-12-14T03:35:43.943ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true resource = Database result = Ok(()) saga_id = e1d583cf-78a1-4cd8-971c-17df5f9fc5bf saga_name = disk-create saga_node = RegionsAlloc
38112024-12-14T03:35:43.988ZINFOnexus (datastore): Allocated regions for volume datasets_and_regions = [(Dataset { identity: DatasetIdentity { id: 121d422a-b686-4104-94c9-5fd7c76c65b6 (dataset), time_created: 2024-12-14T03:35:40.104807Z, time_modified: 2024-12-14T03:35:40.104807Z }, time_deleted: None, rcgen: Generation(Generation(1)), pool_id: 7abbec18-6cce-4b1e-9880-d5caa99cf0a9, ip: Some(fd00:1122:3344:101::14), port: Some(SqlU16(32345)), kind: Crucible, size_used: Some(1073741824), zone_name: None, quota: None, reservation: None, compression: None }, Region { identity: RegionIdentity { id: 3ead8cd7-6fa7-4bbf-9f9e-9dca40f92855, time_created: 2024-12-14T03:35:43.959368Z, time_modified: 2024-12-14T03:35:43.959368Z }, dataset_id: 121d422a-b686-4104-94c9-5fd7c76c65b6 (dataset), volume_id: 3aead670-8c03-462f-add7-e5e70903aeeb, block_size: ByteCount(ByteCount(512)), blocks_per_extent: 131072, extent_count: 16, port: None, read_only: false, deleting: false }), (Dataset { identity: DatasetIdentity { id: 41ff7081-1b47-498e-821e-887b9e69d3d4 (dataset), time_created: 2024-12-14T03:35:40.104810Z, time_modified: 2024-12-14T03:35:40.104810Z }, time_deleted: None, rcgen: Generation(Generation(1)), pool_id: a74803d1-a742-40d3-90f4-c7bf854f2fa2, ip: Some(fd00:1122:3344:101::19), port: Some(SqlU16(32345)), kind: Crucible, size_used: Some(1073741824), zone_name: None, quota: None, reservation: None, compression: None }, Region { identity: RegionIdentity { id: 4db54528-ce0b-448e-b664-cc8ddd73d51a, time_created: 2024-12-14T03:35:43.959368Z, time_modified: 2024-12-14T03:35:43.959368Z }, dataset_id: 41ff7081-1b47-498e-821e-887b9e69d3d4 (dataset), volume_id: 3aead670-8c03-462f-add7-e5e70903aeeb, block_size: ByteCount(ByteCount(512)), blocks_per_extent: 131072, extent_count: 16, port: None, read_only: false, deleting: false }), (Dataset { identity: DatasetIdentity { id: 54cf7cf4-70f0-4b69-9a7c-f396dbefa17d (dataset), time_created: 2024-12-14T03:35:40.104807Z, time_modified: 2024-12-14T03:35:40.104807Z }, time_deleted: None, rcgen: Generation(Generation(1)), pool_id: 0943bac0-9587-46a8-9356-3f72a7cd0f99, ip: Some(fd00:1122:3344:101::12), port: Some(SqlU16(32345)), kind: Crucible, size_used: Some(1073741824), zone_name: None, quota: None, reservation: None, compression: None }, Region { identity: RegionIdentity { id: 991790da-bac9-4a32-b6f4-0fb9e22fea3d, time_created: 2024-12-14T03:35:43.959368Z, time_modified: 2024-12-14T03:35:43.959368Z }, dataset_id: 54cf7cf4-70f0-4b69-9a7c-f396dbefa17d (dataset), volume_id: 3aead670-8c03-462f-add7-e5e70903aeeb, block_size: ByteCount(ByteCount(512)), blocks_per_extent: 131072, extent_count: 16, port: None, read_only: false, deleting: false })] file = nexus/db-queries/src/db/datastore/region.rs:282 maybe_snapshot_id = None volume_id = 3aead670-8c03-462f-add7-e5e70903aeeb
38122024-12-14T03:35:43.988ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 5f2fe413-3c4a-4994-b4a0-995c1da486b1
38132024-12-14T03:35:43.988ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Array [Array [Object {"compression": Null, "identity": Object {"id": String("121d422a-b686-4104-94c9-5fd7c76c65b6"), "time_created": String("2024-12-14T03:35:40.104807Z"), "time_modified": String("2024-12-14T03:35:40.104807Z")}, "ip": String("fd00:1122:3344:101::14"), "kind": String("Crucible"), "pool_id": String("7abbec18-6cce-4b1e-9880-d5caa99cf0a9"), "port": Number(32345), "quota": Null, "rcgen": Number(1), "reservation": Null, "size_used": Number(1073741824), "time_deleted": Null, "zone_name": Null}, Object {"block_size": Number(512), "blocks_per_extent": Number(131072), "dataset_id": String("121d422a-b686-4104-94c9-5fd7c76c65b6"), "deleting": Bool(false), "extent_count": Number(16), "identity": Object {"id": String("3ead8cd7-6fa7-4bbf-9f9e-9dca40f92855"), "time_created": String("2024-12-14T03:35:43.959368Z"), "time_modified": String("2024-12-14T03:35:43.959368Z")}, "port": Null, "read_only": Bool(false), "volume_id": String("3aead670-8c03-462f-add7-e5e70903aeeb")}], Array [Object {"compression": Null, "identity": Object {"id": String("41ff7081-1b47-498e-821e-887b9e69d3d4"), "time_created": String("2024-12-14T03:35:40.104810Z"), "time_modified": String("2024-12-14T03:35:40.104810Z")}, "ip": String("fd00:1122:3344:101::19"), "kind": String("Crucible"), "pool_id": String("a74803d1-a742-40d3-90f4-c7bf854f2fa2"), "port": Number(32345), "quota": Null, "rcgen": Number(1), "reservation": Null, "size_used": Number(1073741824), "time_deleted": Null, "zone_name": Null}, Object {"block_size": Number(512), "blocks_per_extent": Number(131072), "dataset_id": String("41ff7081-1b47-498e-821e-887b9e69d3d4"), "deleting": Bool(false), "extent_count": Number(16), "identity": Object {"id": String("4db54528-ce0b-448e-b664-cc8ddd73d51a"), "time_created": String("2024-12-14T03:35:43.959368Z"), "time_modified": String("2024-12-14T03:35:43.959368Z")}, "port": Null, "read_only": Bool(false), "volume_id": String("3aead670-8c03-462f-add7-e5e70903aeeb")}], Array [Object {"compression": Null, "identity": Object {"id": String("54cf7cf4-70f0-4b69-9a7c-f396dbefa17d"), "time_created": String("2024-12-14T03:35:40.104807Z"), "time_modified": String("2024-12-14T03:35:40.104807Z")}, "ip": String("fd00:1122:3344:101::12"), "kind": String("Crucible"), "pool_id": String("0943bac0-9587-46a8-9356-3f72a7cd0f99"), "port": Number(32345), "quota": Null, "rcgen": Number(1), "reservation": Null, "size_used": Number(1073741824), "time_deleted": Null, "zone_name": Null}, Object {"block_size": Number(512), "blocks_per_extent": Number(131072), "dataset_id": String("54cf7cf4-70f0-4b69-9a7c-f396dbefa17d"), "deleting": Bool(false), "extent_count": Number(16), "identity": Object {"id": String("991790da-bac9-4a32-b6f4-0fb9e22fea3d"), "time_created": String("2024-12-14T03:35:43.959368Z"), "time_modified": String("2024-12-14T03:35:43.959368Z")}, "port": Null, "read_only": Bool(false), "volume_id": String("3aead670-8c03-462f-add7-e5e70903aeeb")}]]) node_id = 3 saga_id = e1d583cf-78a1-4cd8-971c-17df5f9fc5bf
38142024-12-14T03:35:43.992ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 5f2fe413-3c4a-4994-b4a0-995c1da486b1
38152024-12-14T03:35:43.992ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = e1d583cf-78a1-4cd8-971c-17df5f9fc5bf
38162024-12-14T03:35:43.995ZDEBGnexus (SagaExecutor): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true roles = RoleSet { roles: {} } saga_id = e1d583cf-78a1-4cd8-971c-17df5f9fc5bf saga_name = disk-create saga_node = SpaceAccount
38172024-12-14T03:35:43.996ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true resource = Database result = Ok(()) saga_id = e1d583cf-78a1-4cd8-971c-17df5f9fc5bf saga_name = disk-create saga_node = SpaceAccount
38182024-12-14T03:35:44.021ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 5f2fe413-3c4a-4994-b4a0-995c1da486b1
38192024-12-14T03:35:44.021ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = e1d583cf-78a1-4cd8-971c-17df5f9fc5bf
38202024-12-14T03:35:44.025ZDEBGnexus (SEC): saga log event new_state = N005 started sec_id = 5f2fe413-3c4a-4994-b4a0-995c1da486b1
38212024-12-14T03:35:44.025ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 5 saga_id = e1d583cf-78a1-4cd8-971c-17df5f9fc5bf
38222024-12-14T03:35:44.028ZDEBGnexus (SEC): saga log event new_state = N005 succeeded sec_id = 5f2fe413-3c4a-4994-b4a0-995c1da486b1
38232024-12-14T03:35:44.028ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 5 saga_id = e1d583cf-78a1-4cd8-971c-17df5f9fc5bf
38242024-12-14T03:35:44.031ZDEBGnexus (SEC): saga log event new_state = N006 started sec_id = 5f2fe413-3c4a-4994-b4a0-995c1da486b1
38252024-12-14T03:35:44.031ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 6 saga_id = e1d583cf-78a1-4cd8-971c-17df5f9fc5bf
38262024-12-14T03:35:44.064ZWARNnexus (SagaExecutor): Region requested, not yet created. Retrying in 288.986251ms dataset = 121d422a-b686-4104-94c9-5fd7c76c65b6 file = nexus/src/app/crucible.rs:231 region = 3ead8cd7-6fa7-4bbf-9f9e-9dca40f92855 saga_id = e1d583cf-78a1-4cd8-971c-17df5f9fc5bf saga_name = disk-create
38272024-12-14T03:35:44.071ZWARNnexus (SagaExecutor): Region requested, not yet created. Retrying in 139.100183ms dataset = 54cf7cf4-70f0-4b69-9a7c-f396dbefa17d file = nexus/src/app/crucible.rs:231 region = 991790da-bac9-4a32-b6f4-0fb9e22fea3d saga_id = e1d583cf-78a1-4cd8-971c-17df5f9fc5bf saga_name = disk-create
38282024-12-14T03:35:44.086ZWARNnexus (SagaExecutor): Region requested, not yet created. Retrying in 335.473776ms dataset = 41ff7081-1b47-498e-821e-887b9e69d3d4 file = nexus/src/app/crucible.rs:231 region = 4db54528-ce0b-448e-b664-cc8ddd73d51a saga_id = e1d583cf-78a1-4cd8-971c-17df5f9fc5bf saga_name = disk-create
38292024-12-14T03:35:44.218ZWARNnexus (SagaExecutor): Region requested, not yet created. Retrying in 422.730027ms dataset = 54cf7cf4-70f0-4b69-9a7c-f396dbefa17d file = nexus/src/app/crucible.rs:231 region = 991790da-bac9-4a32-b6f4-0fb9e22fea3d saga_id = e1d583cf-78a1-4cd8-971c-17df5f9fc5bf saga_name = disk-create
38302024-12-14T03:35:44.654ZDEBGnexus (SEC): saga log event new_state = N006 succeeded sec_id = 5f2fe413-3c4a-4994-b4a0-995c1da486b1
38312024-12-14T03:35:44.654ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("{\\"type\\":\\"volume\\",\\"block_size\\":512,\\"id\\":\\"74670848-5d44-4852-bc5d-e46c97b1e097\\",\\"sub_volumes\\":[{\\"type\\":\\"region\\",\\"block_size\\":512,\\"blocks_per_extent\\":131072,\\"extent_count\\":16,\\"gen\\":1,\\"opts\\":{\\"id\\":\\"74670848-5d44-4852-bc5d-e46c97b1e097\\",\\"key\\":\\"E668l9TUtAPjnQv+iE1l39iuF5LjyVU6cRrhlBr4xQY=\\",\\"lossy\\":false,\\"read_only\\":false,\\"target\\":[\\"[fd00:1122:3344:101::14]:19000\\",\\"[fd00:1122:3344:101::19]:19000\\",\\"[fd00:1122:3344:101::12]:19000\\"]}}]}")) node_id = 6 saga_id = e1d583cf-78a1-4cd8-971c-17df5f9fc5bf
38322024-12-14T03:35:44.660ZDEBGnexus (SEC): saga log event new_state = N007 started sec_id = 5f2fe413-3c4a-4994-b4a0-995c1da486b1
38332024-12-14T03:35:44.660ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 7 saga_id = e1d583cf-78a1-4cd8-971c-17df5f9fc5bf
38342024-12-14T03:35:44.670ZDEBGnexus (SEC): saga log event new_state = N007 succeeded sec_id = 5f2fe413-3c4a-4994-b4a0-995c1da486b1
38352024-12-14T03:35:44.670ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 7 saga_id = e1d583cf-78a1-4cd8-971c-17df5f9fc5bf
38362024-12-14T03:35:44.674ZDEBGnexus (SEC): saga log event new_state = N008 started sec_id = 5f2fe413-3c4a-4994-b4a0-995c1da486b1
38372024-12-14T03:35:44.674ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 8 saga_id = e1d583cf-78a1-4cd8-971c-17df5f9fc5bf
38382024-12-14T03:35:44.679ZDEBGnexus (SagaExecutor): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true roles = RoleSet { roles: {} } saga_id = e1d583cf-78a1-4cd8-971c-17df5f9fc5bf saga_name = disk-create saga_node = FinalizeDiskRecord
38392024-12-14T03:35:44.679ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true resource = Database result = Ok(()) saga_id = e1d583cf-78a1-4cd8-971c-17df5f9fc5bf saga_name = disk-create saga_node = FinalizeDiskRecord
38402024-12-14T03:35:44.687ZDEBGnexus (SagaExecutor): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true roles = RoleSet { roles: {} } saga_id = e1d583cf-78a1-4cd8-971c-17df5f9fc5bf saga_name = disk-create saga_node = FinalizeDiskRecord
38412024-12-14T03:35:44.687ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true resource = Database result = Ok(()) saga_id = e1d583cf-78a1-4cd8-971c-17df5f9fc5bf saga_name = disk-create saga_node = FinalizeDiskRecord
38422024-12-14T03:35:44.689ZDEBGnexus (SagaExecutor): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true roles = RoleSet { roles: {} } saga_id = e1d583cf-78a1-4cd8-971c-17df5f9fc5bf saga_name = disk-create saga_node = FinalizeDiskRecord
38432024-12-14T03:35:44.689ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true resource = Database result = Ok(()) saga_id = e1d583cf-78a1-4cd8-971c-17df5f9fc5bf saga_name = disk-create saga_node = FinalizeDiskRecord
38442024-12-14T03:35:44.690ZDEBGnexus (SagaExecutor): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true roles = RoleSet { roles: {} } saga_id = e1d583cf-78a1-4cd8-971c-17df5f9fc5bf saga_name = disk-create saga_node = FinalizeDiskRecord
38452024-12-14T03:35:44.690ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true resource = Database result = Ok(()) saga_id = e1d583cf-78a1-4cd8-971c-17df5f9fc5bf saga_name = disk-create saga_node = FinalizeDiskRecord
38462024-12-14T03:35:44.692ZDEBGnexus (SagaExecutor): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true roles = RoleSet { roles: {} } saga_id = e1d583cf-78a1-4cd8-971c-17df5f9fc5bf saga_name = disk-create saga_node = FinalizeDiskRecord
38472024-12-14T03:35:44.693ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true resource = Database result = Ok(()) saga_id = e1d583cf-78a1-4cd8-971c-17df5f9fc5bf saga_name = disk-create saga_node = FinalizeDiskRecord
38482024-12-14T03:35:44.695ZDEBGnexus (SagaExecutor): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true roles = RoleSet { roles: {} } saga_id = e1d583cf-78a1-4cd8-971c-17df5f9fc5bf saga_name = disk-create saga_node = FinalizeDiskRecord
38492024-12-14T03:35:44.695ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true resource = Database result = Ok(()) saga_id = e1d583cf-78a1-4cd8-971c-17df5f9fc5bf saga_name = disk-create saga_node = FinalizeDiskRecord
38502024-12-14T03:35:44.697ZDEBGnexus (SagaExecutor): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true roles = RoleSet { roles: {} } saga_id = e1d583cf-78a1-4cd8-971c-17df5f9fc5bf saga_name = disk-create saga_node = FinalizeDiskRecord
38512024-12-14T03:35:44.698ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true resource = Database result = Ok(()) saga_id = e1d583cf-78a1-4cd8-971c-17df5f9fc5bf saga_name = disk-create saga_node = FinalizeDiskRecord
38522024-12-14T03:35:44.699ZDEBGnexus (SagaExecutor): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true roles = RoleSet { roles: {(Silo, 578bc52c-ac81-41a6-a56b-dfc79805368e, "admin")} } saga_id = e1d583cf-78a1-4cd8-971c-17df5f9fc5bf saga_name = disk-create saga_node = FinalizeDiskRecord
38532024-12-14T03:35:44.702ZDEBGnexus (SagaExecutor): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true resource = Disk { parent: Project { parent: Silo { parent: Fleet, key: 578bc52c-ac81-41a6-a56b-dfc79805368e, lookup_type: ById(578bc52c-ac81-41a6-a56b-dfc79805368e) }, key: 8aed7aa9-b517-4399-811c-bfaf9b226118, lookup_type: ById(8aed7aa9-b517-4399-811c-bfaf9b226118) }, key: 74670848-5d44-4852-bc5d-e46c97b1e097, lookup_type: ById(74670848-5d44-4852-bc5d-e46c97b1e097) } result = Ok(()) saga_id = e1d583cf-78a1-4cd8-971c-17df5f9fc5bf saga_name = disk-create saga_node = FinalizeDiskRecord
38542024-12-14T03:35:44.702ZDEBGnexus (SagaExecutor): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true roles = RoleSet { roles: {} } saga_id = e1d583cf-78a1-4cd8-971c-17df5f9fc5bf saga_name = disk-create saga_node = FinalizeDiskRecord
38552024-12-14T03:35:44.702ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true resource = Database result = Ok(()) saga_id = e1d583cf-78a1-4cd8-971c-17df5f9fc5bf saga_name = disk-create saga_node = FinalizeDiskRecord
38562024-12-14T03:35:44.705ZDEBGnexus (SagaExecutor): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true roles = RoleSet { roles: {} } saga_id = e1d583cf-78a1-4cd8-971c-17df5f9fc5bf saga_name = disk-create saga_node = FinalizeDiskRecord
38572024-12-14T03:35:44.705ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true resource = Database result = Ok(()) saga_id = e1d583cf-78a1-4cd8-971c-17df5f9fc5bf saga_name = disk-create saga_node = FinalizeDiskRecord
38582024-12-14T03:35:44.707ZDEBGnexus (SagaExecutor): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true roles = RoleSet { roles: {} } saga_id = e1d583cf-78a1-4cd8-971c-17df5f9fc5bf saga_name = disk-create saga_node = FinalizeDiskRecord
38592024-12-14T03:35:44.707ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true resource = Database result = Ok(()) saga_id = e1d583cf-78a1-4cd8-971c-17df5f9fc5bf saga_name = disk-create saga_node = FinalizeDiskRecord
38602024-12-14T03:35:44.709ZDEBGnexus (SagaExecutor): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true roles = RoleSet { roles: {} } saga_id = e1d583cf-78a1-4cd8-971c-17df5f9fc5bf saga_name = disk-create saga_node = FinalizeDiskRecord
38612024-12-14T03:35:44.709ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true resource = Database result = Ok(()) saga_id = e1d583cf-78a1-4cd8-971c-17df5f9fc5bf saga_name = disk-create saga_node = FinalizeDiskRecord
38622024-12-14T03:35:44.711ZDEBGnexus (SagaExecutor): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true roles = RoleSet { roles: {(Silo, 578bc52c-ac81-41a6-a56b-dfc79805368e, "admin")} } saga_id = e1d583cf-78a1-4cd8-971c-17df5f9fc5bf saga_name = disk-create saga_node = FinalizeDiskRecord
38632024-12-14T03:35:44.713ZDEBGnexus (SagaExecutor): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true resource = Disk { parent: Project { parent: Silo { parent: Fleet, key: 578bc52c-ac81-41a6-a56b-dfc79805368e, lookup_type: ById(578bc52c-ac81-41a6-a56b-dfc79805368e) }, key: 8aed7aa9-b517-4399-811c-bfaf9b226118, lookup_type: ById(8aed7aa9-b517-4399-811c-bfaf9b226118) }, key: 74670848-5d44-4852-bc5d-e46c97b1e097, lookup_type: ById(74670848-5d44-4852-bc5d-e46c97b1e097) } result = Ok(()) saga_id = e1d583cf-78a1-4cd8-971c-17df5f9fc5bf saga_name = disk-create saga_node = FinalizeDiskRecord
38642024-12-14T03:35:44.713ZDEBGnexus (SagaExecutor): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true roles = RoleSet { roles: {} } saga_id = e1d583cf-78a1-4cd8-971c-17df5f9fc5bf saga_name = disk-create saga_node = FinalizeDiskRecord
38652024-12-14T03:35:44.714ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true resource = Database result = Ok(()) saga_id = e1d583cf-78a1-4cd8-971c-17df5f9fc5bf saga_name = disk-create saga_node = FinalizeDiskRecord
38662024-12-14T03:35:44.727ZDEBGnexus (SEC): saga log event new_state = N008 succeeded sec_id = 5f2fe413-3c4a-4994-b4a0-995c1da486b1
38672024-12-14T03:35:44.727ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 8 saga_id = e1d583cf-78a1-4cd8-971c-17df5f9fc5bf
38682024-12-14T03:35:44.730ZDEBGnexus (SEC): saga log event new_state = N010 started sec_id = 5f2fe413-3c4a-4994-b4a0-995c1da486b1
38692024-12-14T03:35:44.730ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 10 saga_id = e1d583cf-78a1-4cd8-971c-17df5f9fc5bf
38702024-12-14T03:35:44.733ZDEBGnexus (SEC): saga log event new_state = N010 succeeded sec_id = 5f2fe413-3c4a-4994-b4a0-995c1da486b1
38712024-12-14T03:35:44.733ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 10 saga_id = e1d583cf-78a1-4cd8-971c-17df5f9fc5bf
38722024-12-14T03:35:44.736ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = e1d583cf-78a1-4cd8-971c-17df5f9fc5bf sec_id = 5f2fe413-3c4a-4994-b4a0-995c1da486b1
38732024-12-14T03:35:44.736ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = e1d583cf-78a1-4cd8-971c-17df5f9fc5bf
38742024-12-14T03:35:44.769ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = e1d583cf-78a1-4cd8-971c-17df5f9fc5bf saga_name = disk-create sec_id = 5f2fe413-3c4a-4994-b4a0-995c1da486b1
38752024-12-14T03:35:44.769ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = e1d583cf-78a1-4cd8-971c-17df5f9fc5bf saga_name = disk-create saga_result = SagaResult { saga_id: e1d583cf-78a1-4cd8-971c-17df5f9fc5bf, saga_log: SagaLog { saga_id: e1d583cf-78a1-4cd8-971c-17df5f9fc5bf, unwinding: false, events: [N009 started, N009 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N003 started, N003 succeeded, N004 started, N004 succeeded, N005 started, N005 succeeded, N006 started, N006 succeeded, N007 started, N007 succeeded, N008 started, N008 succeeded, N010 started, N010 succeeded], node_status: {0: Succeeded(String("74670848-5d44-4852-bc5d-e46c97b1e097")), 1: Succeeded(String("3aead670-8c03-462f-add7-e5e70903aeeb")), 2: Succeeded(Object {"block_size": String("Traditional"), "create_image_id": Null, "create_snapshot_id": Null, "identity": Object {"description": String(""), "id": String("74670848-5d44-4852-bc5d-e46c97b1e097"), "name": String("disk-3d3717ae006"), "time_created": String("2024-12-14T03:35:43.874294Z"), "time_deleted": Null, "time_modified": String("2024-12-14T03:35:43.874294Z")}, "pantry_address": Null, "project_id": String("8aed7aa9-b517-4399-811c-bfaf9b226118"), "rcgen": Number(1), "runtime_state": Object {"attach_instance_id": Null, "disk_state": String("creating"), "gen": Number(1), "time_updated": String("2024-12-14T03:35:43.874293Z")}, "size": Number(1073741824), "slot": Null, "volume_id": String("3aead670-8c03-462f-add7-e5e70903aeeb")}), 3: Succeeded(Array [Array [Object {"compression": Null, "identity": Object {"id": String("121d422a-b686-4104-94c9-5fd7c76c65b6"), "time_created": String("2024-12-14T03:35:40.104807Z"), "time_modified": String("2024-12-14T03:35:40.104807Z")}, "ip": String("fd00:1122:3344:101::14"), "kind": String("Crucible"), "pool_id": String("7abbec18-6cce-4b1e-9880-d5caa99cf0a9"), "port": Number(32345), "quota": Null, "rcgen": Number(1), "reservation": Null, "size_used": Number(1073741824), "time_deleted": Null, "zone_name": Null}, Object {"block_size": Number(512), "blocks_per_extent": Number(131072), "dataset_id": String("121d422a-b686-4104-94c9-5fd7c76c65b6"), "deleting": Bool(false), "extent_count": Number(16), "identity": Object {"id": String("3ead8cd7-6fa7-4bbf-9f9e-9dca40f92855"), "time_created": String("2024-12-14T03:35:43.959368Z"), "time_modified": String("2024-12-14T03:35:43.959368Z")}, "port": Null, "read_only": Bool(false), "volume_id": String("3aead670-8c03-462f-add7-e5e70903aeeb")}], Array [Object {"compression": Null, "identity": Object {"id": String("41ff7081-1b47-498e-821e-887b9e69d3d4"), "time_created": String("2024-12-14T03:35:40.104810Z"), "time_modified": String("2024-12-14T03:35:40.104810Z")}, "ip": String("fd00:1122:3344:101::19"), "kind": String("Crucible"), "pool_id": String("a74803d1-a742-40d3-90f4-c7bf854f2fa2"), "port": Number(32345), "quota": Null, "rcgen": Number(1), "reservation": Null, "size_used": Number(1073741824), "time_deleted": Null, "zone_name": Null}, Object {"block_size": Number(512), "blocks_per_extent": Number(131072), "dataset_id": String("41ff7081-1b47-498e-821e-887b9e69d3d4"), "deleting": Bool(false), "extent_count": Number(16), "identity": Object {"id": String("4db54528-ce0b-448e-b664-cc8ddd73d51a"), "time_created": String("2024-12-14T03:35:43.959368Z"), "time_modified": String("2024-12-14T03:35:43.959368Z")}, "port": Null, "read_only": Bool(false), "volume_id": String("3aead670-8c03-462f-add7-e5e70903aeeb")}], Array [Object {"compression": Null, "identity": Object {"id": String("54cf7cf4-70f0-4b69-9a7c-f396dbefa17d"), "time_created": String("2024-12-14T03:35:40.104807Z"), "time_modified": String("2024-12-14T03:35:40.104807Z")}, "ip": String("fd00:1122:3344:101::12"), "kind": String("Crucible"), "pool_id": String("0943bac0-9587-46a8-9356-3f72a7cd0f99"), "port": Number(32345), "quota": Null, "rcgen": Number(1), "reservation": Null, "size_used": Number(1073741824), "time_deleted": Null, "zone_name": Null}, Object {"block_size": Number(512), "blocks_per_extent": Number(131072), "dataset_id": String("54cf7cf4-70f0-4b69-9a7c-f396dbefa17d"), "deleting": Bool(false), "extent_count": Number(16), "identity": Object {"id": String("991790da-bac9-4a32-b6f4-0fb9e22fea3d"), "time_created": String("2024-12-14T03:35:43.959368Z"), "time_modified": String("2024-12-14T03:35:43.959368Z")}, "port": Null, "read_only": Bool(false), "volume_id": String("3aead670-8c03-462f-add7-e5e70903aeeb")}]]), 4: Succeeded(Null), 5: Succeeded(Null), 6: Succeeded(String("{\\"type\\":\\"volume\\",\\"block_size\\":512,\\"id\\":\\"74670848-5d44-4852-bc5d-e46c97b1e097\\",\\"sub_volumes\\":[{\\"type\\":\\"region\\",\\"block_size\\":512,\\"blocks_per_extent\\":131072,\\"extent_count\\":16,\\"gen\\":1,\\"opts\\":{\\"id\\":\\"74670848-5d44-4852-bc5d-e46c97b1e097\\",\\"key\\":\\"E668l9TUtAPjnQv+iE1l39iuF5LjyVU6cRrhlBr4xQY=\\",\\"lossy\\":false,\\"read_only\\":false,\\"target\\":[\\"[fd00:1122:3344:101::14]:19000\\",\\"[fd00:1122:3344:101::19]:19000\\",\\"[fd00:1122:3344:101::12]:19000\\"]}}]}")), 7: Succeeded(Null), 8: Succeeded(Null), 9: Succeeded(Null), 10: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"created_disk": Object {"block_size": String("Traditional"), "create_image_id": Null, "create_snapshot_id": Null, "identity": Object {"description": String(""), "id": String("74670848-5d44-4852-bc5d-e46c97b1e097"), "name": String("disk-3d3717ae006"), "time_created": String("2024-12-14T03:35:43.874294Z"), "time_deleted": Null, "time_modified": String("2024-12-14T03:35:43.874294Z")}, "pantry_address": Null, "project_id": String("8aed7aa9-b517-4399-811c-bfaf9b226118"), "rcgen": Number(1), "runtime_state": Object {"attach_instance_id": Null, "disk_state": String("creating"), "gen": Number(1), "time_updated": String("2024-12-14T03:35:43.874293Z")}, "size": Number(1073741824), "slot": Null, "volume_id": String("3aead670-8c03-462f-add7-e5e70903aeeb")}, "created_volume": Null, "datasets_and_regions": Array [Array [Object {"compression": Null, "identity": Object {"id": String("121d422a-b686-4104-94c9-5fd7c76c65b6"), "time_created": String("2024-12-14T03:35:40.104807Z"), "time_modified": String("2024-12-14T03:35:40.104807Z")}, "ip": String("fd00:1122:3344:101::14"), "kind": String("Crucible"), "pool_id": String("7abbec18-6cce-4b1e-9880-d5caa99cf0a9"), "port": Number(32345), "quota": Null, "rcgen": Number(1), "reservation": Null, "size_used": Number(1073741824), "time_deleted": Null, "zone_name": Null}, Object {"block_size": Number(512), "blocks_per_extent": Number(131072), "dataset_id": String("121d422a-b686-4104-94c9-5fd7c76c65b6"), "deleting": Bool(false), "extent_count": Number(16), "identity": Object {"id": String("3ead8cd7-6fa7-4bbf-9f9e-9dca40f92855"), "time_created": String("2024-12-14T03:35:43.959368Z"), "time_modified": String("2024-12-14T03:35:43.959368Z")}, "port": Null, "read_only": Bool(false), "volume_id": String("3aead670-8c03-462f-add7-e5e70903aeeb")}], Array [Object {"compression": Null, "identity": Object {"id": String("41ff7081-1b47-498e-821e-887b9e69d3d4"), "time_created": String("2024-12-14T03:35:40.104810Z"), "time_modified": String("2024-12-14T03:35:40.104810Z")}, "ip": String("fd00:1122:3344:101::19"), "kind": String("Crucible"), "pool_id": String("a74803d1-a742-40d3-90f4-c7bf854f2fa2"), "port": Number(32345), "quota": Null, "rcgen": Number(1), "reservation": Null, "size_used": Number(1073741824), "time_deleted": Null, "zone_name": Null}, Object {"block_size": Number(512), "blocks_per_extent": Number(131072), "dataset_id": String("41ff7081-1b47-498e-821e-887b9e69d3d4"), "deleting": Bool(false), "extent_count": Number(16), "identity": Object {"id": String("4db54528-ce0b-448e-b664-cc8ddd73d51a"), "time_created": String("2024-12-14T03:35:43.959368Z"), "time_modified": String("2024-12-14T03:35:43.959368Z")}, "port": Null, "read_only": Bool(false), "volume_id": String("3aead670-8c03-462f-add7-e5e70903aeeb")}], Array [Object {"compression": Null, "identity": Object {"id": String("54cf7cf4-70f0-4b69-9a7c-f396dbefa17d"), "time_created": String("2024-12-14T03:35:40.104807Z"), "time_modified": String("2024-12-14T03:35:40.104807Z")}, "ip": String("fd00:1122:3344:101::12"), "kind": String("Crucible"), "pool_id": String("0943bac0-9587-46a8-9356-3f72a7cd0f99"), "port": Number(32345), "quota": Null, "rcgen": Number(1), "reservation": Null, "size_used": Number(1073741824), "time_deleted": Null, "zone_name": Null}, Object {"block_size": Number(512), "blocks_per_extent": Number(131072), "dataset_id": String("54cf7cf4-70f0-4b69-9a7c-f396dbefa17d"), "deleting": Bool(false), "extent_count": Number(16), "identity": Object {"id": String("991790da-bac9-4a32-b6f4-0fb9e22fea3d"), "time_created": String("2024-12-14T03:35:43.959368Z"), "time_modified": String("2024-12-14T03:35:43.959368Z")}, "port": Null, "read_only": Bool(false), "volume_id": String("3aead670-8c03-462f-add7-e5e70903aeeb")}]], "disk_id": String("74670848-5d44-4852-bc5d-e46c97b1e097"), "disk_runtime": Null, "no_result": Null, "regions_ensure": String("{\\"type\\":\\"volume\\",\\"block_size\\":512,\\"id\\":\\"74670848-5d44-4852-bc5d-e46c97b1e097\\",\\"sub_volumes\\":[{\\"type\\":\\"region\\",\\"block_size\\":512,\\"blocks_per_extent\\":131072,\\"extent_count\\":16,\\"gen\\":1,\\"opts\\":{\\"id\\":\\"74670848-5d44-4852-bc5d-e46c97b1e097\\",\\"key\\":\\"E668l9TUtAPjnQv+iE1l39iuF5LjyVU6cRrhlBr4xQY=\\",\\"lossy\\":false,\\"read_only\\":false,\\"target\\":[\\"[fd00:1122:3344:101::14]:19000\\",\\"[fd00:1122:3344:101::19]:19000\\",\\"[fd00:1122:3344:101::12]:19000\\"]}}]}"), "regions_ensure_undo": Null, "volume_id": String("3aead670-8c03-462f-add7-e5e70903aeeb")} }) }
38762024-12-14T03:35:44.769ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 970631 local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:34803 req_id = 5889db46-1584-403d-830c-54d0fdaf1415 response_code = 201 uri = /v1/disks?project=proj-9c0961bf572
38772024-12-14T03:35:44.770ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
38782024-12-14T03:35:44.770ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
38792024-12-14T03:35:44.772ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
38802024-12-14T03:35:44.772ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
38812024-12-14T03:35:44.774ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
38822024-12-14T03:35:44.775ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "db95a822bf0fd07240bed3e48d369a3d91a78b45", lookup_type: ByCompositeId("token = \\"db95a822bf0fd07240bed3e48d369a3d91a78b45\\"") } result = Ok(())
38832024-12-14T03:35:44.775ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
38842024-12-14T03:35:44.775ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
38852024-12-14T03:35:44.777ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
38862024-12-14T03:35:44.777ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
38872024-12-14T03:35:44.778ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
38882024-12-14T03:35:44.778ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
38892024-12-14T03:35:44.779ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
38902024-12-14T03:35:44.780ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
38912024-12-14T03:35:44.780ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
38922024-12-14T03:35:44.782ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 578bc52c-ac81-41a6-a56b-dfc79805368e, lookup_type: ById(578bc52c-ac81-41a6-a56b-dfc79805368e) }, key: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, lookup_type: ById(6d1b4298-6f48-4e38-b4c6-02b2175d87a2) } result = Ok(())
38932024-12-14T03:35:44.782ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
38942024-12-14T03:35:44.782ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
38952024-12-14T03:35:44.783ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
38962024-12-14T03:35:44.784ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "db95a822bf0fd07240bed3e48d369a3d91a78b45", lookup_type: ByCompositeId("db95a822bf0fd07240bed3e48d369a3d91a78b45") } result = Ok(())
38972024-12-14T03:35:44.784ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
38982024-12-14T03:35:44.784ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
38992024-12-14T03:35:44.788ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
39002024-12-14T03:35:44.789ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
39012024-12-14T03:35:44.790ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
39022024-12-14T03:35:44.790ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
39032024-12-14T03:35:44.791ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
39042024-12-14T03:35:44.791ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
39052024-12-14T03:35:44.792ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
39062024-12-14T03:35:44.793ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
39072024-12-14T03:35:44.794ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
39082024-12-14T03:35:44.795ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 578bc52c-ac81-41a6-a56b-dfc79805368e, lookup_type: ById(578bc52c-ac81-41a6-a56b-dfc79805368e) }, key: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, lookup_type: ById(6d1b4298-6f48-4e38-b4c6-02b2175d87a2) } result = Ok(())
39092024-12-14T03:35:44.795ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
39102024-12-14T03:35:44.795ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
39112024-12-14T03:35:44.797ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
39122024-12-14T03:35:44.797ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
39132024-12-14T03:35:44.798ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
39142024-12-14T03:35:44.798ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
39152024-12-14T03:35:44.800ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
39162024-12-14T03:35:44.801ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 578bc52c-ac81-41a6-a56b-dfc79805368e, lookup_type: ById(578bc52c-ac81-41a6-a56b-dfc79805368e) } result = Ok(())
39172024-12-14T03:35:44.801ZDEBGnexus (dropshot_external): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:34803 req_id = 7ded3810-a695-4788-9210-1228ead5c1df roles = RoleSet { roles: {} } uri = /v1/disks/disk-3d3717ae006?project=proj-9c0961bf572
39182024-12-14T03:35:44.801ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:34803 req_id = 7ded3810-a695-4788-9210-1228ead5c1df resource = Database result = Ok(()) uri = /v1/disks/disk-3d3717ae006?project=proj-9c0961bf572
39192024-12-14T03:35:44.802ZDEBGnexus (dropshot_external): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:34803 req_id = 7ded3810-a695-4788-9210-1228ead5c1df roles = RoleSet { roles: {} } uri = /v1/disks/disk-3d3717ae006?project=proj-9c0961bf572
39202024-12-14T03:35:44.802ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:34803 req_id = 7ded3810-a695-4788-9210-1228ead5c1df resource = Database result = Ok(()) uri = /v1/disks/disk-3d3717ae006?project=proj-9c0961bf572
39212024-12-14T03:35:44.804ZDEBGnexus (dropshot_external): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:34803 req_id = 7ded3810-a695-4788-9210-1228ead5c1df roles = RoleSet { roles: {} } uri = /v1/disks/disk-3d3717ae006?project=proj-9c0961bf572
39222024-12-14T03:35:44.804ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:34803 req_id = 7ded3810-a695-4788-9210-1228ead5c1df resource = Database result = Ok(()) uri = /v1/disks/disk-3d3717ae006?project=proj-9c0961bf572
39232024-12-14T03:35:44.807ZDEBGnexus (dropshot_external): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:34803 req_id = 7ded3810-a695-4788-9210-1228ead5c1df roles = RoleSet { roles: {} } uri = /v1/disks/disk-3d3717ae006?project=proj-9c0961bf572
39242024-12-14T03:35:44.807ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:34803 req_id = 7ded3810-a695-4788-9210-1228ead5c1df resource = Database result = Ok(()) uri = /v1/disks/disk-3d3717ae006?project=proj-9c0961bf572
39252024-12-14T03:35:44.809ZDEBGnexus (dropshot_external): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:34803 req_id = 7ded3810-a695-4788-9210-1228ead5c1df roles = RoleSet { roles: {} } uri = /v1/disks/disk-3d3717ae006?project=proj-9c0961bf572
39262024-12-14T03:35:44.810ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:34803 req_id = 7ded3810-a695-4788-9210-1228ead5c1df resource = Database result = Ok(()) uri = /v1/disks/disk-3d3717ae006?project=proj-9c0961bf572
39272024-12-14T03:35:44.812ZDEBGnexus (dropshot_external): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:34803 req_id = 7ded3810-a695-4788-9210-1228ead5c1df roles = RoleSet { roles: {} } uri = /v1/disks/disk-3d3717ae006?project=proj-9c0961bf572
39282024-12-14T03:35:44.812ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:34803 req_id = 7ded3810-a695-4788-9210-1228ead5c1df resource = Database result = Ok(()) uri = /v1/disks/disk-3d3717ae006?project=proj-9c0961bf572
39292024-12-14T03:35:44.814ZDEBGnexus (dropshot_external): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:34803 req_id = 7ded3810-a695-4788-9210-1228ead5c1df roles = RoleSet { roles: {} } uri = /v1/disks/disk-3d3717ae006?project=proj-9c0961bf572
39302024-12-14T03:35:44.814ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:34803 req_id = 7ded3810-a695-4788-9210-1228ead5c1df resource = Database result = Ok(()) uri = /v1/disks/disk-3d3717ae006?project=proj-9c0961bf572
39312024-12-14T03:35:44.816ZDEBGnexus (dropshot_external): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:34803 req_id = 7ded3810-a695-4788-9210-1228ead5c1df roles = RoleSet { roles: {(Silo, 578bc52c-ac81-41a6-a56b-dfc79805368e, "admin")} } uri = /v1/disks/disk-3d3717ae006?project=proj-9c0961bf572
39322024-12-14T03:35:44.819ZDEBGnexus (dropshot_external): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:34803 req_id = 7ded3810-a695-4788-9210-1228ead5c1df resource = Disk { parent: Project { parent: Silo { parent: Fleet, key: 578bc52c-ac81-41a6-a56b-dfc79805368e, lookup_type: ById(578bc52c-ac81-41a6-a56b-dfc79805368e) }, key: 8aed7aa9-b517-4399-811c-bfaf9b226118, lookup_type: ByName("proj-9c0961bf572") }, key: 74670848-5d44-4852-bc5d-e46c97b1e097, lookup_type: ByName("disk-3d3717ae006") } result = Ok(()) uri = /v1/disks/disk-3d3717ae006?project=proj-9c0961bf572
39332024-12-14T03:35:44.819ZDEBGnexus (dropshot_external): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:34803 req_id = 7ded3810-a695-4788-9210-1228ead5c1df roles = RoleSet { roles: {} } uri = /v1/disks/disk-3d3717ae006?project=proj-9c0961bf572
39342024-12-14T03:35:44.819ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:34803 req_id = 7ded3810-a695-4788-9210-1228ead5c1df resource = Database result = Ok(()) uri = /v1/disks/disk-3d3717ae006?project=proj-9c0961bf572
39352024-12-14T03:35:44.821ZDEBGnexus (dropshot_external): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:34803 req_id = 7ded3810-a695-4788-9210-1228ead5c1df roles = RoleSet { roles: {} } uri = /v1/disks/disk-3d3717ae006?project=proj-9c0961bf572
39362024-12-14T03:35:44.821ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:34803 req_id = 7ded3810-a695-4788-9210-1228ead5c1df resource = Database result = Ok(()) uri = /v1/disks/disk-3d3717ae006?project=proj-9c0961bf572
39372024-12-14T03:35:44.822ZDEBGnexus (dropshot_external): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:34803 req_id = 7ded3810-a695-4788-9210-1228ead5c1df roles = RoleSet { roles: {} } uri = /v1/disks/disk-3d3717ae006?project=proj-9c0961bf572
39382024-12-14T03:35:44.822ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:34803 req_id = 7ded3810-a695-4788-9210-1228ead5c1df resource = Database result = Ok(()) uri = /v1/disks/disk-3d3717ae006?project=proj-9c0961bf572
39392024-12-14T03:35:44.824ZDEBGnexus (dropshot_external): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:34803 req_id = 7ded3810-a695-4788-9210-1228ead5c1df roles = RoleSet { roles: {} } uri = /v1/disks/disk-3d3717ae006?project=proj-9c0961bf572
39402024-12-14T03:35:44.824ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:34803 req_id = 7ded3810-a695-4788-9210-1228ead5c1df resource = Database result = Ok(()) uri = /v1/disks/disk-3d3717ae006?project=proj-9c0961bf572
39412024-12-14T03:35:44.825ZDEBGnexus (dropshot_external): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:34803 req_id = 7ded3810-a695-4788-9210-1228ead5c1df roles = RoleSet { roles: {} } uri = /v1/disks/disk-3d3717ae006?project=proj-9c0961bf572
39422024-12-14T03:35:44.826ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:34803 req_id = 7ded3810-a695-4788-9210-1228ead5c1df resource = Database result = Ok(()) uri = /v1/disks/disk-3d3717ae006?project=proj-9c0961bf572
39432024-12-14T03:35:44.828ZDEBGnexus (dropshot_external): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:34803 req_id = 7ded3810-a695-4788-9210-1228ead5c1df roles = RoleSet { roles: {} } uri = /v1/disks/disk-3d3717ae006?project=proj-9c0961bf572
39442024-12-14T03:35:44.828ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:34803 req_id = 7ded3810-a695-4788-9210-1228ead5c1df resource = Database result = Ok(()) uri = /v1/disks/disk-3d3717ae006?project=proj-9c0961bf572
39452024-12-14T03:35:44.830ZDEBGnexus (dropshot_external): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:34803 req_id = 7ded3810-a695-4788-9210-1228ead5c1df roles = RoleSet { roles: {} } uri = /v1/disks/disk-3d3717ae006?project=proj-9c0961bf572
39462024-12-14T03:35:44.830ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:34803 req_id = 7ded3810-a695-4788-9210-1228ead5c1df resource = Database result = Ok(()) uri = /v1/disks/disk-3d3717ae006?project=proj-9c0961bf572
39472024-12-14T03:35:44.832ZDEBGnexus (dropshot_external): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:34803 req_id = 7ded3810-a695-4788-9210-1228ead5c1df roles = RoleSet { roles: {(Silo, 578bc52c-ac81-41a6-a56b-dfc79805368e, "admin")} } uri = /v1/disks/disk-3d3717ae006?project=proj-9c0961bf572
39482024-12-14T03:35:44.835ZDEBGnexus (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:34803 req_id = 7ded3810-a695-4788-9210-1228ead5c1df resource = Disk { parent: Project { parent: Silo { parent: Fleet, key: 578bc52c-ac81-41a6-a56b-dfc79805368e, lookup_type: ById(578bc52c-ac81-41a6-a56b-dfc79805368e) }, key: 8aed7aa9-b517-4399-811c-bfaf9b226118, lookup_type: ById(8aed7aa9-b517-4399-811c-bfaf9b226118) }, key: 74670848-5d44-4852-bc5d-e46c97b1e097, lookup_type: ById(74670848-5d44-4852-bc5d-e46c97b1e097) } result = Ok(()) uri = /v1/disks/disk-3d3717ae006?project=proj-9c0961bf572
39492024-12-14T03:35:44.835ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = 1e96253d-ab0a-405e-9d9e-175890ec20e6 saga_name = disk-delete
39502024-12-14T03:35:44.835ZINFOnexus (SEC): saga create dag = {"end_node":14,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[2,3,null],[4,5,null],[4,6,null],[6,7,null],[5,7,null],[7,8,null],[8,9,null],[9,10,null],[10,11,null],[3,4,null],[11,12,null],[13,0,null],[12,14,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"disk_delete.delete_disk_record","label":"DeleteDiskRecord","name":"deleted_disk"}},{"Action":{"action_name":"disk_delete.space_account","label":"SpaceAccount","name":"no_result1"}},{"Constant":{"name":"params_for_volume_delete_subsaga","value":{"serialized_authn":{"kind":{"Authenticated":[{"actor":{"SiloUser":{"silo_id":"578bc52c-ac81-41a6-a56b-dfc79805368e","silo_user_id":"6d1b4298-6f48-4e38-b4c6-02b2175d87a2"}}},{"mapped_fleet_roles":{"admin":["admin"]}}]}},"volume_id":"3aead670-8c03-462f-add7-e5e70903aeeb"}}},{"SubsagaStart":{"params_node_name":"params_for_volume_delete_subsaga","saga_name":"volume-delete"}},{"Action":{"action_name":"volume_delete.decrease_crucible_resource_count","label":"DecreaseCrucibleResourceCount","name":"crucible_resources_to_delete"}},{"Action":{"action_name":"volume_delete.delete_crucible_regions","label":"DeleteCrucibleRegions","name":"no_result_1"}},{"Action":{"action_name":"volume_delete.delete_crucible_running_snapshots","label":"DeleteCrucibleRunningSnapshots","name":"no_result_2"}},{"Action":{"action_name":"volume_delete.delete_crucible_snapshots","label":"DeleteCrucibleSnapshots","name":"no_result_3"}},{"Action":{"action_name":"volume_delete.delete_crucible_snapshot_records","label":"DeleteCrucibleSnapshotRecords","name":"no_result_4"}},{"Action":{"action_name":"volume_delete.find_freed_crucible_regions","label":"FindFreedCrucibleRegions","name":"freed_crucible_regions"}},{"Action":{"action_name":"volume_delete.delete_freed_crucible_regions","label":"DeleteFreedCrucibleRegions","name":"no_result_5"}},{"Action":{"action_name":"volume_delete.hard_delete_volume_record","label":"HardDeleteVolumeRecord","name":"volume_hard_deleted"}},{"SubsagaEnd":{"name":"volume_delete_subsaga_no_result"}},{"Start":{"params":{"disk_id":"74670848-5d44-4852-bc5d-e46c97b1e097","project_id":"8aed7aa9-b517-4399-811c-bfaf9b226118","serialized_authn":{"kind":{"Authenticated":[{"actor":{"SiloUser":{"silo_id":"578bc52c-ac81-41a6-a56b-dfc79805368e","silo_user_id":"6d1b4298-6f48-4e38-b4c6-02b2175d87a2"}}},{"mapped_fleet_roles":{"admin":["admin"]}}]}},"volume_id":"3aead670-8c03-462f-add7-e5e70903aeeb"}}},"End"]},"saga_name":"disk-delete","start_node":13} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = 1e96253d-ab0a-405e-9d9e-175890ec20e6 saga_name = disk-delete sec_id = 5f2fe413-3c4a-4994-b4a0-995c1da486b1
39512024-12-14T03:35:44.835ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = 1e96253d-ab0a-405e-9d9e-175890ec20e6 saga_name = disk-delete
39522024-12-14T03:35:44.839ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = 1e96253d-ab0a-405e-9d9e-175890ec20e6 saga_name = disk-delete
39532024-12-14T03:35:44.839ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = 1e96253d-ab0a-405e-9d9e-175890ec20e6 saga_name = disk-delete sec_id = 5f2fe413-3c4a-4994-b4a0-995c1da486b1
39542024-12-14T03:35:44.839ZDEBGnexus (SEC): saga log event new_state = N013 started sec_id = 5f2fe413-3c4a-4994-b4a0-995c1da486b1
39552024-12-14T03:35:44.839ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 13 saga_id = 1e96253d-ab0a-405e-9d9e-175890ec20e6
39562024-12-14T03:35:44.843ZDEBGnexus (SEC): saga log event new_state = N013 succeeded sec_id = 5f2fe413-3c4a-4994-b4a0-995c1da486b1
39572024-12-14T03:35:44.843ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 13 saga_id = 1e96253d-ab0a-405e-9d9e-175890ec20e6
39582024-12-14T03:35:44.846ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 5f2fe413-3c4a-4994-b4a0-995c1da486b1
39592024-12-14T03:35:44.846ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = 1e96253d-ab0a-405e-9d9e-175890ec20e6
39602024-12-14T03:35:44.857ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 5f2fe413-3c4a-4994-b4a0-995c1da486b1
39612024-12-14T03:35:44.857ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"block_size": String("Traditional"), "create_image_id": Null, "create_snapshot_id": Null, "identity": Object {"description": String(""), "id": String("74670848-5d44-4852-bc5d-e46c97b1e097"), "name": String("disk-3d3717ae006"), "time_created": String("2024-12-14T03:35:43.874294Z"), "time_deleted": Null, "time_modified": String("2024-12-14T03:35:43.874294Z")}, "pantry_address": Null, "project_id": String("8aed7aa9-b517-4399-811c-bfaf9b226118"), "rcgen": Number(1), "runtime_state": Object {"attach_instance_id": Null, "disk_state": String("detached"), "gen": Number(2), "time_updated": String("2024-12-14T03:35:44.702365Z")}, "size": Number(1073741824), "slot": Null, "volume_id": String("3aead670-8c03-462f-add7-e5e70903aeeb")}) node_id = 0 saga_id = 1e96253d-ab0a-405e-9d9e-175890ec20e6
39622024-12-14T03:35:44.861ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 5f2fe413-3c4a-4994-b4a0-995c1da486b1
39632024-12-14T03:35:44.861ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = 1e96253d-ab0a-405e-9d9e-175890ec20e6
39642024-12-14T03:35:44.864ZDEBGnexus (SagaExecutor): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true roles = RoleSet { roles: {} } saga_id = 1e96253d-ab0a-405e-9d9e-175890ec20e6 saga_name = disk-delete saga_node = SpaceAccount
39652024-12-14T03:35:44.864ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true resource = Database result = Ok(()) saga_id = 1e96253d-ab0a-405e-9d9e-175890ec20e6 saga_name = disk-delete saga_node = SpaceAccount
39662024-12-14T03:35:44.879ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 5f2fe413-3c4a-4994-b4a0-995c1da486b1
39672024-12-14T03:35:44.879ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 1 saga_id = 1e96253d-ab0a-405e-9d9e-175890ec20e6
39682024-12-14T03:35:44.883ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 5f2fe413-3c4a-4994-b4a0-995c1da486b1
39692024-12-14T03:35:44.883ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = 1e96253d-ab0a-405e-9d9e-175890ec20e6
39702024-12-14T03:35:44.886ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 5f2fe413-3c4a-4994-b4a0-995c1da486b1
39712024-12-14T03:35:44.886ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"SiloUser": Object {"silo_id": String("578bc52c-ac81-41a6-a56b-dfc79805368e"), "silo_user_id": String("6d1b4298-6f48-4e38-b4c6-02b2175d87a2")}}}, Object {"mapped_fleet_roles": Object {"admin": Array [String("admin")]}}]}}, "volume_id": String("3aead670-8c03-462f-add7-e5e70903aeeb")}) node_id = 2 saga_id = 1e96253d-ab0a-405e-9d9e-175890ec20e6
39722024-12-14T03:35:44.889ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 5f2fe413-3c4a-4994-b4a0-995c1da486b1
39732024-12-14T03:35:44.889ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = 1e96253d-ab0a-405e-9d9e-175890ec20e6
39742024-12-14T03:35:44.893ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 5f2fe413-3c4a-4994-b4a0-995c1da486b1
39752024-12-14T03:35:44.893ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = 1e96253d-ab0a-405e-9d9e-175890ec20e6
39762024-12-14T03:35:44.895ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 5f2fe413-3c4a-4994-b4a0-995c1da486b1
39772024-12-14T03:35:44.896ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = 1e96253d-ab0a-405e-9d9e-175890ec20e6
39782024-12-14T03:35:44.912ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 5f2fe413-3c4a-4994-b4a0-995c1da486b1
39792024-12-14T03:35:44.912ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"V3": Object {"region_snapshots": Array [], "regions": Array [String("3ead8cd7-6fa7-4bbf-9f9e-9dca40f92855"), String("4db54528-ce0b-448e-b664-cc8ddd73d51a"), String("991790da-bac9-4a32-b6f4-0fb9e22fea3d")]}}) node_id = 4 saga_id = 1e96253d-ab0a-405e-9d9e-175890ec20e6
39802024-12-14T03:35:44.916ZDEBGnexus (SEC): saga log event new_state = N005 started sec_id = 5f2fe413-3c4a-4994-b4a0-995c1da486b1
39812024-12-14T03:35:44.916ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 5 saga_id = 1e96253d-ab0a-405e-9d9e-175890ec20e6
39822024-12-14T03:35:44.919ZDEBGnexus (SEC): saga log event new_state = N006 started sec_id = 5f2fe413-3c4a-4994-b4a0-995c1da486b1
39832024-12-14T03:35:44.919ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 6 saga_id = 1e96253d-ab0a-405e-9d9e-175890ec20e6
39842024-12-14T03:35:44.924ZDEBGnexus (SEC): saga log event new_state = N006 succeeded sec_id = 5f2fe413-3c4a-4994-b4a0-995c1da486b1
39852024-12-14T03:35:44.924ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 6 saga_id = 1e96253d-ab0a-405e-9d9e-175890ec20e6
39862024-12-14T03:35:44.955ZINFOnexus (SagaExecutor): Transient(region not deleted yet), trying again in 129.848667ms file = nexus/src/app/crucible.rs:828 region_id = 4db54528-ce0b-448e-b664-cc8ddd73d51a saga_id = 1e96253d-ab0a-405e-9d9e-175890ec20e6 saga_name = disk-delete
39872024-12-14T03:35:44.955ZINFOnexus (SagaExecutor): Transient(region not deleted yet), trying again in 138.037209ms file = nexus/src/app/crucible.rs:828 region_id = 3ead8cd7-6fa7-4bbf-9f9e-9dca40f92855 saga_id = 1e96253d-ab0a-405e-9d9e-175890ec20e6 saga_name = disk-delete
39882024-12-14T03:35:44.958ZINFOnexus (SagaExecutor): Transient(region not deleted yet), trying again in 71.744367ms file = nexus/src/app/crucible.rs:828 region_id = 991790da-bac9-4a32-b6f4-0fb9e22fea3d saga_id = 1e96253d-ab0a-405e-9d9e-175890ec20e6 saga_name = disk-delete
39892024-12-14T03:35:45.036ZINFOnexus (SagaExecutor): region deleted file = nexus/src/app/crucible.rs:813 region_id = 991790da-bac9-4a32-b6f4-0fb9e22fea3d saga_id = 1e96253d-ab0a-405e-9d9e-175890ec20e6 saga_name = disk-delete
39902024-12-14T03:35:45.090ZINFOnexus (SagaExecutor): region deleted file = nexus/src/app/crucible.rs:813 region_id = 4db54528-ce0b-448e-b664-cc8ddd73d51a saga_id = 1e96253d-ab0a-405e-9d9e-175890ec20e6 saga_name = disk-delete
39912024-12-14T03:35:45.098ZINFOnexus (SagaExecutor): region deleted file = nexus/src/app/crucible.rs:813 region_id = 3ead8cd7-6fa7-4bbf-9f9e-9dca40f92855 saga_id = 1e96253d-ab0a-405e-9d9e-175890ec20e6 saga_name = disk-delete
39922024-12-14T03:35:45.121ZDEBGnexus (SEC): saga log event new_state = N005 succeeded sec_id = 5f2fe413-3c4a-4994-b4a0-995c1da486b1
39932024-12-14T03:35:45.121ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 5 saga_id = 1e96253d-ab0a-405e-9d9e-175890ec20e6
39942024-12-14T03:35:45.126ZDEBGnexus (SEC): saga log event new_state = N007 started sec_id = 5f2fe413-3c4a-4994-b4a0-995c1da486b1
39952024-12-14T03:35:45.126ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 7 saga_id = 1e96253d-ab0a-405e-9d9e-175890ec20e6
39962024-12-14T03:35:45.132ZDEBGnexus (SEC): saga log event new_state = N007 succeeded sec_id = 5f2fe413-3c4a-4994-b4a0-995c1da486b1
39972024-12-14T03:35:45.132ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 7 saga_id = 1e96253d-ab0a-405e-9d9e-175890ec20e6
39982024-12-14T03:35:45.138ZDEBGnexus (SEC): saga log event new_state = N008 started sec_id = 5f2fe413-3c4a-4994-b4a0-995c1da486b1
39992024-12-14T03:35:45.138ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 8 saga_id = 1e96253d-ab0a-405e-9d9e-175890ec20e6
40002024-12-14T03:35:45.147ZDEBGnexus (SEC): saga log event new_state = N008 succeeded sec_id = 5f2fe413-3c4a-4994-b4a0-995c1da486b1
40012024-12-14T03:35:45.147ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 8 saga_id = 1e96253d-ab0a-405e-9d9e-175890ec20e6
40022024-12-14T03:35:45.151ZDEBGnexus (SEC): saga log event new_state = N009 started sec_id = 5f2fe413-3c4a-4994-b4a0-995c1da486b1
40032024-12-14T03:35:45.151ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 9 saga_id = 1e96253d-ab0a-405e-9d9e-175890ec20e6
40042024-12-14T03:35:45.169ZDEBGnexus (SEC): saga log event new_state = N009 succeeded sec_id = 5f2fe413-3c4a-4994-b4a0-995c1da486b1
40052024-12-14T03:35:45.169ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Array []) node_id = 9 saga_id = 1e96253d-ab0a-405e-9d9e-175890ec20e6
40062024-12-14T03:35:45.173ZDEBGnexus (SEC): saga log event new_state = N010 started sec_id = 5f2fe413-3c4a-4994-b4a0-995c1da486b1
40072024-12-14T03:35:45.173ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 10 saga_id = 1e96253d-ab0a-405e-9d9e-175890ec20e6
40082024-12-14T03:35:45.177ZDEBGnexus (SEC): saga log event new_state = N010 succeeded sec_id = 5f2fe413-3c4a-4994-b4a0-995c1da486b1
40092024-12-14T03:35:45.177ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 10 saga_id = 1e96253d-ab0a-405e-9d9e-175890ec20e6
40102024-12-14T03:35:45.181ZDEBGnexus (SEC): saga log event new_state = N011 started sec_id = 5f2fe413-3c4a-4994-b4a0-995c1da486b1
40112024-12-14T03:35:45.181ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 11 saga_id = 1e96253d-ab0a-405e-9d9e-175890ec20e6
40122024-12-14T03:35:45.188ZINFOnexus (SagaExecutor): allocated regions for 3aead670-8c03-462f-add7-e5e70903aeeb is empty, calling volume_hard_delete file = nexus/src/app/sagas/volume_delete.rs:531 saga_id = 1e96253d-ab0a-405e-9d9e-175890ec20e6 saga_name = disk-delete
40132024-12-14T03:35:45.193ZDEBGnexus (SEC): saga log event new_state = N011 succeeded sec_id = 5f2fe413-3c4a-4994-b4a0-995c1da486b1
40142024-12-14T03:35:45.193ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Bool(true)) node_id = 11 saga_id = 1e96253d-ab0a-405e-9d9e-175890ec20e6
40152024-12-14T03:35:45.197ZDEBGnexus (SEC): saga log event new_state = N012 started sec_id = 5f2fe413-3c4a-4994-b4a0-995c1da486b1
40162024-12-14T03:35:45.197ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 12 saga_id = 1e96253d-ab0a-405e-9d9e-175890ec20e6
40172024-12-14T03:35:45.201ZDEBGnexus (SEC): saga log event new_state = N012 succeeded sec_id = 5f2fe413-3c4a-4994-b4a0-995c1da486b1
40182024-12-14T03:35:45.201ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Bool(true)) node_id = 12 saga_id = 1e96253d-ab0a-405e-9d9e-175890ec20e6
40192024-12-14T03:35:45.205ZDEBGnexus (SEC): saga log event new_state = N014 started sec_id = 5f2fe413-3c4a-4994-b4a0-995c1da486b1
40202024-12-14T03:35:45.205ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 14 saga_id = 1e96253d-ab0a-405e-9d9e-175890ec20e6
40212024-12-14T03:35:45.208ZDEBGnexus (SEC): saga log event new_state = N014 succeeded sec_id = 5f2fe413-3c4a-4994-b4a0-995c1da486b1
40222024-12-14T03:35:45.208ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 14 saga_id = 1e96253d-ab0a-405e-9d9e-175890ec20e6
40232024-12-14T03:35:45.212ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = 1e96253d-ab0a-405e-9d9e-175890ec20e6 sec_id = 5f2fe413-3c4a-4994-b4a0-995c1da486b1
40242024-12-14T03:35:45.212ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = 1e96253d-ab0a-405e-9d9e-175890ec20e6
40252024-12-14T03:35:45.219ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = 1e96253d-ab0a-405e-9d9e-175890ec20e6 saga_name = disk-delete sec_id = 5f2fe413-3c4a-4994-b4a0-995c1da486b1
40262024-12-14T03:35:45.219ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = 1e96253d-ab0a-405e-9d9e-175890ec20e6 saga_name = disk-delete saga_result = SagaResult { saga_id: 1e96253d-ab0a-405e-9d9e-175890ec20e6, saga_log: SagaLog { saga_id: 1e96253d-ab0a-405e-9d9e-175890ec20e6, unwinding: false, events: [N013 started, N013 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N003 started, N003 succeeded, N004 started, N004 succeeded, N005 started, N006 started, N006 succeeded, N005 succeeded, N007 started, N007 succeeded, N008 started, N008 succeeded, N009 started, N009 succeeded, N010 started, N010 succeeded, N011 started, N011 succeeded, N012 started, N012 succeeded, N014 started, N014 succeeded], node_status: {0: Succeeded(Object {"block_size": String("Traditional"), "create_image_id": Null, "create_snapshot_id": Null, "identity": Object {"description": String(""), "id": String("74670848-5d44-4852-bc5d-e46c97b1e097"), "name": String("disk-3d3717ae006"), "time_created": String("2024-12-14T03:35:43.874294Z"), "time_deleted": Null, "time_modified": String("2024-12-14T03:35:43.874294Z")}, "pantry_address": Null, "project_id": String("8aed7aa9-b517-4399-811c-bfaf9b226118"), "rcgen": Number(1), "runtime_state": Object {"attach_instance_id": Null, "disk_state": String("detached"), "gen": Number(2), "time_updated": String("2024-12-14T03:35:44.702365Z")}, "size": Number(1073741824), "slot": Null, "volume_id": String("3aead670-8c03-462f-add7-e5e70903aeeb")}), 1: Succeeded(Null), 2: Succeeded(Object {"serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"SiloUser": Object {"silo_id": String("578bc52c-ac81-41a6-a56b-dfc79805368e"), "silo_user_id": String("6d1b4298-6f48-4e38-b4c6-02b2175d87a2")}}}, Object {"mapped_fleet_roles": Object {"admin": Array [String("admin")]}}]}}, "volume_id": String("3aead670-8c03-462f-add7-e5e70903aeeb")}), 3: Succeeded(Null), 4: Succeeded(Object {"V3": Object {"region_snapshots": Array [], "regions": Array [String("3ead8cd7-6fa7-4bbf-9f9e-9dca40f92855"), String("4db54528-ce0b-448e-b664-cc8ddd73d51a"), String("991790da-bac9-4a32-b6f4-0fb9e22fea3d")]}}), 5: Succeeded(Null), 6: Succeeded(Null), 7: Succeeded(Null), 8: Succeeded(Null), 9: Succeeded(Array []), 10: Succeeded(Null), 11: Succeeded(Bool(true)), 12: Succeeded(Bool(true)), 13: Succeeded(Null), 14: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Bool(true), node_outputs: {"crucible_resources_to_delete": Object {"V3": Object {"region_snapshots": Array [], "regions": Array [String("3ead8cd7-6fa7-4bbf-9f9e-9dca40f92855"), String("4db54528-ce0b-448e-b664-cc8ddd73d51a"), String("991790da-bac9-4a32-b6f4-0fb9e22fea3d")]}}, "deleted_disk": Object {"block_size": String("Traditional"), "create_image_id": Null, "create_snapshot_id": Null, "identity": Object {"description": String(""), "id": String("74670848-5d44-4852-bc5d-e46c97b1e097"), "name": String("disk-3d3717ae006"), "time_created": String("2024-12-14T03:35:43.874294Z"), "time_deleted": Null, "time_modified": String("2024-12-14T03:35:43.874294Z")}, "pantry_address": Null, "project_id": String("8aed7aa9-b517-4399-811c-bfaf9b226118"), "rcgen": Number(1), "runtime_state": Object {"attach_instance_id": Null, "disk_state": String("detached"), "gen": Number(2), "time_updated": String("2024-12-14T03:35:44.702365Z")}, "size": Number(1073741824), "slot": Null, "volume_id": String("3aead670-8c03-462f-add7-e5e70903aeeb")}, "freed_crucible_regions": Array [], "no_result1": Null, "no_result_1": Null, "no_result_2": Null, "no_result_3": Null, "no_result_4": Null, "no_result_5": Null, "params_for_volume_delete_subsaga": Object {"serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"SiloUser": Object {"silo_id": String("578bc52c-ac81-41a6-a56b-dfc79805368e"), "silo_user_id": String("6d1b4298-6f48-4e38-b4c6-02b2175d87a2")}}}, Object {"mapped_fleet_roles": Object {"admin": Array [String("admin")]}}]}}, "volume_id": String("3aead670-8c03-462f-add7-e5e70903aeeb")}, "volume_delete_subsaga_no_result": Bool(true), "volume_hard_deleted": Bool(true)} }) }
40272024-12-14T03:35:45.219ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 448792 local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:34803 req_id = 7ded3810-a695-4788-9210-1228ead5c1df response_code = 204 uri = /v1/disks/disk-3d3717ae006?project=proj-9c0961bf572
40282024-12-14T03:35:45.221ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
40292024-12-14T03:35:45.221ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
40302024-12-14T03:35:45.223ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
40312024-12-14T03:35:45.225ZDEBGnexus (ExternalAuthn): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = DeviceAuthRequestList result = Ok(())
40322024-12-14T03:35:45.225ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
40332024-12-14T03:35:45.225ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
40342024-12-14T03:35:45.234ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 14276 local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:34803 req_id = 2e4f5045-e7c0-4226-8c5d-1a8512eb552e response_code = 200 uri = /device/auth
40352024-12-14T03:35:45.235ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
40362024-12-14T03:35:45.236ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
40372024-12-14T03:35:45.237ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
40382024-12-14T03:35:45.237ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
40392024-12-14T03:35:45.238ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
40402024-12-14T03:35:45.239ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "db95a822bf0fd07240bed3e48d369a3d91a78b45", lookup_type: ByCompositeId("token = \\"db95a822bf0fd07240bed3e48d369a3d91a78b45\\"") } result = Ok(())
40412024-12-14T03:35:45.239ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
40422024-12-14T03:35:45.239ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
40432024-12-14T03:35:45.241ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
40442024-12-14T03:35:45.241ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
40452024-12-14T03:35:45.242ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
40462024-12-14T03:35:45.242ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
40472024-12-14T03:35:45.244ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
40482024-12-14T03:35:45.244ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
40492024-12-14T03:35:45.245ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
40502024-12-14T03:35:45.246ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 578bc52c-ac81-41a6-a56b-dfc79805368e, lookup_type: ById(578bc52c-ac81-41a6-a56b-dfc79805368e) }, key: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, lookup_type: ById(6d1b4298-6f48-4e38-b4c6-02b2175d87a2) } result = Ok(())
40512024-12-14T03:35:45.246ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
40522024-12-14T03:35:45.247ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
40532024-12-14T03:35:45.248ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
40542024-12-14T03:35:45.249ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "db95a822bf0fd07240bed3e48d369a3d91a78b45", lookup_type: ByCompositeId("db95a822bf0fd07240bed3e48d369a3d91a78b45") } result = Ok(())
40552024-12-14T03:35:45.249ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
40562024-12-14T03:35:45.249ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
40572024-12-14T03:35:45.253ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
40582024-12-14T03:35:45.253ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
40592024-12-14T03:35:45.254ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
40602024-12-14T03:35:45.254ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
40612024-12-14T03:35:45.256ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
40622024-12-14T03:35:45.256ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
40632024-12-14T03:35:45.257ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
40642024-12-14T03:35:45.257ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
40652024-12-14T03:35:45.258ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
40662024-12-14T03:35:45.260ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 578bc52c-ac81-41a6-a56b-dfc79805368e, lookup_type: ById(578bc52c-ac81-41a6-a56b-dfc79805368e) }, key: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, lookup_type: ById(6d1b4298-6f48-4e38-b4c6-02b2175d87a2) } result = Ok(())
40672024-12-14T03:35:45.260ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
40682024-12-14T03:35:45.260ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
40692024-12-14T03:35:45.261ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
40702024-12-14T03:35:45.261ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
40712024-12-14T03:35:45.262ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
40722024-12-14T03:35:45.262ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
40732024-12-14T03:35:45.263ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
40742024-12-14T03:35:45.264ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 578bc52c-ac81-41a6-a56b-dfc79805368e, lookup_type: ById(578bc52c-ac81-41a6-a56b-dfc79805368e) } result = Ok(())
40752024-12-14T03:35:45.264ZDEBGnexus (dropshot_external): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:34803 req_id = 3dfb9114-0595-4e32-befa-3c1b0c036351 roles = RoleSet { roles: {} } uri = /device/confirm
40762024-12-14T03:35:45.265ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:34803 req_id = 3dfb9114-0595-4e32-befa-3c1b0c036351 resource = Database result = Ok(()) uri = /device/confirm
40772024-12-14T03:35:45.272ZDEBGnexus (dropshot_external): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:34803 req_id = 3dfb9114-0595-4e32-befa-3c1b0c036351 roles = RoleSet { roles: {} } uri = /device/confirm
40782024-12-14T03:35:45.272ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:34803 req_id = 3dfb9114-0595-4e32-befa-3c1b0c036351 resource = Database result = Ok(()) uri = /device/confirm
40792024-12-14T03:35:45.275ZDEBGnexus (dropshot_external): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:34803 req_id = 3dfb9114-0595-4e32-befa-3c1b0c036351 roles = RoleSet { roles: {} } uri = /device/confirm
40802024-12-14T03:35:45.275ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:34803 req_id = 3dfb9114-0595-4e32-befa-3c1b0c036351 resource = Database result = Ok(()) uri = /device/confirm
40812024-12-14T03:35:45.277ZDEBGnexus (dropshot_external): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:34803 req_id = 3dfb9114-0595-4e32-befa-3c1b0c036351 roles = RoleSet { roles: {(Silo, 578bc52c-ac81-41a6-a56b-dfc79805368e, "admin")} } uri = /device/confirm
40822024-12-14T03:35:45.278ZDEBGnexus (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:34803 req_id = 3dfb9114-0595-4e32-befa-3c1b0c036351 resource = DeviceAuthRequest { parent: Fleet, key: "XKLL-FXQS", lookup_type: ByCompositeId("user_code = \\"XKLL-FXQS\\"") } result = Ok(()) uri = /device/confirm
40832024-12-14T03:35:45.278ZDEBGnexus (dropshot_external): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:34803 req_id = 3dfb9114-0595-4e32-befa-3c1b0c036351 roles = RoleSet { roles: {} } uri = /device/confirm
40842024-12-14T03:35:45.278ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:34803 req_id = 3dfb9114-0595-4e32-befa-3c1b0c036351 resource = Database result = Ok(()) uri = /device/confirm
40852024-12-14T03:35:45.279ZDEBGnexus (dropshot_external): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:34803 req_id = 3dfb9114-0595-4e32-befa-3c1b0c036351 roles = RoleSet { roles: {} } uri = /device/confirm
40862024-12-14T03:35:45.279ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:34803 req_id = 3dfb9114-0595-4e32-befa-3c1b0c036351 resource = Database result = Ok(()) uri = /device/confirm
40872024-12-14T03:35:45.281ZDEBGnexus (dropshot_external): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:34803 req_id = 3dfb9114-0595-4e32-befa-3c1b0c036351 roles = RoleSet { roles: {} } uri = /device/confirm
40882024-12-14T03:35:45.281ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:34803 req_id = 3dfb9114-0595-4e32-befa-3c1b0c036351 resource = Database result = Ok(()) uri = /device/confirm
40892024-12-14T03:35:45.283ZDEBGnexus (dropshot_external): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:34803 req_id = 3dfb9114-0595-4e32-befa-3c1b0c036351 roles = RoleSet { roles: {} } uri = /device/confirm
40902024-12-14T03:35:45.283ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:34803 req_id = 3dfb9114-0595-4e32-befa-3c1b0c036351 resource = Database result = Ok(()) uri = /device/confirm
40912024-12-14T03:35:45.285ZDEBGnexus (dropshot_external): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:34803 req_id = 3dfb9114-0595-4e32-befa-3c1b0c036351 roles = RoleSet { roles: {} } uri = /device/confirm
40922024-12-14T03:35:45.285ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:34803 req_id = 3dfb9114-0595-4e32-befa-3c1b0c036351 resource = Database result = Ok(()) uri = /device/confirm
40932024-12-14T03:35:45.287ZDEBGnexus (dropshot_external): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:34803 req_id = 3dfb9114-0595-4e32-befa-3c1b0c036351 roles = RoleSet { roles: {(Silo, 578bc52c-ac81-41a6-a56b-dfc79805368e, "admin")} } uri = /device/confirm
40942024-12-14T03:35:45.288ZDEBGnexus (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:34803 req_id = 3dfb9114-0595-4e32-befa-3c1b0c036351 resource = SiloUser { parent: Silo { parent: Fleet, key: 578bc52c-ac81-41a6-a56b-dfc79805368e, lookup_type: ById(578bc52c-ac81-41a6-a56b-dfc79805368e) }, key: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, lookup_type: ById(6d1b4298-6f48-4e38-b4c6-02b2175d87a2) } result = Ok(()) uri = /device/confirm
40952024-12-14T03:35:45.288ZDEBGnexus (dropshot_external): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:34803 req_id = 3dfb9114-0595-4e32-befa-3c1b0c036351 roles = RoleSet { roles: {} } uri = /device/confirm
40962024-12-14T03:35:45.288ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:34803 req_id = 3dfb9114-0595-4e32-befa-3c1b0c036351 resource = Database result = Ok(()) uri = /device/confirm
40972024-12-14T03:35:45.291ZDEBGnexus (dropshot_external): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:34803 req_id = 3dfb9114-0595-4e32-befa-3c1b0c036351 roles = RoleSet { roles: {} } uri = /device/confirm
40982024-12-14T03:35:45.291ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:34803 req_id = 3dfb9114-0595-4e32-befa-3c1b0c036351 resource = Database result = Ok(()) uri = /device/confirm
40992024-12-14T03:35:45.293ZDEBGnexus (dropshot_external): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:34803 req_id = 3dfb9114-0595-4e32-befa-3c1b0c036351 roles = RoleSet { roles: {(Silo, 578bc52c-ac81-41a6-a56b-dfc79805368e, "admin")} } uri = /device/confirm
41002024-12-14T03:35:45.293ZDEBGnexus (dropshot_external): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:34803 req_id = 3dfb9114-0595-4e32-befa-3c1b0c036351 resource = DeviceAuthRequest { parent: Fleet, key: "XKLL-FXQS", lookup_type: ByCompositeId("user_code = \\"XKLL-FXQS\\"") } result = Ok(()) uri = /device/confirm
41012024-12-14T03:35:45.293ZDEBGnexus (dropshot_external): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:34803 req_id = 3dfb9114-0595-4e32-befa-3c1b0c036351 roles = RoleSet { roles: {} } uri = /device/confirm
41022024-12-14T03:35:45.294ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:34803 req_id = 3dfb9114-0595-4e32-befa-3c1b0c036351 resource = Database result = Ok(()) uri = /device/confirm
41032024-12-14T03:35:45.296ZDEBGnexus (dropshot_external): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:34803 req_id = 3dfb9114-0595-4e32-befa-3c1b0c036351 roles = RoleSet { roles: {} } uri = /device/confirm
41042024-12-14T03:35:45.296ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:34803 req_id = 3dfb9114-0595-4e32-befa-3c1b0c036351 resource = Database result = Ok(()) uri = /device/confirm
41052024-12-14T03:35:45.298ZDEBGnexus (dropshot_external): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:34803 req_id = 3dfb9114-0595-4e32-befa-3c1b0c036351 roles = RoleSet { roles: {} } uri = /device/confirm
41062024-12-14T03:35:45.298ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:34803 req_id = 3dfb9114-0595-4e32-befa-3c1b0c036351 resource = Database result = Ok(()) uri = /device/confirm
41072024-12-14T03:35:45.300ZDEBGnexus (dropshot_external): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:34803 req_id = 3dfb9114-0595-4e32-befa-3c1b0c036351 roles = RoleSet { roles: {(Silo, 578bc52c-ac81-41a6-a56b-dfc79805368e, "admin")} } uri = /device/confirm
41082024-12-14T03:35:45.301ZDEBGnexus (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:34803 req_id = 3dfb9114-0595-4e32-befa-3c1b0c036351 resource = SiloUser { parent: Silo { parent: Fleet, key: 578bc52c-ac81-41a6-a56b-dfc79805368e, lookup_type: ById(578bc52c-ac81-41a6-a56b-dfc79805368e) }, key: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, lookup_type: ById(6d1b4298-6f48-4e38-b4c6-02b2175d87a2) } result = Ok(()) uri = /device/confirm
41092024-12-14T03:35:45.301ZDEBGnexus (dropshot_external): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:34803 req_id = 3dfb9114-0595-4e32-befa-3c1b0c036351 roles = RoleSet { roles: {} } uri = /device/confirm
41102024-12-14T03:35:45.301ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:34803 req_id = 3dfb9114-0595-4e32-befa-3c1b0c036351 resource = Database result = Ok(()) uri = /device/confirm
41112024-12-14T03:35:45.333ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98071 local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:34803 req_id = 3dfb9114-0595-4e32-befa-3c1b0c036351 response_code = 204 uri = /device/confirm
41122024-12-14T03:35:45.335ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
41132024-12-14T03:35:45.335ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
41142024-12-14T03:35:45.346ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 11726 local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:34803 req_id = dc83d197-26e1-408f-9271-3bdb0ca33ab8 response_code = 200 uri = /device/token
41152024-12-14T03:35:45.349ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
41162024-12-14T03:35:45.349ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
41172024-12-14T03:35:45.350ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
41182024-12-14T03:35:45.350ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
41192024-12-14T03:35:45.351ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
41202024-12-14T03:35:45.353ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "db95a822bf0fd07240bed3e48d369a3d91a78b45", lookup_type: ByCompositeId("token = \\"db95a822bf0fd07240bed3e48d369a3d91a78b45\\"") } result = Ok(())
41212024-12-14T03:35:45.353ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
41222024-12-14T03:35:45.353ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
41232024-12-14T03:35:45.354ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
41242024-12-14T03:35:45.355ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
41252024-12-14T03:35:45.356ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
41262024-12-14T03:35:45.356ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
41272024-12-14T03:35:45.357ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
41282024-12-14T03:35:45.358ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
41292024-12-14T03:35:45.359ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
41302024-12-14T03:35:45.360ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 578bc52c-ac81-41a6-a56b-dfc79805368e, lookup_type: ById(578bc52c-ac81-41a6-a56b-dfc79805368e) }, key: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, lookup_type: ById(6d1b4298-6f48-4e38-b4c6-02b2175d87a2) } result = Ok(())
41312024-12-14T03:35:45.360ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
41322024-12-14T03:35:45.361ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
41332024-12-14T03:35:45.362ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
41342024-12-14T03:35:45.363ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "db95a822bf0fd07240bed3e48d369a3d91a78b45", lookup_type: ByCompositeId("db95a822bf0fd07240bed3e48d369a3d91a78b45") } result = Ok(())
41352024-12-14T03:35:45.363ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
41362024-12-14T03:35:45.363ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
41372024-12-14T03:35:45.368ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
41382024-12-14T03:35:45.368ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
41392024-12-14T03:35:45.369ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
41402024-12-14T03:35:45.369ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
41412024-12-14T03:35:45.371ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
41422024-12-14T03:35:45.371ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
41432024-12-14T03:35:45.372ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
41442024-12-14T03:35:45.372ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
41452024-12-14T03:35:45.374ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
41462024-12-14T03:35:45.375ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 578bc52c-ac81-41a6-a56b-dfc79805368e, lookup_type: ById(578bc52c-ac81-41a6-a56b-dfc79805368e) }, key: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, lookup_type: ById(6d1b4298-6f48-4e38-b4c6-02b2175d87a2) } result = Ok(())
41472024-12-14T03:35:45.375ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
41482024-12-14T03:35:45.375ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
41492024-12-14T03:35:45.376ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
41502024-12-14T03:35:45.376ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
41512024-12-14T03:35:45.377ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
41522024-12-14T03:35:45.378ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
41532024-12-14T03:35:45.378ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
41542024-12-14T03:35:45.380ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 578bc52c-ac81-41a6-a56b-dfc79805368e, lookup_type: ById(578bc52c-ac81-41a6-a56b-dfc79805368e) } result = Ok(())
41552024-12-14T03:35:45.380ZDEBGnexus (dropshot_external): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:34803 req_id = 13a9390d-78f6-492a-8e8e-69f1284aeb2d roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-9c0961bf572&vpc=default
41562024-12-14T03:35:45.380ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:34803 req_id = 13a9390d-78f6-492a-8e8e-69f1284aeb2d resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-9c0961bf572&vpc=default
41572024-12-14T03:35:45.381ZDEBGnexus (dropshot_external): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:34803 req_id = 13a9390d-78f6-492a-8e8e-69f1284aeb2d roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-9c0961bf572&vpc=default
41582024-12-14T03:35:45.381ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:34803 req_id = 13a9390d-78f6-492a-8e8e-69f1284aeb2d resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-9c0961bf572&vpc=default
41592024-12-14T03:35:45.383ZDEBGnexus (dropshot_external): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:34803 req_id = 13a9390d-78f6-492a-8e8e-69f1284aeb2d roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-9c0961bf572&vpc=default
41602024-12-14T03:35:45.384ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:34803 req_id = 13a9390d-78f6-492a-8e8e-69f1284aeb2d resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-9c0961bf572&vpc=default
41612024-12-14T03:35:45.385ZDEBGnexus (dropshot_external): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:34803 req_id = 13a9390d-78f6-492a-8e8e-69f1284aeb2d roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-9c0961bf572&vpc=default
41622024-12-14T03:35:45.385ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:34803 req_id = 13a9390d-78f6-492a-8e8e-69f1284aeb2d resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-9c0961bf572&vpc=default
41632024-12-14T03:35:45.387ZDEBGnexus (dropshot_external): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:34803 req_id = 13a9390d-78f6-492a-8e8e-69f1284aeb2d roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-9c0961bf572&vpc=default
41642024-12-14T03:35:45.387ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:34803 req_id = 13a9390d-78f6-492a-8e8e-69f1284aeb2d resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-9c0961bf572&vpc=default
41652024-12-14T03:35:45.389ZDEBGnexus (dropshot_external): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:34803 req_id = 13a9390d-78f6-492a-8e8e-69f1284aeb2d roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-9c0961bf572&vpc=default
41662024-12-14T03:35:45.389ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:34803 req_id = 13a9390d-78f6-492a-8e8e-69f1284aeb2d resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-9c0961bf572&vpc=default
41672024-12-14T03:35:45.391ZDEBGnexus (dropshot_external): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:34803 req_id = 13a9390d-78f6-492a-8e8e-69f1284aeb2d roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-9c0961bf572&vpc=default
41682024-12-14T03:35:45.391ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:34803 req_id = 13a9390d-78f6-492a-8e8e-69f1284aeb2d resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-9c0961bf572&vpc=default
41692024-12-14T03:35:45.393ZDEBGnexus (dropshot_external): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:34803 req_id = 13a9390d-78f6-492a-8e8e-69f1284aeb2d roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-9c0961bf572&vpc=default
41702024-12-14T03:35:45.394ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:34803 req_id = 13a9390d-78f6-492a-8e8e-69f1284aeb2d resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-9c0961bf572&vpc=default
41712024-12-14T03:35:45.396ZDEBGnexus (dropshot_external): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:34803 req_id = 13a9390d-78f6-492a-8e8e-69f1284aeb2d roles = RoleSet { roles: {(Silo, 578bc52c-ac81-41a6-a56b-dfc79805368e, "admin")} } uri = /v1/vpc-subnets/default?project=proj-9c0961bf572&vpc=default
41722024-12-14T03:35:45.399ZDEBGnexus (dropshot_external): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:34803 req_id = 13a9390d-78f6-492a-8e8e-69f1284aeb2d resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 578bc52c-ac81-41a6-a56b-dfc79805368e, lookup_type: ById(578bc52c-ac81-41a6-a56b-dfc79805368e) }, key: 8aed7aa9-b517-4399-811c-bfaf9b226118, lookup_type: ByName("proj-9c0961bf572") }, key: 43bb0c4f-fec6-478e-864a-67e6dec06f39, lookup_type: ByName("default") }, key: df878936-0bd3-498e-8a58-fd6b370cf975, lookup_type: ByName("default") } result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-9c0961bf572&vpc=default
41732024-12-14T03:35:45.399ZDEBGnexus (dropshot_external): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:34803 req_id = 13a9390d-78f6-492a-8e8e-69f1284aeb2d roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-9c0961bf572&vpc=default
41742024-12-14T03:35:45.399ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:34803 req_id = 13a9390d-78f6-492a-8e8e-69f1284aeb2d resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-9c0961bf572&vpc=default
41752024-12-14T03:35:45.401ZDEBGnexus (dropshot_external): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:34803 req_id = 13a9390d-78f6-492a-8e8e-69f1284aeb2d roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-9c0961bf572&vpc=default
41762024-12-14T03:35:45.401ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:34803 req_id = 13a9390d-78f6-492a-8e8e-69f1284aeb2d resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-9c0961bf572&vpc=default
41772024-12-14T03:35:45.403ZDEBGnexus (dropshot_external): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:34803 req_id = 13a9390d-78f6-492a-8e8e-69f1284aeb2d roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-9c0961bf572&vpc=default
41782024-12-14T03:35:45.403ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:34803 req_id = 13a9390d-78f6-492a-8e8e-69f1284aeb2d resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-9c0961bf572&vpc=default
41792024-12-14T03:35:45.405ZDEBGnexus (dropshot_external): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:34803 req_id = 13a9390d-78f6-492a-8e8e-69f1284aeb2d roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-9c0961bf572&vpc=default
41802024-12-14T03:35:45.405ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:34803 req_id = 13a9390d-78f6-492a-8e8e-69f1284aeb2d resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-9c0961bf572&vpc=default
41812024-12-14T03:35:45.408ZDEBGnexus (dropshot_external): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:34803 req_id = 13a9390d-78f6-492a-8e8e-69f1284aeb2d roles = RoleSet { roles: {(Silo, 578bc52c-ac81-41a6-a56b-dfc79805368e, "admin")} } uri = /v1/vpc-subnets/default?project=proj-9c0961bf572&vpc=default
41822024-12-14T03:35:45.411ZDEBGnexus (dropshot_external): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:34803 req_id = 13a9390d-78f6-492a-8e8e-69f1284aeb2d resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 578bc52c-ac81-41a6-a56b-dfc79805368e, lookup_type: ById(578bc52c-ac81-41a6-a56b-dfc79805368e) }, key: 8aed7aa9-b517-4399-811c-bfaf9b226118, lookup_type: ByName("proj-9c0961bf572") }, key: 43bb0c4f-fec6-478e-864a-67e6dec06f39, lookup_type: ByName("default") }, key: df878936-0bd3-498e-8a58-fd6b370cf975, lookup_type: ByName("default") } result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-9c0961bf572&vpc=default
41832024-12-14T03:35:45.411ZDEBGnexus (dropshot_external): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:34803 req_id = 13a9390d-78f6-492a-8e8e-69f1284aeb2d roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-9c0961bf572&vpc=default
41842024-12-14T03:35:45.411ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:34803 req_id = 13a9390d-78f6-492a-8e8e-69f1284aeb2d resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-9c0961bf572&vpc=default
41852024-12-14T03:35:45.413ZDEBGnexus (dropshot_external): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:34803 req_id = 13a9390d-78f6-492a-8e8e-69f1284aeb2d roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-9c0961bf572&vpc=default
41862024-12-14T03:35:45.413ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:34803 req_id = 13a9390d-78f6-492a-8e8e-69f1284aeb2d resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-9c0961bf572&vpc=default
41872024-12-14T03:35:45.419ZDEBGnexus (dropshot_external): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:34803 req_id = 13a9390d-78f6-492a-8e8e-69f1284aeb2d roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-9c0961bf572&vpc=default
41882024-12-14T03:35:45.419ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:34803 req_id = 13a9390d-78f6-492a-8e8e-69f1284aeb2d resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-9c0961bf572&vpc=default
41892024-12-14T03:35:45.459ZDEBGnexus (dropshot_external): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:34803 req_id = 13a9390d-78f6-492a-8e8e-69f1284aeb2d roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-9c0961bf572&vpc=default
41902024-12-14T03:35:45.459ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:34803 req_id = 13a9390d-78f6-492a-8e8e-69f1284aeb2d resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-9c0961bf572&vpc=default
41912024-12-14T03:35:45.465ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 116658 local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:34803 req_id = 13a9390d-78f6-492a-8e8e-69f1284aeb2d response_code = 204 uri = /v1/vpc-subnets/default?project=proj-9c0961bf572&vpc=default
41922024-12-14T03:35:45.465ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 3 reason = Signaled
41932024-12-14T03:35:45.465ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
41942024-12-14T03:35:45.465ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
41952024-12-14T03:35:45.465ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
41962024-12-14T03:35:45.465ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
41972024-12-14T03:35:45.466ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
41982024-12-14T03:35:45.466ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41992024-12-14T03:35:45.467ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
42002024-12-14T03:35:45.467ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
42012024-12-14T03:35:45.468ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
42022024-12-14T03:35:45.468ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
42032024-12-14T03:35:45.468ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
42042024-12-14T03:35:45.468ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
42052024-12-14T03:35:45.469ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42062024-12-14T03:35:45.470ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "db95a822bf0fd07240bed3e48d369a3d91a78b45", lookup_type: ByCompositeId("token = \\"db95a822bf0fd07240bed3e48d369a3d91a78b45\\"") } result = Ok(())
42072024-12-14T03:35:45.470ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
42082024-12-14T03:35:45.470ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
42092024-12-14T03:35:45.471ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
42102024-12-14T03:35:45.471ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
42112024-12-14T03:35:45.471ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
42122024-12-14T03:35:45.471ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
42132024-12-14T03:35:45.472ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
42142024-12-14T03:35:45.473ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
42152024-12-14T03:35:45.473ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
42162024-12-14T03:35:45.474ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
42172024-12-14T03:35:45.474ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
42182024-12-14T03:35:45.475ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
42192024-12-14T03:35:45.476ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 578bc52c-ac81-41a6-a56b-dfc79805368e, lookup_type: ById(578bc52c-ac81-41a6-a56b-dfc79805368e) }, key: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, lookup_type: ById(6d1b4298-6f48-4e38-b4c6-02b2175d87a2) } result = Ok(())
42202024-12-14T03:35:45.476ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
42212024-12-14T03:35:45.477ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
42222024-12-14T03:35:45.478ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
42232024-12-14T03:35:45.479ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "db95a822bf0fd07240bed3e48d369a3d91a78b45", lookup_type: ByCompositeId("db95a822bf0fd07240bed3e48d369a3d91a78b45") } result = Ok(())
42242024-12-14T03:35:45.479ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
42252024-12-14T03:35:45.479ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
42262024-12-14T03:35:45.504ZINFOnexus (BackgroundTasks): VPC route manager sled 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
42272024-12-14T03:35:45.504ZDEBGnexus (BackgroundTasks): client request SledAgent = 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
42282024-12-14T03:35:45.506ZDEBGnexus (BackgroundTasks): client response SledAgent = 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "33205ab8-3a36-4138-b2f7-1fb43a90324c", "content-length": "312", "date": "Sat, 14 Dec 2024 03:35:45 GMT"} })
42292024-12-14T03:35:45.506ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
42302024-12-14T03:35:45.506ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
42312024-12-14T03:35:45.508ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
42322024-12-14T03:35:45.509ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
42332024-12-14T03:35:45.510ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
42342024-12-14T03:35:45.510ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
42352024-12-14T03:35:45.511ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
42362024-12-14T03:35:45.512ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
42372024-12-14T03:35:45.513ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
42382024-12-14T03:35:45.513ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
42392024-12-14T03:35:45.514ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
42402024-12-14T03:35:45.516ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 578bc52c-ac81-41a6-a56b-dfc79805368e, lookup_type: ById(578bc52c-ac81-41a6-a56b-dfc79805368e) }, key: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, lookup_type: ById(6d1b4298-6f48-4e38-b4c6-02b2175d87a2) } result = Ok(())
42412024-12-14T03:35:45.516ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
42422024-12-14T03:35:45.516ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
42432024-12-14T03:35:45.517ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
42442024-12-14T03:35:45.517ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
42452024-12-14T03:35:45.518ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
42462024-12-14T03:35:45.518ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
42472024-12-14T03:35:45.522ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
42482024-12-14T03:35:45.523ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 578bc52c-ac81-41a6-a56b-dfc79805368e, lookup_type: ById(578bc52c-ac81-41a6-a56b-dfc79805368e) } result = Ok(())
42492024-12-14T03:35:45.523ZDEBGnexus (dropshot_external): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:34803 req_id = b3eb138e-d188-4363-b008-ad6cdbde6602 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-9c0961bf572
42502024-12-14T03:35:45.523ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:34803 req_id = b3eb138e-d188-4363-b008-ad6cdbde6602 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-9c0961bf572
42512024-12-14T03:35:45.525ZDEBGnexus (dropshot_external): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:34803 req_id = b3eb138e-d188-4363-b008-ad6cdbde6602 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-9c0961bf572
42522024-12-14T03:35:45.526ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:34803 req_id = b3eb138e-d188-4363-b008-ad6cdbde6602 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-9c0961bf572
42532024-12-14T03:35:45.527ZDEBGnexus (dropshot_external): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:34803 req_id = b3eb138e-d188-4363-b008-ad6cdbde6602 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-9c0961bf572
42542024-12-14T03:35:45.528ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:34803 req_id = b3eb138e-d188-4363-b008-ad6cdbde6602 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-9c0961bf572
42552024-12-14T03:35:45.529ZDEBGnexus (dropshot_external): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:34803 req_id = b3eb138e-d188-4363-b008-ad6cdbde6602 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-9c0961bf572
42562024-12-14T03:35:45.529ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:34803 req_id = b3eb138e-d188-4363-b008-ad6cdbde6602 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-9c0961bf572
42572024-12-14T03:35:45.530ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
42582024-12-14T03:35:45.530ZDEBGnexus (BackgroundTasks): client request SledAgent = 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
42592024-12-14T03:35:45.531ZDEBGnexus (BackgroundTasks): client response SledAgent = 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "6478f638-527d-4e91-b663-a9ba04250563", "date": "Sat, 14 Dec 2024 03:35:45 GMT"} })
42602024-12-14T03:35:45.531ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
42612024-12-14T03:35:45.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
42622024-12-14T03:35:45.531ZDEBGnexus (dropshot_external): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:34803 req_id = b3eb138e-d188-4363-b008-ad6cdbde6602 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-9c0961bf572
42632024-12-14T03:35:45.532ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:34803 req_id = b3eb138e-d188-4363-b008-ad6cdbde6602 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-9c0961bf572
42642024-12-14T03:35:45.534ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
42652024-12-14T03:35:45.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
42662024-12-14T03:35:45.534ZDEBGnexus (dropshot_external): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:34803 req_id = b3eb138e-d188-4363-b008-ad6cdbde6602 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-9c0961bf572
42672024-12-14T03:35:45.535ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:34803 req_id = b3eb138e-d188-4363-b008-ad6cdbde6602 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-9c0961bf572
42682024-12-14T03:35:45.537ZDEBGnexus (dropshot_external): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:34803 req_id = b3eb138e-d188-4363-b008-ad6cdbde6602 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-9c0961bf572
42692024-12-14T03:35:45.537ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:34803 req_id = b3eb138e-d188-4363-b008-ad6cdbde6602 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-9c0961bf572
42702024-12-14T03:35:45.537ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
42712024-12-14T03:35:45.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
42722024-12-14T03:35:45.539ZDEBGnexus (dropshot_external): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:34803 req_id = b3eb138e-d188-4363-b008-ad6cdbde6602 roles = RoleSet { roles: {(Silo, 578bc52c-ac81-41a6-a56b-dfc79805368e, "admin")} } uri = /v1/vpcs/default?project=proj-9c0961bf572
42732024-12-14T03:35:45.540ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
42742024-12-14T03:35:45.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
42752024-12-14T03:35:45.542ZDEBGnexus (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:34803 req_id = b3eb138e-d188-4363-b008-ad6cdbde6602 resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 578bc52c-ac81-41a6-a56b-dfc79805368e, lookup_type: ById(578bc52c-ac81-41a6-a56b-dfc79805368e) }, key: 8aed7aa9-b517-4399-811c-bfaf9b226118, lookup_type: ByName("proj-9c0961bf572") }, key: 43bb0c4f-fec6-478e-864a-67e6dec06f39, lookup_type: ByName("default") } result = Ok(()) uri = /v1/vpcs/default?project=proj-9c0961bf572
42762024-12-14T03:35:45.542ZDEBGnexus (dropshot_external): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:34803 req_id = b3eb138e-d188-4363-b008-ad6cdbde6602 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-9c0961bf572
42772024-12-14T03:35:45.542ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:34803 req_id = b3eb138e-d188-4363-b008-ad6cdbde6602 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-9c0961bf572
42782024-12-14T03:35:45.543ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
42792024-12-14T03:35:45.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
42802024-12-14T03:35:45.544ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
42812024-12-14T03:35:45.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
42822024-12-14T03:35:45.544ZDEBGnexus (dropshot_external): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:34803 req_id = b3eb138e-d188-4363-b008-ad6cdbde6602 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-9c0961bf572
42832024-12-14T03:35:45.544ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:34803 req_id = b3eb138e-d188-4363-b008-ad6cdbde6602 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-9c0961bf572
42842024-12-14T03:35:45.545ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
42852024-12-14T03:35:45.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
42862024-12-14T03:35:45.546ZDEBGnexus (dropshot_external): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:34803 req_id = b3eb138e-d188-4363-b008-ad6cdbde6602 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-9c0961bf572
42872024-12-14T03:35:45.546ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:34803 req_id = b3eb138e-d188-4363-b008-ad6cdbde6602 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-9c0961bf572
42882024-12-14T03:35:45.547ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
42892024-12-14T03:35:45.547ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
42902024-12-14T03:35:45.548ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
42912024-12-14T03:35:45.548ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
42922024-12-14T03:35:45.549ZDEBGnexus (dropshot_external): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:34803 req_id = b3eb138e-d188-4363-b008-ad6cdbde6602 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-9c0961bf572
42932024-12-14T03:35:45.549ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:34803 req_id = b3eb138e-d188-4363-b008-ad6cdbde6602 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-9c0961bf572
42942024-12-14T03:35:45.549ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
42952024-12-14T03:35:45.549ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
42962024-12-14T03:35:45.550ZDEBGnexus (dropshot_external): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:34803 req_id = b3eb138e-d188-4363-b008-ad6cdbde6602 roles = RoleSet { roles: {(Silo, 578bc52c-ac81-41a6-a56b-dfc79805368e, "admin")} } uri = /v1/vpcs/default?project=proj-9c0961bf572
42972024-12-14T03:35:45.551ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42982024-12-14T03:35:45.554ZDEBGnexus (dropshot_external): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:34803 req_id = b3eb138e-d188-4363-b008-ad6cdbde6602 resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 578bc52c-ac81-41a6-a56b-dfc79805368e, lookup_type: ById(578bc52c-ac81-41a6-a56b-dfc79805368e) }, key: 8aed7aa9-b517-4399-811c-bfaf9b226118, lookup_type: ByName("proj-9c0961bf572") }, key: 43bb0c4f-fec6-478e-864a-67e6dec06f39, lookup_type: ByName("default") } result = Ok(()) uri = /v1/vpcs/default?project=proj-9c0961bf572
42992024-12-14T03:35:45.554ZDEBGnexus (dropshot_external): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:34803 req_id = b3eb138e-d188-4363-b008-ad6cdbde6602 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-9c0961bf572
43002024-12-14T03:35:45.554ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:34803 req_id = b3eb138e-d188-4363-b008-ad6cdbde6602 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-9c0961bf572
43012024-12-14T03:35:45.555ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) } result = Ok(())
43022024-12-14T03:35:45.555ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
43032024-12-14T03:35:45.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43042024-12-14T03:35:45.556ZDEBGnexus (dropshot_external): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:34803 req_id = b3eb138e-d188-4363-b008-ad6cdbde6602 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-9c0961bf572
43052024-12-14T03:35:45.556ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:34803 req_id = b3eb138e-d188-4363-b008-ad6cdbde6602 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-9c0961bf572
43062024-12-14T03:35:45.556ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
43072024-12-14T03:35:45.556ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43082024-12-14T03:35:45.557ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
43092024-12-14T03:35:45.557ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43102024-12-14T03:35:45.559ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43112024-12-14T03:35:45.560ZDEBGnexus (dropshot_external): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:34803 req_id = b3eb138e-d188-4363-b008-ad6cdbde6602 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-9c0961bf572
43122024-12-14T03:35:45.560ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:34803 req_id = b3eb138e-d188-4363-b008-ad6cdbde6602 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-9c0961bf572
43132024-12-14T03:35:45.562ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) } result = Ok(())
43142024-12-14T03:35:45.562ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
43152024-12-14T03:35:45.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43162024-12-14T03:35:45.563ZDEBGnexus (dropshot_external): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:34803 req_id = b3eb138e-d188-4363-b008-ad6cdbde6602 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-9c0961bf572
43172024-12-14T03:35:45.563ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:34803 req_id = b3eb138e-d188-4363-b008-ad6cdbde6602 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-9c0961bf572
43182024-12-14T03:35:45.564ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
43192024-12-14T03:35:45.564ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43202024-12-14T03:35:45.565ZDEBGnexus (dropshot_external): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:34803 req_id = b3eb138e-d188-4363-b008-ad6cdbde6602 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-9c0961bf572
43212024-12-14T03:35:45.565ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:34803 req_id = b3eb138e-d188-4363-b008-ad6cdbde6602 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-9c0961bf572
43222024-12-14T03:35:45.565ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
43232024-12-14T03:35:45.566ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43242024-12-14T03:35:45.567ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
43252024-12-14T03:35:45.567ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43262024-12-14T03:35:45.567ZDEBGnexus (dropshot_external): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:34803 req_id = b3eb138e-d188-4363-b008-ad6cdbde6602 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-9c0961bf572
43272024-12-14T03:35:45.567ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:34803 req_id = b3eb138e-d188-4363-b008-ad6cdbde6602 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-9c0961bf572
43282024-12-14T03:35:45.568ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
43292024-12-14T03:35:45.568ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43302024-12-14T03:35:45.570ZDEBGnexus (dropshot_external): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:34803 req_id = b3eb138e-d188-4363-b008-ad6cdbde6602 roles = RoleSet { roles: {(Silo, 578bc52c-ac81-41a6-a56b-dfc79805368e, "admin")} } uri = /v1/vpcs/default?project=proj-9c0961bf572
43312024-12-14T03:35:45.570ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
43322024-12-14T03:35:45.570ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43332024-12-14T03:35:45.572ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
43342024-12-14T03:35:45.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43352024-12-14T03:35:45.573ZDEBGnexus (dropshot_external): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:34803 req_id = b3eb138e-d188-4363-b008-ad6cdbde6602 resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 578bc52c-ac81-41a6-a56b-dfc79805368e, lookup_type: ById(578bc52c-ac81-41a6-a56b-dfc79805368e) }, key: 8aed7aa9-b517-4399-811c-bfaf9b226118, lookup_type: ByName("proj-9c0961bf572") }, key: 43bb0c4f-fec6-478e-864a-67e6dec06f39, lookup_type: ByName("default") }, key: 09bbd44b-923c-40e4-a154-80660c9d794e, lookup_type: ById(09bbd44b-923c-40e4-a154-80660c9d794e) } result = Ok(()) uri = /v1/vpcs/default?project=proj-9c0961bf572
43362024-12-14T03:35:45.573ZDEBGnexus (dropshot_external): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:34803 req_id = b3eb138e-d188-4363-b008-ad6cdbde6602 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-9c0961bf572
43372024-12-14T03:35:45.573ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
43382024-12-14T03:35:45.573ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:34803 req_id = b3eb138e-d188-4363-b008-ad6cdbde6602 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-9c0961bf572
43392024-12-14T03:35:45.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43402024-12-14T03:35:45.575ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43412024-12-14T03:35:45.577ZDEBGnexus (dropshot_external): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:34803 req_id = b3eb138e-d188-4363-b008-ad6cdbde6602 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-9c0961bf572
43422024-12-14T03:35:45.577ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:34803 req_id = b3eb138e-d188-4363-b008-ad6cdbde6602 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-9c0961bf572
43432024-12-14T03:35:45.578ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-c470-4000-8000-000000000003, lookup_type: ByName("boundary-ntp") } result = Ok(())
43442024-12-14T03:35:45.578ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
43452024-12-14T03:35:45.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43462024-12-14T03:35:45.580ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
43472024-12-14T03:35:45.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43482024-12-14T03:35:45.581ZDEBGnexus (dropshot_external): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:34803 req_id = b3eb138e-d188-4363-b008-ad6cdbde6602 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-9c0961bf572
43492024-12-14T03:35:45.581ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
43502024-12-14T03:35:45.581ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:34803 req_id = b3eb138e-d188-4363-b008-ad6cdbde6602 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-9c0961bf572
43512024-12-14T03:35:45.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43522024-12-14T03:35:45.583ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
43532024-12-14T03:35:45.583ZDEBGnexus (dropshot_external): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:34803 req_id = b3eb138e-d188-4363-b008-ad6cdbde6602 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-9c0961bf572
43542024-12-14T03:35:45.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43552024-12-14T03:35:45.583ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:34803 req_id = b3eb138e-d188-4363-b008-ad6cdbde6602 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-9c0961bf572
43562024-12-14T03:35:45.585ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
43572024-12-14T03:35:45.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43582024-12-14T03:35:45.586ZDEBGnexus (dropshot_external): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:34803 req_id = b3eb138e-d188-4363-b008-ad6cdbde6602 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-9c0961bf572
43592024-12-14T03:35:45.586ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:34803 req_id = b3eb138e-d188-4363-b008-ad6cdbde6602 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-9c0961bf572
43602024-12-14T03:35:45.586ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
43612024-12-14T03:35:45.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43622024-12-14T03:35:45.587ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
43632024-12-14T03:35:45.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43642024-12-14T03:35:45.588ZDEBGnexus (dropshot_external): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:34803 req_id = b3eb138e-d188-4363-b008-ad6cdbde6602 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-9c0961bf572
43652024-12-14T03:35:45.588ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:34803 req_id = b3eb138e-d188-4363-b008-ad6cdbde6602 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-9c0961bf572
43662024-12-14T03:35:45.588ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43672024-12-14T03:35:45.590ZDEBGnexus (dropshot_external): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:34803 req_id = b3eb138e-d188-4363-b008-ad6cdbde6602 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-9c0961bf572
43682024-12-14T03:35:45.591ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:34803 req_id = b3eb138e-d188-4363-b008-ad6cdbde6602 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-9c0961bf572
43692024-12-14T03:35:45.592ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
43702024-12-14T03:35:45.592ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
43712024-12-14T03:35:45.592ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43722024-12-14T03:35:45.593ZDEBGnexus (dropshot_external): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:34803 req_id = b3eb138e-d188-4363-b008-ad6cdbde6602 roles = RoleSet { roles: {(Silo, 578bc52c-ac81-41a6-a56b-dfc79805368e, "admin")} } uri = /v1/vpcs/default?project=proj-9c0961bf572
43732024-12-14T03:35:45.593ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
43742024-12-14T03:35:45.593ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43752024-12-14T03:35:45.594ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
43762024-12-14T03:35:45.594ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43772024-12-14T03:35:45.595ZDEBGnexus (dropshot_external): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:34803 req_id = b3eb138e-d188-4363-b008-ad6cdbde6602 resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 578bc52c-ac81-41a6-a56b-dfc79805368e, lookup_type: ById(578bc52c-ac81-41a6-a56b-dfc79805368e) }, key: 8aed7aa9-b517-4399-811c-bfaf9b226118, lookup_type: ByName("proj-9c0961bf572") }, key: 43bb0c4f-fec6-478e-864a-67e6dec06f39, lookup_type: ByName("default") } result = Ok(()) uri = /v1/vpcs/default?project=proj-9c0961bf572
43782024-12-14T03:35:45.595ZDEBGnexus (dropshot_external): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:34803 req_id = b3eb138e-d188-4363-b008-ad6cdbde6602 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-9c0961bf572
43792024-12-14T03:35:45.595ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:34803 req_id = b3eb138e-d188-4363-b008-ad6cdbde6602 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-9c0961bf572
43802024-12-14T03:35:45.596ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
43812024-12-14T03:35:45.596ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43822024-12-14T03:35:45.597ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
43832024-12-14T03:35:45.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43842024-12-14T03:35:45.599ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
43852024-12-14T03:35:45.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43862024-12-14T03:35:45.600ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
43872024-12-14T03:35:45.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43882024-12-14T03:35:45.601ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 135525 local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:34803 req_id = b3eb138e-d188-4363-b008-ad6cdbde6602 response_code = 204 uri = /v1/vpcs/default?project=proj-9c0961bf572
43892024-12-14T03:35:45.601ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43902024-12-14T03:35:45.602ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
43912024-12-14T03:35:45.602ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
43922024-12-14T03:35:45.603ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
43932024-12-14T03:35:45.603ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
43942024-12-14T03:35:45.604ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
43952024-12-14T03:35:45.604ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
43962024-12-14T03:35:45.604ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
43972024-12-14T03:35:45.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43982024-12-14T03:35:45.606ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "db95a822bf0fd07240bed3e48d369a3d91a78b45", lookup_type: ByCompositeId("token = \\"db95a822bf0fd07240bed3e48d369a3d91a78b45\\"") } result = Ok(())
43992024-12-14T03:35:45.606ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
44002024-12-14T03:35:45.606ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
44012024-12-14T03:35:45.606ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
44022024-12-14T03:35:45.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
44032024-12-14T03:35:45.607ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
44042024-12-14T03:35:45.607ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
44052024-12-14T03:35:45.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
44062024-12-14T03:35:45.607ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
44072024-12-14T03:35:45.608ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
44082024-12-14T03:35:45.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
44092024-12-14T03:35:45.608ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
44102024-12-14T03:35:45.609ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
44112024-12-14T03:35:45.610ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
44122024-12-14T03:35:45.610ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
44132024-12-14T03:35:45.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
44142024-12-14T03:35:45.610ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
44152024-12-14T03:35:45.611ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
44162024-12-14T03:35:45.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
44172024-12-14T03:35:45.612ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
44182024-12-14T03:35:45.612ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
44192024-12-14T03:35:45.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
44202024-12-14T03:35:45.613ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 578bc52c-ac81-41a6-a56b-dfc79805368e, lookup_type: ById(578bc52c-ac81-41a6-a56b-dfc79805368e) }, key: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, lookup_type: ById(6d1b4298-6f48-4e38-b4c6-02b2175d87a2) } result = Ok(())
44212024-12-14T03:35:45.613ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
44222024-12-14T03:35:45.613ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
44232024-12-14T03:35:45.614ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44242024-12-14T03:35:45.614ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
44252024-12-14T03:35:45.616ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "db95a822bf0fd07240bed3e48d369a3d91a78b45", lookup_type: ByCompositeId("db95a822bf0fd07240bed3e48d369a3d91a78b45") } result = Ok(())
44262024-12-14T03:35:45.616ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
44272024-12-14T03:35:45.616ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
44282024-12-14T03:35:45.617ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = InternetGateway { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000002, lookup_type: ByName("default") } result = Ok(())
44292024-12-14T03:35:45.617ZDEBGnexus (BackgroundTasks): client request SledAgent = 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
44302024-12-14T03:35:45.619ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
44312024-12-14T03:35:45.620ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
44322024-12-14T03:35:45.620ZDEBGnexus (BackgroundTasks): client response SledAgent = 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "1d4b3eed-749f-432c-a1f6-fbe320f84f5e", "date": "Sat, 14 Dec 2024 03:35:45 GMT"} })
44332024-12-14T03:35:45.620ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
44342024-12-14T03:35:45.621ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 156.082037ms iteration = 3 status = {}
44352024-12-14T03:35:45.621ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
44362024-12-14T03:35:45.622ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
44372024-12-14T03:35:45.622ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
44382024-12-14T03:35:45.623ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
44392024-12-14T03:35:45.623ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
44402024-12-14T03:35:45.625ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
44412024-12-14T03:35:45.626ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 578bc52c-ac81-41a6-a56b-dfc79805368e, lookup_type: ById(578bc52c-ac81-41a6-a56b-dfc79805368e) }, key: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, lookup_type: ById(6d1b4298-6f48-4e38-b4c6-02b2175d87a2) } result = Ok(())
44422024-12-14T03:35:45.626ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
44432024-12-14T03:35:45.626ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
44442024-12-14T03:35:45.627ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
44452024-12-14T03:35:45.627ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
44462024-12-14T03:35:45.628ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
44472024-12-14T03:35:45.629ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
44482024-12-14T03:35:45.630ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
44492024-12-14T03:35:45.631ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 578bc52c-ac81-41a6-a56b-dfc79805368e, lookup_type: ById(578bc52c-ac81-41a6-a56b-dfc79805368e) } result = Ok(())
44502024-12-14T03:35:45.631ZDEBGnexus (dropshot_external): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:34803 req_id = 3f93d55c-02b7-4c47-ba0d-3361993a006b roles = RoleSet { roles: {} } uri = /v1/projects/proj-9c0961bf572
44512024-12-14T03:35:45.631ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:34803 req_id = 3f93d55c-02b7-4c47-ba0d-3361993a006b resource = Database result = Ok(()) uri = /v1/projects/proj-9c0961bf572
44522024-12-14T03:35:45.632ZDEBGnexus (dropshot_external): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:34803 req_id = 3f93d55c-02b7-4c47-ba0d-3361993a006b roles = RoleSet { roles: {} } uri = /v1/projects/proj-9c0961bf572
44532024-12-14T03:35:45.632ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:34803 req_id = 3f93d55c-02b7-4c47-ba0d-3361993a006b resource = Database result = Ok(()) uri = /v1/projects/proj-9c0961bf572
44542024-12-14T03:35:45.634ZDEBGnexus (dropshot_external): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:34803 req_id = 3f93d55c-02b7-4c47-ba0d-3361993a006b roles = RoleSet { roles: {} } uri = /v1/projects/proj-9c0961bf572
44552024-12-14T03:35:45.634ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:34803 req_id = 3f93d55c-02b7-4c47-ba0d-3361993a006b resource = Database result = Ok(()) uri = /v1/projects/proj-9c0961bf572
44562024-12-14T03:35:45.636ZDEBGnexus (dropshot_external): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:34803 req_id = 3f93d55c-02b7-4c47-ba0d-3361993a006b roles = RoleSet { roles: {} } uri = /v1/projects/proj-9c0961bf572
44572024-12-14T03:35:45.636ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:34803 req_id = 3f93d55c-02b7-4c47-ba0d-3361993a006b resource = Database result = Ok(()) uri = /v1/projects/proj-9c0961bf572
44582024-12-14T03:35:45.639ZDEBGnexus (dropshot_external): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:34803 req_id = 3f93d55c-02b7-4c47-ba0d-3361993a006b roles = RoleSet { roles: {} } uri = /v1/projects/proj-9c0961bf572
44592024-12-14T03:35:45.639ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:34803 req_id = 3f93d55c-02b7-4c47-ba0d-3361993a006b resource = Database result = Ok(()) uri = /v1/projects/proj-9c0961bf572
44602024-12-14T03:35:45.641ZDEBGnexus (dropshot_external): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:34803 req_id = 3f93d55c-02b7-4c47-ba0d-3361993a006b roles = RoleSet { roles: {} } uri = /v1/projects/proj-9c0961bf572
44612024-12-14T03:35:45.641ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:34803 req_id = 3f93d55c-02b7-4c47-ba0d-3361993a006b resource = Database result = Ok(()) uri = /v1/projects/proj-9c0961bf572
44622024-12-14T03:35:45.643ZDEBGnexus (dropshot_external): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:34803 req_id = 3f93d55c-02b7-4c47-ba0d-3361993a006b roles = RoleSet { roles: {(Silo, 578bc52c-ac81-41a6-a56b-dfc79805368e, "admin")} } uri = /v1/projects/proj-9c0961bf572
44632024-12-14T03:35:45.646ZDEBGnexus (dropshot_external): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:34803 req_id = 3f93d55c-02b7-4c47-ba0d-3361993a006b resource = Project { parent: Silo { parent: Fleet, key: 578bc52c-ac81-41a6-a56b-dfc79805368e, lookup_type: ById(578bc52c-ac81-41a6-a56b-dfc79805368e) }, key: 8aed7aa9-b517-4399-811c-bfaf9b226118, lookup_type: ByName("proj-9c0961bf572") } result = Ok(()) uri = /v1/projects/proj-9c0961bf572
44642024-12-14T03:35:45.646ZDEBGnexus (dropshot_external): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:34803 req_id = 3f93d55c-02b7-4c47-ba0d-3361993a006b roles = RoleSet { roles: {} } uri = /v1/projects/proj-9c0961bf572
44652024-12-14T03:35:45.646ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:34803 req_id = 3f93d55c-02b7-4c47-ba0d-3361993a006b resource = Database result = Ok(()) uri = /v1/projects/proj-9c0961bf572
44662024-12-14T03:35:45.648ZDEBGnexus (dropshot_external): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:34803 req_id = 3f93d55c-02b7-4c47-ba0d-3361993a006b roles = RoleSet { roles: {} } uri = /v1/projects/proj-9c0961bf572
44672024-12-14T03:35:45.648ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:34803 req_id = 3f93d55c-02b7-4c47-ba0d-3361993a006b resource = Database result = Ok(()) uri = /v1/projects/proj-9c0961bf572
44682024-12-14T03:35:45.650ZDEBGnexus (dropshot_external): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:34803 req_id = 3f93d55c-02b7-4c47-ba0d-3361993a006b roles = RoleSet { roles: {} } uri = /v1/projects/proj-9c0961bf572
44692024-12-14T03:35:45.650ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:34803 req_id = 3f93d55c-02b7-4c47-ba0d-3361993a006b resource = Database result = Ok(()) uri = /v1/projects/proj-9c0961bf572
44702024-12-14T03:35:45.652ZDEBGnexus (dropshot_external): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:34803 req_id = 3f93d55c-02b7-4c47-ba0d-3361993a006b roles = RoleSet { roles: {} } uri = /v1/projects/proj-9c0961bf572
44712024-12-14T03:35:45.653ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:34803 req_id = 3f93d55c-02b7-4c47-ba0d-3361993a006b resource = Database result = Ok(()) uri = /v1/projects/proj-9c0961bf572
44722024-12-14T03:35:45.655ZDEBGnexus (dropshot_external): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:34803 req_id = 3f93d55c-02b7-4c47-ba0d-3361993a006b roles = RoleSet { roles: {(Silo, 578bc52c-ac81-41a6-a56b-dfc79805368e, "admin")} } uri = /v1/projects/proj-9c0961bf572
44732024-12-14T03:35:45.657ZDEBGnexus (dropshot_external): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:34803 req_id = 3f93d55c-02b7-4c47-ba0d-3361993a006b resource = Project { parent: Silo { parent: Fleet, key: 578bc52c-ac81-41a6-a56b-dfc79805368e, lookup_type: ById(578bc52c-ac81-41a6-a56b-dfc79805368e) }, key: 8aed7aa9-b517-4399-811c-bfaf9b226118, lookup_type: ByName("proj-9c0961bf572") } result = Ok(()) uri = /v1/projects/proj-9c0961bf572
44742024-12-14T03:35:45.657ZDEBGnexus (dropshot_external): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:34803 req_id = 3f93d55c-02b7-4c47-ba0d-3361993a006b roles = RoleSet { roles: {} } uri = /v1/projects/proj-9c0961bf572
44752024-12-14T03:35:45.657ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:34803 req_id = 3f93d55c-02b7-4c47-ba0d-3361993a006b resource = Database result = Ok(()) uri = /v1/projects/proj-9c0961bf572
44762024-12-14T03:35:45.659ZDEBGnexus (dropshot_external): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:34803 req_id = 3f93d55c-02b7-4c47-ba0d-3361993a006b roles = RoleSet { roles: {} } uri = /v1/projects/proj-9c0961bf572
44772024-12-14T03:35:45.659ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:34803 req_id = 3f93d55c-02b7-4c47-ba0d-3361993a006b resource = Database result = Ok(()) uri = /v1/projects/proj-9c0961bf572
44782024-12-14T03:35:45.661ZDEBGnexus (dropshot_external): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:34803 req_id = 3f93d55c-02b7-4c47-ba0d-3361993a006b roles = RoleSet { roles: {} } uri = /v1/projects/proj-9c0961bf572
44792024-12-14T03:35:45.661ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:34803 req_id = 3f93d55c-02b7-4c47-ba0d-3361993a006b resource = Database result = Ok(()) uri = /v1/projects/proj-9c0961bf572
44802024-12-14T03:35:45.671ZDEBGnexus (dropshot_external): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:34803 req_id = 3f93d55c-02b7-4c47-ba0d-3361993a006b roles = RoleSet { roles: {} } uri = /v1/projects/proj-9c0961bf572
44812024-12-14T03:35:45.671ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:34803 req_id = 3f93d55c-02b7-4c47-ba0d-3361993a006b resource = Database result = Ok(()) uri = /v1/projects/proj-9c0961bf572
44822024-12-14T03:35:45.684ZDEBGnexus (dropshot_external): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:34803 req_id = 3f93d55c-02b7-4c47-ba0d-3361993a006b roles = RoleSet { roles: {} } uri = /v1/projects/proj-9c0961bf572
44832024-12-14T03:35:45.685ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:34803 req_id = 3f93d55c-02b7-4c47-ba0d-3361993a006b resource = Database result = Ok(()) uri = /v1/projects/proj-9c0961bf572
44842024-12-14T03:35:45.692ZDEBGnexus (dropshot_external): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:34803 req_id = 3f93d55c-02b7-4c47-ba0d-3361993a006b roles = RoleSet { roles: {} } uri = /v1/projects/proj-9c0961bf572
44852024-12-14T03:35:45.693ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:34803 req_id = 3f93d55c-02b7-4c47-ba0d-3361993a006b resource = Database result = Ok(()) uri = /v1/projects/proj-9c0961bf572
44862024-12-14T03:35:45.694ZDEBGnexus (dropshot_external): roles actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:34803 req_id = 3f93d55c-02b7-4c47-ba0d-3361993a006b roles = RoleSet { roles: {} } uri = /v1/projects/proj-9c0961bf572
44872024-12-14T03:35:45.694ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 6d1b4298-6f48-4e38-b4c6-02b2175d87a2, silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, .. }) actor_id = 6d1b4298-6f48-4e38-b4c6-02b2175d87a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:34803 req_id = 3f93d55c-02b7-4c47-ba0d-3361993a006b resource = Database result = Ok(()) uri = /v1/projects/proj-9c0961bf572
44882024-12-14T03:35:45.707ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105114 local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:34803 req_id = 3f93d55c-02b7-4c47-ba0d-3361993a006b response_code = 204 uri = /v1/projects/proj-9c0961bf572
44892024-12-14T03:35:46.344ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 6 reason = Timeout
44902024-12-14T03:35:46.344ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 6 reason = Timeout
44912024-12-14T03:35:46.344ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
44922024-12-14T03:35:46.344ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44932024-12-14T03:35:46.344ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
44942024-12-14T03:35:46.344ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44952024-12-14T03:35:46.346ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44962024-12-14T03:35:46.347ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
44972024-12-14T03:35:46.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
44982024-12-14T03:35:46.349ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
44992024-12-14T03:35:46.349ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45002024-12-14T03:35:46.349ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.96932ms iteration = 6 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
45012024-12-14T03:35:46.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45022024-12-14T03:35:46.350ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45032024-12-14T03:35:46.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45042024-12-14T03:35:46.352ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45052024-12-14T03:35:46.354ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1, lookup_type: ById(eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1) } result = Ok(())
45062024-12-14T03:35:46.354ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45072024-12-14T03:35:46.354ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45082024-12-14T03:35:46.374ZINFOnexus (BackgroundTasks): found new target blueprint (first find) background_task = blueprint_loader file = nexus/src/app/background/tasks/blueprint_load.rs:88 target_id = eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1 time_created = 2024-12-14 03:34:51.368980 UTC
45092024-12-14T03:35:46.374ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 29.867548ms iteration = 6 status = {"enabled":false,"status":"first target blueprint","target_id":"eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1","time_created":"2024-12-14T03:34:51.368980Z","time_found":"2024-12-14T03:35:46.374214985Z"}
45102024-12-14T03:35:46.374ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 2 reason = Dependency
45112024-12-14T03:35:46.374ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1
45122024-12-14T03:35:46.374ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 2 reason = Dependency
45132024-12-14T03:35:46.374ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 5.61\u{b5}s iteration = 2 status = {"enabled":false,"target_id":"eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1"}
45142024-12-14T03:35:46.374ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
45152024-12-14T03:35:46.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
45162024-12-14T03:35:46.374ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
45172024-12-14T03:35:46.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
45182024-12-14T03:35:46.374ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
45192024-12-14T03:35:46.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
45202024-12-14T03:35:46.374ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
45212024-12-14T03:35:46.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
45222024-12-14T03:35:46.375ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
45232024-12-14T03:35:46.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
45242024-12-14T03:35:46.376ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45252024-12-14T03:35:46.378ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
45262024-12-14T03:35:46.378ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
45272024-12-14T03:35:46.378ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
45282024-12-14T03:35:46.378ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45292024-12-14T03:35:46.380ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
45302024-12-14T03:35:46.380ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
45312024-12-14T03:35:46.380ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
45322024-12-14T03:35:46.380ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45332024-12-14T03:35:46.382ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
45342024-12-14T03:35:46.382ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
45352024-12-14T03:35:46.382ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
45362024-12-14T03:35:46.382ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45372024-12-14T03:35:46.384ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
45382024-12-14T03:35:46.384ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
45392024-12-14T03:35:46.384ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
45402024-12-14T03:35:46.384ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45412024-12-14T03:35:46.386ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
45422024-12-14T03:35:46.386ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
45432024-12-14T03:35:46.386ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
45442024-12-14T03:35:46.418ZDEBGnexus (BackgroundTasks): client request background_task = crdb_node_id_collector body = None method = GET uri = http://[fd00:1122:3344:101::6]:32222/node/id
45452024-12-14T03:35:46.448ZDEBGnexus (BackgroundTasks): client request background_task = crdb_node_id_collector body = None method = GET uri = http://[fd00:1122:3344:101::7]:32222/node/id
45462024-12-14T03:35:46.478ZDEBGnexus (BackgroundTasks): client request background_task = crdb_node_id_collector body = None method = GET uri = http://[fd00:1122:3344:101::3]:32222/node/id
45472024-12-14T03:35:46.509ZDEBGnexus (BackgroundTasks): client request background_task = crdb_node_id_collector body = None method = GET uri = http://[fd00:1122:3344:101::4]:32222/node/id
45482024-12-14T03:35:46.540ZDEBGnexus (BackgroundTasks): client request background_task = crdb_node_id_collector body = None method = GET uri = http://[fd00:1122:3344:101::5]:32222/node/id
45492024-12-14T03:35:47.430ZDEBGnexus (BackgroundTasks): client response background_task = crdb_node_id_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::7]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "9ccb5206-5583-40a3-934d-189119367f95", "content-length": "64", "date": "Sat, 14 Dec 2024 03:35:46 GMT"} })
45502024-12-14T03:35:47.432ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
45512024-12-14T03:35:47.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
45522024-12-14T03:35:47.434ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45532024-12-14T03:35:47.435ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
45542024-12-14T03:35:47.435ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
45552024-12-14T03:35:47.435ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
45562024-12-14T03:35:47.453ZDEBGnexus (BackgroundTasks): client response background_task = crdb_node_id_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::6]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f32b2c31-802a-470f-abd4-703bd8924d71", "content-length": "64", "date": "Sat, 14 Dec 2024 03:35:46 GMT"} })
45572024-12-14T03:35:47.453ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
45582024-12-14T03:35:47.453ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
45592024-12-14T03:35:47.455ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45602024-12-14T03:35:47.456ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
45612024-12-14T03:35:47.456ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
45622024-12-14T03:35:47.456ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
45632024-12-14T03:35:47.477ZDEBGnexus (BackgroundTasks): client response background_task = crdb_node_id_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::3]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b522eb1e-922c-456f-8fef-096349a061d0", "content-length": "64", "date": "Sat, 14 Dec 2024 03:35:46 GMT"} })
45642024-12-14T03:35:47.477ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
45652024-12-14T03:35:47.477ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
45662024-12-14T03:35:47.479ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45672024-12-14T03:35:47.480ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
45682024-12-14T03:35:47.480ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
45692024-12-14T03:35:47.480ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
45702024-12-14T03:35:47.508ZDEBGnexus (BackgroundTasks): client response background_task = crdb_node_id_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::5]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "21239edd-c061-4614-bd83-f28f2861d202", "content-length": "64", "date": "Sat, 14 Dec 2024 03:35:46 GMT"} })
45712024-12-14T03:35:47.508ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
45722024-12-14T03:35:47.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
45732024-12-14T03:35:47.509ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45742024-12-14T03:35:47.511ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
45752024-12-14T03:35:47.511ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
45762024-12-14T03:35:47.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
45772024-12-14T03:35:47.511ZDEBGnexus (BackgroundTasks): client response background_task = crdb_node_id_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::4]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "5c36a2c3-65eb-46c4-a439-8972fdcb88b7", "content-length": "64", "date": "Sat, 14 Dec 2024 03:35:46 GMT"} })
45782024-12-14T03:35:47.511ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
45792024-12-14T03:35:47.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
45802024-12-14T03:35:47.512ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45812024-12-14T03:35:47.514ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
45822024-12-14T03:35:47.514ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
45832024-12-14T03:35:47.514ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
45842024-12-14T03:35:47.519ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 1.145652432s iteration = 2 status = {"nsuccess":5}
45852024-12-14T03:35:51.848ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:41517
45862024-12-14T03:35:51.848ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:41517 req_id = 039b77a3-c4a7-475d-a276-af1149fb3e28 roles = RoleSet { roles: {} } uri = /metrics/producers
45872024-12-14T03:35:51.849ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:41517 req_id = 039b77a3-c4a7-475d-a276-af1149fb3e28 resource = Database result = Ok(()) uri = /metrics/producers
45882024-12-14T03:35:51.891ZINFOnexus: assigned collector to new producer collector_id = a321e00a-3126-4ea4-b26d-c0e3eea69166 file = nexus/src/app/oximeter.rs:76 producer_id = 232a98a5-5cb7-4d84-a629-b03087fbd5b7
45892024-12-14T03:35:51.891ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 42715 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:41517 req_id = 039b77a3-c4a7-475d-a276-af1149fb3e28 response_code = 201 uri = /metrics/producers
45902024-12-14T03:35:56.345ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 3 reason = Timeout
45912024-12-14T03:35:56.345ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
45922024-12-14T03:35:56.345ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 3 reason = Timeout
45932024-12-14T03:35:56.345ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 2 reason = Timeout
45942024-12-14T03:35:56.345ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
45952024-12-14T03:35:56.345ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 3 reason = Timeout
45962024-12-14T03:35:56.345ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 3 reason = Timeout
45972024-12-14T03:35:56.345ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
45982024-12-14T03:35:56.345ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 3 reason = Timeout
45992024-12-14T03:35:56.345ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
46002024-12-14T03:35:56.345ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
46012024-12-14T03:35:56.345ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
46022024-12-14T03:35:56.345ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 3 reason = Timeout
46032024-12-14T03:35:56.345ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
46042024-12-14T03:35:56.345ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 3 reason = Timeout
46052024-12-14T03:35:56.345ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
46062024-12-14T03:35:56.345ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 2 reason = Timeout
46072024-12-14T03:35:56.345ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-14 03:25:56.345419009 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
46082024-12-14T03:35:56.345ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
46092024-12-14T03:35:56.345ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 3 reason = Timeout
46102024-12-14T03:35:56.345ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
46112024-12-14T03:35:56.345ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 2 reason = Timeout
46122024-12-14T03:35:56.345ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
46132024-12-14T03:35:56.345ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 3 reason = Timeout
46142024-12-14T03:35:56.345ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1
46152024-12-14T03:35:56.345ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 20.14\u{b5}s iteration = 3 status = {"enabled":false,"target_id":"eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1"}
46162024-12-14T03:35:56.345ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 2 reason = Timeout
46172024-12-14T03:35:56.345ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 2 reason = Timeout
46182024-12-14T03:35:56.345ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
46192024-12-14T03:35:56.345ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
46202024-12-14T03:35:56.345ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 4 reason = Timeout
46212024-12-14T03:35:56.345ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
46222024-12-14T03:35:56.345ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
46232024-12-14T03:35:56.345ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46242024-12-14T03:35:56.345ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 3 reason = Timeout
46252024-12-14T03:35:56.345ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 5 reason = Timeout
46262024-12-14T03:35:56.345ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
46272024-12-14T03:35:56.345ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 4 reason = Timeout
46282024-12-14T03:35:56.345ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 3 reason = Timeout
46292024-12-14T03:35:56.345ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
46302024-12-14T03:35:56.345ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 7 reason = Timeout
46312024-12-14T03:35:56.345ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
46322024-12-14T03:35:56.345ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46332024-12-14T03:35:56.345ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 3 reason = Timeout
46342024-12-14T03:35:56.345ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 4 reason = Timeout
46352024-12-14T03:35:56.345ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 3 reason = Timeout
46362024-12-14T03:35:56.345ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
46372024-12-14T03:35:56.345ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 7 reason = Timeout
46382024-12-14T03:35:56.345ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46392024-12-14T03:35:56.345ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
46402024-12-14T03:35:56.345ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 3 reason = Timeout
46412024-12-14T03:35:56.345ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
46422024-12-14T03:35:56.345ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
46432024-12-14T03:35:56.345ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 3 reason = Timeout
46442024-12-14T03:35:56.345ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 3 reason = Timeout
46452024-12-14T03:35:56.345ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
46462024-12-14T03:35:56.345ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 3 reason = Timeout
46472024-12-14T03:35:56.345ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
46482024-12-14T03:35:56.346ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 3 reason = Timeout
46492024-12-14T03:35:56.346ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
46502024-12-14T03:35:56.346ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 3 reason = Timeout
46512024-12-14T03:35:56.346ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
46522024-12-14T03:35:56.346ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
46532024-12-14T03:35:56.346ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
46542024-12-14T03:35:56.346ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
46552024-12-14T03:35:56.346ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
46562024-12-14T03:35:56.346ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
46572024-12-14T03:35:56.346ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
46582024-12-14T03:35:56.346ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
46592024-12-14T03:35:56.346ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
46602024-12-14T03:35:56.346ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
46612024-12-14T03:35:56.346ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
46622024-12-14T03:35:56.346ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
46632024-12-14T03:35:56.346ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
46642024-12-14T03:35:56.346ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46652024-12-14T03:35:56.346ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
46662024-12-14T03:35:56.346ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
46672024-12-14T03:35:56.346ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
46682024-12-14T03:35:56.346ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("28f528f1-3159-4fbc-9304-37b7e4a50ae8.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7274e15f-a5f6-4975-bcdd-a2ef890c0230.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("7274e15f-a5f6-4975-bcdd-a2ef890c0230.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1162, tv_nsec: 667010270 } })
46692024-12-14T03:35:56.346ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
46702024-12-14T03:35:56.346ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46712024-12-14T03:35:56.346ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
46722024-12-14T03:35:56.346ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
46732024-12-14T03:35:56.346ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("3db8556d-0ae0-4824-8953-f38d8eef7409.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7b672843-049d-4d9c-b0a2-21d7b6323621.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("db39fe07-65c4-451a-a2bd-78fcdfc10040.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("db39fe07-65c4-451a-a2bd-78fcdfc10040.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1162, tv_nsec: 667060261 } })
46742024-12-14T03:35:56.346ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
46752024-12-14T03:35:56.346ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46762024-12-14T03:35:56.346ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
46772024-12-14T03:35:56.346ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
46782024-12-14T03:35:56.347ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
46792024-12-14T03:35:56.347ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.570852ms iteration = 3 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
46802024-12-14T03:35:56.347ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
46812024-12-14T03:35:56.347ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.354787ms iteration = 3 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
46822024-12-14T03:35:56.348ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-14 03:25:56.345419009 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
46832024-12-14T03:35:56.348ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 3.204054ms iteration = 2 status = {"expiration":"2024-12-14T03:25:56.345419009Z","pruned":[]}
46842024-12-14T03:35:56.349ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
46852024-12-14T03:35:56.349ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
46862024-12-14T03:35:56.349ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
46872024-12-14T03:35:56.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
46882024-12-14T03:35:56.350ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8d70e61c-94ed-41ce-b36c-cb904f92c534.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8d70e61c-94ed-41ce-b36c-cb904f92c534.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1162, tv_nsec: 670511760 } })
46892024-12-14T03:35:56.350ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
46902024-12-14T03:35:56.350ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 5.54362ms iteration = 3 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
46912024-12-14T03:35:56.350ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8d70e61c-94ed-41ce-b36c-cb904f92c534.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8d70e61c-94ed-41ce-b36c-cb904f92c534.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1162, tv_nsec: 671430029 } })
46922024-12-14T03:35:56.351ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46932024-12-14T03:35:56.351ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46942024-12-14T03:35:56.351ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
46952024-12-14T03:35:56.352ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 6.799226ms iteration = 2 status = {"errors":[],"found_port_ok":[]}
46962024-12-14T03:35:56.353ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
46972024-12-14T03:35:56.353ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
46982024-12-14T03:35:56.353ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
46992024-12-14T03:35:56.354ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
47002024-12-14T03:35:56.354ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
47012024-12-14T03:35:56.354ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
47022024-12-14T03:35:56.357ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
47032024-12-14T03:35:56.357ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47042024-12-14T03:35:56.357ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
47052024-12-14T03:35:56.357ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47062024-12-14T03:35:56.359ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
47072024-12-14T03:35:56.359ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
47082024-12-14T03:35:56.359ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
47092024-12-14T03:35:56.360ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
47102024-12-14T03:35:56.360ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
47112024-12-14T03:35:56.360ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
47122024-12-14T03:35:56.361ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
47132024-12-14T03:35:56.361ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
47142024-12-14T03:35:56.363ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47152024-12-14T03:35:56.363ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47162024-12-14T03:35:56.366ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
47172024-12-14T03:35:56.366ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
47182024-12-14T03:35:56.366ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
47192024-12-14T03:35:56.368ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
47202024-12-14T03:35:56.368ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47212024-12-14T03:35:56.369ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47222024-12-14T03:35:56.374ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 28.818487ms iteration = 3 status = {"errors":[],"garbage_collect_requested":[]}
47232024-12-14T03:35:56.376ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47242024-12-14T03:35:56.376ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
47252024-12-14T03:35:56.376ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
47262024-12-14T03:35:56.379ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
47272024-12-14T03:35:56.382ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47282024-12-14T03:35:56.382ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
47292024-12-14T03:35:56.382ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47302024-12-14T03:35:56.382ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
47312024-12-14T03:35:56.390ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47322024-12-14T03:35:56.390ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
47332024-12-14T03:35:56.390ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
47342024-12-14T03:35:56.390ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
47352024-12-14T03:35:56.390ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 45.631104ms iteration = 2 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
47362024-12-14T03:35:56.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
47372024-12-14T03:35:56.392ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
47382024-12-14T03:35:56.392ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
47392024-12-14T03:35:56.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
47402024-12-14T03:35:56.394ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 48.535763ms iteration = 7 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
47412024-12-14T03:35:56.395ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47422024-12-14T03:35:56.398ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
47432024-12-14T03:35:56.399ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
47442024-12-14T03:35:56.399ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
47452024-12-14T03:35:56.399ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
47462024-12-14T03:35:56.399ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
47472024-12-14T03:35:56.401ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
47482024-12-14T03:35:56.401ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
47492024-12-14T03:35:56.402ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47502024-12-14T03:35:56.403ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 57.996792ms iteration = 3 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
47512024-12-14T03:35:56.405ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
47522024-12-14T03:35:56.405ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
47532024-12-14T03:35:56.405ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
47542024-12-14T03:35:56.407ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 61.88661ms iteration = 3 status = {"errors":[],"records_set_to_done":[]}
47552024-12-14T03:35:56.408ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
47562024-12-14T03:35:56.408ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47572024-12-14T03:35:56.408ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
47582024-12-14T03:35:56.410ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
47592024-12-14T03:35:56.410ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
47602024-12-14T03:35:56.410ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
47612024-12-14T03:35:56.411ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
47622024-12-14T03:35:56.412ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
47632024-12-14T03:35:56.413ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
47642024-12-14T03:35:56.413ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
47652024-12-14T03:35:56.413ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
47662024-12-14T03:35:56.413ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8d70e61c-94ed-41ce-b36c-cb904f92c534.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8d70e61c-94ed-41ce-b36c-cb904f92c534.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1162, tv_nsec: 734037853 } })
47672024-12-14T03:35:56.413ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
47682024-12-14T03:35:56.413ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200
47692024-12-14T03:35:56.423ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
47702024-12-14T03:35:56.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
47712024-12-14T03:35:56.425ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
47722024-12-14T03:35:56.425ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 79.763218ms iteration = 3 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
47732024-12-14T03:35:56.427ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47742024-12-14T03:35:56.427ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
47752024-12-14T03:35:56.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
47762024-12-14T03:35:56.430ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
47772024-12-14T03:35:56.430ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
47782024-12-14T03:35:56.430ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
47792024-12-14T03:35:56.432ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47802024-12-14T03:35:56.433ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
47812024-12-14T03:35:56.433ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
47822024-12-14T03:35:56.433ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 87.561784ms iteration = 2 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
47832024-12-14T03:35:56.433ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47842024-12-14T03:35:56.436ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 8d70e61c-94ed-41ce-b36c-cb904f92c534, lookup_type: ById(8d70e61c-94ed-41ce-b36c-cb904f92c534) } result = Ok(())
47852024-12-14T03:35:56.436ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
47862024-12-14T03:35:56.436ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
47872024-12-14T03:35:56.436ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
47882024-12-14T03:35:56.438ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
47892024-12-14T03:35:56.438ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
47902024-12-14T03:35:56.438ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
47912024-12-14T03:35:56.438ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
47922024-12-14T03:35:56.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
47932024-12-14T03:35:56.438ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
47942024-12-14T03:35:56.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
47952024-12-14T03:35:56.440ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47962024-12-14T03:35:56.443ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47972024-12-14T03:35:56.443ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
47982024-12-14T03:35:56.443ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
47992024-12-14T03:35:56.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
48002024-12-14T03:35:56.446ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1, lookup_type: ById(eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1) } result = Ok(())
48012024-12-14T03:35:56.446ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48022024-12-14T03:35:56.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48032024-12-14T03:35:56.446ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
48042024-12-14T03:35:56.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
48052024-12-14T03:35:56.449ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
48062024-12-14T03:35:56.449ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
48072024-12-14T03:35:56.450ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
48082024-12-14T03:35:56.450ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
48092024-12-14T03:35:56.455ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
48102024-12-14T03:35:56.455ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
48112024-12-14T03:35:56.458ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 112.424763ms iteration = 3 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
48122024-12-14T03:35:56.460ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
48132024-12-14T03:35:56.460ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
48142024-12-14T03:35:56.463ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
48152024-12-14T03:35:56.463ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
48162024-12-14T03:35:56.464ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
48172024-12-14T03:35:56.464ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
48182024-12-14T03:35:56.464ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
48192024-12-14T03:35:56.465ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48202024-12-14T03:35:56.468ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
48212024-12-14T03:35:56.468ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
48222024-12-14T03:35:56.468ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 122.948883ms iteration = 3 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
48232024-12-14T03:35:56.468ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
48242024-12-14T03:35:56.469ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
48252024-12-14T03:35:56.469ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
48262024-12-14T03:35:56.469ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
48272024-12-14T03:35:56.469ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1 original_time_created = 2024-12-14 03:34:51.368980 UTC target_id = eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1 time_created = 2024-12-14 03:34:51.368980 UTC
48282024-12-14T03:35:56.469ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 124.2627ms iteration = 7 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1","time_created":"2024-12-14T03:34:51.368980Z"}
48292024-12-14T03:35:56.470ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
48302024-12-14T03:35:56.475ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
48312024-12-14T03:35:56.475ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
48322024-12-14T03:35:56.478ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
48332024-12-14T03:35:56.482ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
48342024-12-14T03:35:56.482ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
48352024-12-14T03:35:56.482ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f2440b42-fe10-4107-ab52-b16fa37cfba8", "content-length": "26", "date": "Sat, 14 Dec 2024 03:35:56 GMT"} })
48362024-12-14T03:35:56.482ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
48372024-12-14T03:35:56.484ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
48382024-12-14T03:35:56.484ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = c7a5bbe9-1af5-4e36-80b5-da9e0053b676 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
48392024-12-14T03:35:56.484ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
48402024-12-14T03:35:56.485ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
48412024-12-14T03:35:56.485ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
48422024-12-14T03:35:56.485ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
48432024-12-14T03:35:56.486ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
48442024-12-14T03:35:56.486ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
48452024-12-14T03:35:56.487ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48462024-12-14T03:35:56.487ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "569b51e6-3d93-46f6-a3e6-38deef5543fb", "content-length": "26", "date": "Sat, 14 Dec 2024 03:35:56 GMT"} })
48472024-12-14T03:35:56.487ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
48482024-12-14T03:35:56.488ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48492024-12-14T03:35:56.488ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
48502024-12-14T03:35:56.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
48512024-12-14T03:35:56.489ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
48522024-12-14T03:35:56.490ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
48532024-12-14T03:35:56.490ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
48542024-12-14T03:35:56.490ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
48552024-12-14T03:35:56.490ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
48562024-12-14T03:35:56.490ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
48572024-12-14T03:35:56.490ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
48582024-12-14T03:35:56.491ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 145.342391ms iteration = 3 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
48592024-12-14T03:35:56.492ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = c7a5bbe9-1af5-4e36-80b5-da9e0053b676 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
48602024-12-14T03:35:56.492ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
48612024-12-14T03:35:56.492ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-14 03:35:40.104814 UTC dns_group = internal generation = 1
48622024-12-14T03:35:56.492ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 147.084317ms iteration = 3 status = {"generation":1}
48632024-12-14T03:35:56.497ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8d70e61c-94ed-41ce-b36c-cb904f92c534.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8d70e61c-94ed-41ce-b36c-cb904f92c534.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1162, tv_nsec: 817981355 } })
48642024-12-14T03:35:56.497ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = service_zone_nat_tracker file = nexus/src/app/mod.rs:1103
48652024-12-14T03:35:56.498ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
48662024-12-14T03:35:56.498ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
48672024-12-14T03:35:56.511ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
48682024-12-14T03:35:56.512ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 51f6df17-b3b5-47fe-9a42-d8752f961c5e dns_zone_name = oxide.test found_so_far = 0 version = 2
48692024-12-14T03:35:56.512ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
48702024-12-14T03:35:56.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
48712024-12-14T03:35:56.513ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48722024-12-14T03:35:56.517ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
48732024-12-14T03:35:56.517ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
48742024-12-14T03:35:56.517ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
48752024-12-14T03:35:56.520ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 175.243421ms iteration = 5 status = {"physical_disks_added":0}
48762024-12-14T03:35:56.546ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (changed) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-14T03:34:54.541856Z, time_modified: 2024-12-14T03:34:54.541856Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, db_silo: Silo { identity: SiloIdentity { id: 578bc52c-ac81-41a6-a56b-dfc79805368e, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-14T03:35:40.848931Z, time_modified: 2024-12-14T03:35:40.848931Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(2)) }, tls_certs: [TlsCertificate { digest: "4dfc5e49ed154568e7a05c630983c79e7ad097d55e90f834bee8ffda0c5a5c9e" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, db_silo: Silo { identity: SiloIdentity { id: 578bc52c-ac81-41a6-a56b-dfc79805368e, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-14T03:35:40.848931Z, time_modified: 2024-12-14T03:35:40.848931Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(2)) }, tls_certs: [TlsCertificate { digest: "4dfc5e49ed154568e7a05c630983c79e7ad097d55e90f834bee8ffda0c5a5c9e" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:94
48772024-12-14T03:35:56.546ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 201.237361ms iteration = 3 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"578bc52c-ac81-41a6-a56b-dfc79805368e","tls_certs":["4dfc5e49ed154568e7a05c630983c79e7ad097d55e90f834bee8ffda0c5a5c9e"]}},"default_endpoint":{"silo_id":"578bc52c-ac81-41a6-a56b-dfc79805368e","tls_certs":["4dfc5e49ed154568e7a05c630983c79e7ad097d55e90f834bee8ffda0c5a5c9e"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
48782024-12-14T03:35:56.547ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
48792024-12-14T03:35:56.547ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
48802024-12-14T03:35:56.554ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
48812024-12-14T03:35:56.554ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 208.643529ms iteration = 2 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
48822024-12-14T03:35:56.569ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 zone_address = fd00:1122:3344:101::2
48832024-12-14T03:35:56.569ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
48842024-12-14T03:35:56.569ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6f9c94b3-bdb3-4731-98ca-9afde7276b03", "content-length": "26", "date": "Sat, 14 Dec 2024 03:35:56 GMT"} })
48852024-12-14T03:35:56.569ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
48862024-12-14T03:35:56.570ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200
48872024-12-14T03:35:56.649ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
48882024-12-14T03:35:56.650ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "be8c1c03-00c4-4a83-b8fc-2dc8e4029598", "content-length": "1", "date": "Sat, 14 Dec 2024 03:35:56 GMT"} })
48892024-12-14T03:35:56.651ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
48902024-12-14T03:35:56.651ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
48912024-12-14T03:35:56.661ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
48922024-12-14T03:35:56.679ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
48932024-12-14T03:35:56.679ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "eb07a961-4805-4691-803f-c05819f9c339", "date": "Sat, 14 Dec 2024 03:35:56 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
48942024-12-14T03:35:56.679ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
48952024-12-14T03:35:56.681ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "a95e19f3-f456-48cf-814c-1de435765dff", "date": "Sat, 14 Dec 2024 03:35:56 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
48962024-12-14T03:35:56.681ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
48972024-12-14T03:35:56.682ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
48982024-12-14T03:35:56.682ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 337.374728ms iteration = 4 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
48992024-12-14T03:35:56.692ZINFOnexus (BackgroundTasks): VPC route manager sled 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
49002024-12-14T03:35:56.692ZDEBGnexus (BackgroundTasks): client request SledAgent = 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
49012024-12-14T03:35:56.692ZDEBGnexus (BackgroundTasks): client response SledAgent = 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "df3eb50d-d8ab-4e42-a5c3-32f034a8bc81", "content-length": "372", "date": "Sat, 14 Dec 2024 03:35:56 GMT"} })
49022024-12-14T03:35:56.692ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
49032024-12-14T03:35:56.692ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
49042024-12-14T03:35:56.694ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49052024-12-14T03:35:56.695ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 350.337999ms iteration = 3 status = null
49062024-12-14T03:35:56.695ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
49072024-12-14T03:35:56.695ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
49082024-12-14T03:35:56.695ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
49092024-12-14T03:35:56.697ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49102024-12-14T03:35:56.699ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
49112024-12-14T03:35:56.699ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
49122024-12-14T03:35:56.699ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
49132024-12-14T03:35:56.700ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 51f6df17-b3b5-47fe-9a42-d8752f961c5e dns_zone_name = oxide.test found_so_far = 1 version = 2
49142024-12-14T03:35:56.700ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
49152024-12-14T03:35:56.700ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-14 03:35:40.905586 UTC dns_group = external generation = 2
49162024-12-14T03:35:56.700ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 354.310838ms iteration = 3 status = {"generation":2}
49172024-12-14T03:35:56.731ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
49182024-12-14T03:35:56.731ZDEBGnexus (BackgroundTasks): client request SledAgent = 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
49192024-12-14T03:35:56.731ZDEBGnexus (BackgroundTasks): client response SledAgent = 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "95791d4a-ffd1-420c-a457-e2172512dff5", "date": "Sat, 14 Dec 2024 03:35:56 GMT"} })
49202024-12-14T03:35:56.731ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
49212024-12-14T03:35:56.731ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
49222024-12-14T03:35:56.733ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
49232024-12-14T03:35:56.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
49242024-12-14T03:35:56.737ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
49252024-12-14T03:35:56.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
49262024-12-14T03:35:56.740ZINFOnexus (BackgroundTasks): VPC route manager sled 8d70e61c-94ed-41ce-b36c-cb904f92c534 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
49272024-12-14T03:35:56.740ZDEBGnexus (BackgroundTasks): client request SledAgent = 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
49282024-12-14T03:35:56.741ZDEBGnexus (BackgroundTasks): client response SledAgent = 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "84de02e3-72d3-4c71-98bf-3782ba1245bf", "date": "Sat, 14 Dec 2024 03:35:56 GMT"} })
49292024-12-14T03:35:56.743ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 397.552045ms iteration = 4 status = {}
49302024-12-14T03:35:56.799ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
49312024-12-14T03:35:56.800ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "9325ed03-cede-40a7-8f5e-245ea28482bf", "date": "Sat, 14 Dec 2024 03:35:56 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
49322024-12-14T03:35:56.800ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
49332024-12-14T03:35:56.801ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "cc02a903-5a57-4b44-8880-fecea4016dd6", "date": "Sat, 14 Dec 2024 03:35:56 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
49342024-12-14T03:35:56.801ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
49352024-12-14T03:35:56.804ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "a4252fea-6e92-4303-ad8e-7cc63a7be179", "date": "Sat, 14 Dec 2024 03:35:56 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
49362024-12-14T03:35:56.804ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
49372024-12-14T03:35:56.805ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
49382024-12-14T03:35:56.805ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 459.835163ms iteration = 4 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
49392024-12-14T03:35:56.810ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = service_zone_nat_tracker file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
49402024-12-14T03:35:56.810ZDEBGnexus (MgsClient): client request background_task = service_zone_nat_tracker body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
49412024-12-14T03:35:56.810ZDEBGnexus (MgsClient): client response background_task = service_zone_nat_tracker result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "cd0cd216-28c6-4bf6-8d62-0a858567b426", "content-length": "26", "date": "Sat, 14 Dec 2024 03:35:56 GMT"} })
49422024-12-14T03:35:56.810ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 465.067658ms iteration = 3 status = {}
49432024-12-14T03:35:56.810ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = service_zone_nat_tracker file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
49442024-12-14T03:35:56.812ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = service_zone_nat_tracker file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
49452024-12-14T03:35:56.821ZDEBGnexus (BackgroundTasks): client request SledAgent = 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
49462024-12-14T03:35:56.822ZDEBGnexus (BackgroundTasks): client response SledAgent = 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "33dc390e-8fbe-48a5-b9f9-5a88bc4125af", "content-length": "691", "date": "Sat, 14 Dec 2024 03:35:56 GMT"} })
49472024-12-14T03:35:56.822ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
49482024-12-14T03:35:56.822ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
49492024-12-14T03:35:56.822ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
49502024-12-14T03:35:56.824ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 478.977196ms iteration = 3 status = {}
49512024-12-14T03:35:56.874ZDEBGnexus (DpdClient): client request background_task = service_zone_nat_tracker body = None method = POST uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger
49522024-12-14T03:35:56.874ZDEBGnexus (DpdClient): client response background_task = service_zone_nat_tracker result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger", status: 200, headers: {"content-type": "application/json", "x-request-id": "865139fd-9b83-43ac-b182-47ae035b4179", "content-length": "4", "date": "Sat, 14 Dec 2024 03:35:56 GMT"} })
49532024-12-14T03:35:56.876ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 531.255603ms iteration = 3 status = 6
49542024-12-14T03:35:56.890ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
49552024-12-14T03:35:56.891ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
49562024-12-14T03:35:56.894ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 45ca990e-42e9-4264-be3e-0adfed2cd99b, rack_id: a121ca05-bbee-41bf-b9db-9e03ff035200, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(811a570a-bdaf-4a1b-8eba-0c0e4977f7bb) } rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 switch_location = Switch0
49572024-12-14T03:35:56.894ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
49582024-12-14T03:35:56.894ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
49592024-12-14T03:35:56.947ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
49602024-12-14T03:35:56.948ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "31eae5f0-63c8-4ab9-aa67-75400ac268d6", "content-length": "134", "date": "Sat, 14 Dec 2024 03:35:56 GMT"} })
49612024-12-14T03:35:56.948ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
49622024-12-14T03:35:56.948ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 811a570a-bdaf-4a1b-8eba-0c0e4977f7bb
49632024-12-14T03:35:56.949ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
49642024-12-14T03:35:56.949ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
49652024-12-14T03:35:56.949ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
49662024-12-14T03:35:56.949ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
49672024-12-14T03:35:56.949ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
49682024-12-14T03:35:56.949ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
49692024-12-14T03:35:56.954ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
49702024-12-14T03:35:56.954ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
49712024-12-14T03:35:56.955ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200
49722024-12-14T03:35:56.955ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
49732024-12-14T03:35:56.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
49742024-12-14T03:35:56.963ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
49752024-12-14T03:35:56.964ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "a5ecaaeb-722e-4fdb-ae7e-0eb5df826a1f", "content-length": "2", "date": "Sat, 14 Dec 2024 03:35:56 GMT"} })
49762024-12-14T03:35:56.964ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
49772024-12-14T03:35:56.965ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "dbc34a4c-e1d8-492e-a960-80f2c102e92b", "content-length": "52", "date": "Sat, 14 Dec 2024 03:35:56 GMT"} })
49782024-12-14T03:35:56.965ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 switch_location = Switch0
49792024-12-14T03:35:56.965ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
49802024-12-14T03:35:57.088ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "f5cfcb4c-b954-4b58-8475-51e3768eb321", "date": "Sat, 14 Dec 2024 03:35:56 GMT"} })
49812024-12-14T03:35:57.088ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 switch = Switch0
49822024-12-14T03:35:57.088ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
49832024-12-14T03:35:57.089ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "c9509eee-78bc-45ba-908a-26b888943813", "content-length": "539", "date": "Sat, 14 Dec 2024 03:35:56 GMT"} })
49842024-12-14T03:35:57.089ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
49852024-12-14T03:35:57.089ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
49862024-12-14T03:35:57.099ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
49872024-12-14T03:35:57.099ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
49882024-12-14T03:35:57.103ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
49892024-12-14T03:35:57.104ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
49902024-12-14T03:35:57.106ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
49912024-12-14T03:35:57.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
49922024-12-14T03:35:57.113ZWARNnexus (BackgroundTasks): no bootstore config found in db background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1229 key = network_key rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200
49932024-12-14T03:35:57.113ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
49942024-12-14T03:35:57.113ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
49952024-12-14T03:35:57.124ZINFOnexus (BackgroundTasks): updating bootstore config background_task = switch_port_config_manager config = EarlyNetworkConfig { body: EarlyNetworkConfigBody { ntp_servers: ["0.pool.ntp.org"], rack_network_config: Some(RackNetworkConfigV2 { bfd: [], bgp: [], infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [PortConfigV2 { addresses: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], autoneg: false, bgp_peers: [], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", routes: [RouteConfig { destination: V4(Ipv4Net { addr: 0.0.0.0, width: 0 }), nexthop: 10.151.1.100, rib_priority: None, vlan_id: None }], switch: Switch0, tx_eq: None, uplink_port_fec: Some(None), uplink_port_speed: Speed40G }], rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56 } }) }, generation: 2, schema_version: 2 } file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1286 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200
49962024-12-14T03:35:57.124ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = PUT rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
49972024-12-14T03:35:57.127ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 204, headers: {"x-request-id": "86e4801e-b335-44c9-a3bf-d4ebe3f11955", "date": "Sat, 14 Dec 2024 03:35:57 GMT"} })
49982024-12-14T03:35:57.127ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
49992024-12-14T03:35:57.127ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
50002024-12-14T03:35:57.144ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 798.853765ms iteration = 3 status = {}
50012024-12-14T03:36:05.609ZINFOnexus (dropshot): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:56585 remote_addr = [fd00:1122:3344:101::d]:58979
50022024-12-14T03:36:05.613ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3796 local_addr = [fd00:1122:3344:101::b]:56585 method = GET remote_addr = [fd00:1122:3344:101::d]:58979 req_id = 502850ca-87bf-4d8b-9d54-de4ea899c4dd response_code = 200 uri = /5f2fe413-3c4a-4994-b4a0-995c1da486b1
50032024-12-14T03:36:06.345ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 8 reason = Timeout
50042024-12-14T03:36:06.345ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 8 reason = Timeout
50052024-12-14T03:36:06.345ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50062024-12-14T03:36:06.345ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
50072024-12-14T03:36:06.345ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50082024-12-14T03:36:06.345ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
50092024-12-14T03:36:06.347ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50102024-12-14T03:36:06.349ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
50112024-12-14T03:36:06.349ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50122024-12-14T03:36:06.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50132024-12-14T03:36:06.352ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50142024-12-14T03:36:06.352ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50152024-12-14T03:36:06.353ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50162024-12-14T03:36:06.355ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1, lookup_type: ById(eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1) } result = Ok(())
50172024-12-14T03:36:06.355ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50182024-12-14T03:36:06.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50192024-12-14T03:36:06.369ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1 original_time_created = 2024-12-14 03:34:51.368980 UTC target_id = eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1 time_created = 2024-12-14 03:34:51.368980 UTC
50202024-12-14T03:36:06.369ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.646424ms iteration = 8 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1","time_created":"2024-12-14T03:34:51.368980Z"}
50212024-12-14T03:36:06.374ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
50222024-12-14T03:36:06.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
50232024-12-14T03:36:06.375ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.711635ms iteration = 8 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
50242024-12-14T03:36:14.562ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:48953
50252024-12-14T03:36:14.566ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:48953 req_id = f0072472-09e4-4e3f-99d3-89c8f704cfb4 roles = RoleSet { roles: {} } uri = /metrics/producers
50262024-12-14T03:36:14.566ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:48953 req_id = f0072472-09e4-4e3f-99d3-89c8f704cfb4 resource = Database result = Ok(()) uri = /metrics/producers
50272024-12-14T03:36:14.607ZINFOnexus: assigned collector to new producer collector_id = a321e00a-3126-4ea4-b26d-c0e3eea69166 file = nexus/src/app/oximeter.rs:76 producer_id = b4254c81-0366-4d7b-a36b-86b73748c2f7
50282024-12-14T03:36:14.607ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 40712 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:48953 req_id = f0072472-09e4-4e3f-99d3-89c8f704cfb4 response_code = 201 uri = /metrics/producers
50292024-12-14T03:36:15.610ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1046 local_addr = [fd00:1122:3344:101::b]:56585 method = GET remote_addr = [fd00:1122:3344:101::d]:58979 req_id = 926cac29-f948-4e63-8311-b898a3aa7b8f response_code = 200 uri = /5f2fe413-3c4a-4994-b4a0-995c1da486b1
50302024-12-14T03:36:16.345ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 9 reason = Timeout
50312024-12-14T03:36:16.345ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50322024-12-14T03:36:16.345ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 9 reason = Timeout
50332024-12-14T03:36:16.345ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
50342024-12-14T03:36:16.345ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50352024-12-14T03:36:16.345ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
50362024-12-14T03:36:16.347ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50372024-12-14T03:36:16.348ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
50382024-12-14T03:36:16.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
50392024-12-14T03:36:16.350ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
50402024-12-14T03:36:16.350ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50412024-12-14T03:36:16.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50422024-12-14T03:36:16.350ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 5.101723ms iteration = 9 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
50432024-12-14T03:36:16.352ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50442024-12-14T03:36:16.352ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50452024-12-14T03:36:16.353ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50462024-12-14T03:36:16.356ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1, lookup_type: ById(eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1) } result = Ok(())
50472024-12-14T03:36:16.356ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50482024-12-14T03:36:16.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50492024-12-14T03:36:16.377ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1 original_time_created = 2024-12-14 03:34:51.368980 UTC target_id = eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1 time_created = 2024-12-14 03:34:51.368980 UTC
50502024-12-14T03:36:16.377ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 32.4585ms iteration = 9 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1","time_created":"2024-12-14T03:34:51.368980Z"}
50512024-12-14T03:36:25.600ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:56805 req_id = b8d43950-6529-4da5-b96d-a242e02265ba roles = RoleSet { roles: {} } uri = /metrics/collectors/a321e00a-3126-4ea4-b26d-c0e3eea69166/producers?sort_by=id_ascending
50522024-12-14T03:36:25.600ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:56805 req_id = b8d43950-6529-4da5-b96d-a242e02265ba resource = Database result = Ok(()) uri = /metrics/collectors/a321e00a-3126-4ea4-b26d-c0e3eea69166/producers?sort_by=id_ascending
50532024-12-14T03:36:25.603ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3529 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:56805 req_id = b8d43950-6529-4da5-b96d-a242e02265ba response_code = 200 uri = /metrics/collectors/a321e00a-3126-4ea4-b26d-c0e3eea69166/producers?sort_by=id_ascending
50542024-12-14T03:36:25.603ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:56805 req_id = 0c050f45-144c-4d6e-8313-6673ad8ee00f roles = RoleSet { roles: {} } uri = /metrics/collectors/a321e00a-3126-4ea4-b26d-c0e3eea69166/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlOGQ5NjQ2Zi1hNTQxLTRjMTEtYjViMi1mOTUzNDI3Y2EyZjMifX0%3D
50552024-12-14T03:36:25.604ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:56805 req_id = 0c050f45-144c-4d6e-8313-6673ad8ee00f resource = Database result = Ok(()) uri = /metrics/collectors/a321e00a-3126-4ea4-b26d-c0e3eea69166/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlOGQ5NjQ2Zi1hNTQxLTRjMTEtYjViMi1mOTUzNDI3Y2EyZjMifX0%3D
50562024-12-14T03:36:25.606ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2479 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:56805 req_id = 0c050f45-144c-4d6e-8313-6673ad8ee00f response_code = 200 uri = /metrics/collectors/a321e00a-3126-4ea4-b26d-c0e3eea69166/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlOGQ5NjQ2Zi1hNTQxLTRjMTEtYjViMi1mOTUzNDI3Y2EyZjMifX0%3D
50572024-12-14T03:36:25.610ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1056 local_addr = [fd00:1122:3344:101::b]:56585 method = GET remote_addr = [fd00:1122:3344:101::d]:58979 req_id = 581b3c1b-090c-4359-8ea3-154ece938478 response_code = 200 uri = /5f2fe413-3c4a-4994-b4a0-995c1da486b1
50582024-12-14T03:36:26.344ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 4 reason = Timeout
50592024-12-14T03:36:26.344ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 4 reason = Timeout
50602024-12-14T03:36:26.344ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
50612024-12-14T03:36:26.344ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
50622024-12-14T03:36:26.344ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 4 reason = Timeout
50632024-12-14T03:36:26.344ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 4 reason = Timeout
50642024-12-14T03:36:26.344ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 4 reason = Timeout
50652024-12-14T03:36:26.344ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
50662024-12-14T03:36:26.344ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
50672024-12-14T03:36:26.344ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 4 reason = Timeout
50682024-12-14T03:36:26.344ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 4 reason = Timeout
50692024-12-14T03:36:26.344ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
50702024-12-14T03:36:26.344ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
50712024-12-14T03:36:26.344ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 5 reason = Timeout
50722024-12-14T03:36:26.344ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
50732024-12-14T03:36:26.344ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 6 reason = Timeout
50742024-12-14T03:36:26.344ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
50752024-12-14T03:36:26.344ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 4 reason = Timeout
50762024-12-14T03:36:26.344ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
50772024-12-14T03:36:26.344ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
50782024-12-14T03:36:26.344ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 4 reason = Timeout
50792024-12-14T03:36:26.344ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
50802024-12-14T03:36:26.344ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 10 reason = Timeout
50812024-12-14T03:36:26.344ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 4 reason = Timeout
50822024-12-14T03:36:26.344ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50832024-12-14T03:36:26.344ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
50842024-12-14T03:36:26.344ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 10 reason = Timeout
50852024-12-14T03:36:26.344ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
50862024-12-14T03:36:26.344ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
50872024-12-14T03:36:26.345ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
50882024-12-14T03:36:26.345ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
50892024-12-14T03:36:26.345ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
50902024-12-14T03:36:26.345ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
50912024-12-14T03:36:26.345ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
50922024-12-14T03:36:26.345ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
50932024-12-14T03:36:26.345ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
50942024-12-14T03:36:26.345ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
50952024-12-14T03:36:26.345ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50962024-12-14T03:36:26.345ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
50972024-12-14T03:36:26.345ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
50982024-12-14T03:36:26.345ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
50992024-12-14T03:36:26.345ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
51002024-12-14T03:36:26.345ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 4 reason = Timeout
51012024-12-14T03:36:26.345ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 4 reason = Timeout
51022024-12-14T03:36:26.345ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
51032024-12-14T03:36:26.345ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
51042024-12-14T03:36:26.345ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 4 reason = Timeout
51052024-12-14T03:36:26.345ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
51062024-12-14T03:36:26.346ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
51072024-12-14T03:36:26.346ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
51082024-12-14T03:36:26.346ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
51092024-12-14T03:36:26.346ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51102024-12-14T03:36:26.347ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.146423ms iteration = 4 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
51112024-12-14T03:36:26.348ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8d70e61c-94ed-41ce-b36c-cb904f92c534.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8d70e61c-94ed-41ce-b36c-cb904f92c534.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1192, tv_nsec: 668832536 } })
51122024-12-14T03:36:26.348ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51132024-12-14T03:36:26.348ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8d70e61c-94ed-41ce-b36c-cb904f92c534.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8d70e61c-94ed-41ce-b36c-cb904f92c534.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1192, tv_nsec: 669027050 } })
51142024-12-14T03:36:26.348ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
51152024-12-14T03:36:26.349ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
51162024-12-14T03:36:26.349ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
51172024-12-14T03:36:26.349ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
51182024-12-14T03:36:26.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
51192024-12-14T03:36:26.350ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
51202024-12-14T03:36:26.350ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
51212024-12-14T03:36:26.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
51222024-12-14T03:36:26.351ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51232024-12-14T03:36:26.352ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51242024-12-14T03:36:26.352ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51252024-12-14T03:36:26.353ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51262024-12-14T03:36:26.353ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
51272024-12-14T03:36:26.353ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
51282024-12-14T03:36:26.354ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
51292024-12-14T03:36:26.354ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
51302024-12-14T03:36:26.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
51312024-12-14T03:36:26.355ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
51322024-12-14T03:36:26.355ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
51332024-12-14T03:36:26.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
51342024-12-14T03:36:26.356ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
51352024-12-14T03:36:26.356ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
51362024-12-14T03:36:26.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
51372024-12-14T03:36:26.356ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
51382024-12-14T03:36:26.356ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51392024-12-14T03:36:26.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51402024-12-14T03:36:26.358ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 12.518221ms iteration = 4 status = {"errors":[],"garbage_collect_requested":[]}
51412024-12-14T03:36:26.359ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
51422024-12-14T03:36:26.359ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
51432024-12-14T03:36:26.359ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
51442024-12-14T03:36:26.359ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
51452024-12-14T03:36:26.359ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
51462024-12-14T03:36:26.359ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
51472024-12-14T03:36:26.359ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
51482024-12-14T03:36:26.359ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
51492024-12-14T03:36:26.359ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
51502024-12-14T03:36:26.360ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 15.250016ms iteration = 10 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
51512024-12-14T03:36:26.360ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
51522024-12-14T03:36:26.360ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51532024-12-14T03:36:26.361ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8d70e61c-94ed-41ce-b36c-cb904f92c534.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8d70e61c-94ed-41ce-b36c-cb904f92c534.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1192, tv_nsec: 681252635 } })
51542024-12-14T03:36:26.361ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200
51552024-12-14T03:36:26.361ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
51562024-12-14T03:36:26.361ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
51572024-12-14T03:36:26.362ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
51582024-12-14T03:36:26.362ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
51592024-12-14T03:36:26.363ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
51602024-12-14T03:36:26.366ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51612024-12-14T03:36:26.366ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51622024-12-14T03:36:26.368ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51632024-12-14T03:36:26.370ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
51642024-12-14T03:36:26.370ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
51652024-12-14T03:36:26.371ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
51662024-12-14T03:36:26.372ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
51672024-12-14T03:36:26.372ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 28.026632ms iteration = 4 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
51682024-12-14T03:36:26.394ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
51692024-12-14T03:36:26.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
51702024-12-14T03:36:26.396ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
51712024-12-14T03:36:26.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
51722024-12-14T03:36:26.397ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
51732024-12-14T03:36:26.397ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
51742024-12-14T03:36:26.399ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
51752024-12-14T03:36:26.399ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
51762024-12-14T03:36:26.399ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
51772024-12-14T03:36:26.399ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
51782024-12-14T03:36:26.401ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 55.761847ms iteration = 4 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
51792024-12-14T03:36:26.401ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 56.108685ms iteration = 4 status = {"errors":[],"records_set_to_done":[]}
51802024-12-14T03:36:26.404ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 59.523553ms iteration = 4 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
51812024-12-14T03:36:26.407ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
51822024-12-14T03:36:26.407ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
51832024-12-14T03:36:26.407ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
51842024-12-14T03:36:26.407ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
51852024-12-14T03:36:26.409ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
51862024-12-14T03:36:26.409ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
51872024-12-14T03:36:26.409ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 64.613874ms iteration = 4 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
51882024-12-14T03:36:26.410ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51892024-12-14T03:36:26.413ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1, lookup_type: ById(eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1) } result = Ok(())
51902024-12-14T03:36:26.413ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51912024-12-14T03:36:26.413ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51922024-12-14T03:36:26.427ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1 original_time_created = 2024-12-14 03:34:51.368980 UTC target_id = eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1 time_created = 2024-12-14 03:34:51.368980 UTC
51932024-12-14T03:36:26.427ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 82.895439ms iteration = 10 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1","time_created":"2024-12-14T03:34:51.368980Z"}
51942024-12-14T03:36:26.437ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 92.567374ms iteration = 4 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
51952024-12-14T03:36:26.444ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51962024-12-14T03:36:26.447ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 8d70e61c-94ed-41ce-b36c-cb904f92c534, lookup_type: ById(8d70e61c-94ed-41ce-b36c-cb904f92c534) } result = Ok(())
51972024-12-14T03:36:26.447ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
51982024-12-14T03:36:26.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
51992024-12-14T03:36:26.449ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 104.924431ms iteration = 4 status = 0
52002024-12-14T03:36:26.464ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
52012024-12-14T03:36:26.464ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
52022024-12-14T03:36:26.465ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "3393ada3-142b-4cce-921c-1249453e7613", "content-length": "26", "date": "Sat, 14 Dec 2024 03:36:26 GMT"} })
52032024-12-14T03:36:26.465ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
52042024-12-14T03:36:26.466ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
52052024-12-14T03:36:26.477ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
52062024-12-14T03:36:26.477ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
52072024-12-14T03:36:26.479ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52082024-12-14T03:36:26.480ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
52092024-12-14T03:36:26.480ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
52102024-12-14T03:36:26.481ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
52112024-12-14T03:36:26.482ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52122024-12-14T03:36:26.484ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
52132024-12-14T03:36:26.484ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
52142024-12-14T03:36:26.484ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 139.83095ms iteration = 6 status = {"physical_disks_added":0}
52152024-12-14T03:36:26.484ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
52162024-12-14T03:36:26.553ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
52172024-12-14T03:36:26.554ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
52182024-12-14T03:36:26.554ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4e0e02d8-aec0-4954-a1ac-4f3173ba44ad", "content-length": "26", "date": "Sat, 14 Dec 2024 03:36:26 GMT"} })
52192024-12-14T03:36:26.554ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
52202024-12-14T03:36:26.556ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
52212024-12-14T03:36:26.579ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 zone_address = fd00:1122:3344:101::2
52222024-12-14T03:36:26.579ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
52232024-12-14T03:36:26.579ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "48f378ba-c242-4704-9b58-7fd3f1329b17", "content-length": "26", "date": "Sat, 14 Dec 2024 03:36:26 GMT"} })
52242024-12-14T03:36:26.579ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
52252024-12-14T03:36:26.581ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200
52262024-12-14T03:36:26.635ZDEBGnexus (BackgroundTasks): client request SledAgent = 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
52272024-12-14T03:36:26.636ZDEBGnexus (BackgroundTasks): client response SledAgent = 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "f42ae434-0ff4-4282-8cd7-88da6e1dbe35", "content-length": "691", "date": "Sat, 14 Dec 2024 03:36:26 GMT"} })
52282024-12-14T03:36:26.636ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
52292024-12-14T03:36:26.636ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
52302024-12-14T03:36:26.636ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
52312024-12-14T03:36:26.637ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 292.865476ms iteration = 4 status = {}
52322024-12-14T03:36:26.756ZINFOnexus (BackgroundTasks): VPC route manager sled 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
52332024-12-14T03:36:26.756ZDEBGnexus (BackgroundTasks): client request SledAgent = 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
52342024-12-14T03:36:26.756ZDEBGnexus (BackgroundTasks): client response SledAgent = 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "68620eb7-5122-4011-8f90-0fd1e4927def", "content-length": "372", "date": "Sat, 14 Dec 2024 03:36:26 GMT"} })
52352024-12-14T03:36:26.756ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
52362024-12-14T03:36:26.756ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
52372024-12-14T03:36:26.792ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
52382024-12-14T03:36:26.792ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "6c3a4499-c116-42bc-a6c4-d1cf78b202bd", "content-length": "1", "date": "Sat, 14 Dec 2024 03:36:25 GMT"} })
52392024-12-14T03:36:26.794ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
52402024-12-14T03:36:26.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
52412024-12-14T03:36:26.796ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
52422024-12-14T03:36:26.796ZDEBGnexus (BackgroundTasks): client request SledAgent = 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
52432024-12-14T03:36:26.796ZDEBGnexus (BackgroundTasks): client response SledAgent = 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "a7806b46-ce08-4590-b10d-383392521173", "date": "Sat, 14 Dec 2024 03:36:26 GMT"} })
52442024-12-14T03:36:26.796ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
52452024-12-14T03:36:26.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
52462024-12-14T03:36:26.796ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 452.100596ms iteration = 4 status = null
52472024-12-14T03:36:26.798ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
52482024-12-14T03:36:26.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
52492024-12-14T03:36:26.801ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
52502024-12-14T03:36:26.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
52512024-12-14T03:36:26.805ZINFOnexus (BackgroundTasks): VPC route manager sled 8d70e61c-94ed-41ce-b36c-cb904f92c534 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
52522024-12-14T03:36:26.805ZDEBGnexus (BackgroundTasks): client request SledAgent = 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
52532024-12-14T03:36:26.805ZDEBGnexus (BackgroundTasks): client response SledAgent = 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "52981b89-b06d-48f5-b470-50f7f3d9f1eb", "date": "Sat, 14 Dec 2024 03:36:26 GMT"} })
52542024-12-14T03:36:26.807ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 462.340062ms iteration = 5 status = {}
52552024-12-14T03:36:26.813ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 468.898284ms iteration = 4 status = {}
52562024-12-14T03:36:26.843ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52572024-12-14T03:36:26.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52582024-12-14T03:36:26.844ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 45ca990e-42e9-4264-be3e-0adfed2cd99b, rack_id: a121ca05-bbee-41bf-b9db-9e03ff035200, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(811a570a-bdaf-4a1b-8eba-0c0e4977f7bb) } rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 switch_location = Switch0
52592024-12-14T03:36:26.844ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52602024-12-14T03:36:26.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52612024-12-14T03:36:26.854ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
52622024-12-14T03:36:26.854ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "dedb11f5-86e8-45cc-a7b2-1268539d3936", "content-length": "134", "date": "Sat, 14 Dec 2024 03:36:25 GMT"} })
52632024-12-14T03:36:26.854ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
52642024-12-14T03:36:26.854ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 811a570a-bdaf-4a1b-8eba-0c0e4977f7bb
52652024-12-14T03:36:26.854ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
52662024-12-14T03:36:26.854ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
52672024-12-14T03:36:26.854ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
52682024-12-14T03:36:26.854ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
52692024-12-14T03:36:26.854ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
52702024-12-14T03:36:26.854ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
52712024-12-14T03:36:26.854ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
52722024-12-14T03:36:26.854ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
52732024-12-14T03:36:26.855ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200
52742024-12-14T03:36:26.855ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52752024-12-14T03:36:26.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52762024-12-14T03:36:26.857ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
52772024-12-14T03:36:26.857ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "68fe6aa5-461b-4ad1-8aa8-58ca275f6bb5", "content-length": "2", "date": "Sat, 14 Dec 2024 03:36:25 GMT"} })
52782024-12-14T03:36:26.857ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
52792024-12-14T03:36:26.857ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "0d19425d-4489-4e23-b2de-0e587e87d84f", "content-length": "52", "date": "Sat, 14 Dec 2024 03:36:25 GMT"} })
52802024-12-14T03:36:26.857ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 switch_location = Switch0
52812024-12-14T03:36:26.857ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
52822024-12-14T03:36:26.951ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "76ffa6f3-3307-4616-a758-33a56c941fb9", "date": "Sat, 14 Dec 2024 03:36:26 GMT"} })
52832024-12-14T03:36:26.951ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 switch = Switch0
52842024-12-14T03:36:26.951ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
52852024-12-14T03:36:26.951ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "5b5034f2-fe7a-4c11-956a-6fec10ab184e", "content-length": "682", "date": "Sat, 14 Dec 2024 03:36:26 GMT"} })
52862024-12-14T03:36:26.952ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52872024-12-14T03:36:26.952ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52882024-12-14T03:36:26.956ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52892024-12-14T03:36:26.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52902024-12-14T03:36:26.959ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52912024-12-14T03:36:26.960ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52922024-12-14T03:36:26.962ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52932024-12-14T03:36:26.962ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52942024-12-14T03:36:26.968ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 623.558252ms iteration = 4 status = {}
52952024-12-14T03:36:35.611ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1149 local_addr = [fd00:1122:3344:101::b]:56585 method = GET remote_addr = [fd00:1122:3344:101::d]:58979 req_id = 7c4714e0-c39f-43c3-9054-6e8c3a1f30ea response_code = 200 uri = /5f2fe413-3c4a-4994-b4a0-995c1da486b1
52962024-12-14T03:36:36.344ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 11 reason = Timeout
52972024-12-14T03:36:36.344ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
52982024-12-14T03:36:36.344ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 11 reason = Timeout
52992024-12-14T03:36:36.344ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53002024-12-14T03:36:36.345ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
53012024-12-14T03:36:36.345ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53022024-12-14T03:36:36.346ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
53032024-12-14T03:36:36.346ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
53042024-12-14T03:36:36.347ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53052024-12-14T03:36:36.348ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.755105ms iteration = 11 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
53062024-12-14T03:36:36.350ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
53072024-12-14T03:36:36.350ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53082024-12-14T03:36:36.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53092024-12-14T03:36:36.351ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53102024-12-14T03:36:36.352ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53112024-12-14T03:36:36.353ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53122024-12-14T03:36:36.356ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1, lookup_type: ById(eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1) } result = Ok(())
53132024-12-14T03:36:36.356ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53142024-12-14T03:36:36.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53152024-12-14T03:36:36.364ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1 original_time_created = 2024-12-14 03:34:51.368980 UTC target_id = eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1 time_created = 2024-12-14 03:34:51.368980 UTC
53162024-12-14T03:36:36.364ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.570112ms iteration = 11 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1","time_created":"2024-12-14T03:34:51.368980Z"}
53172024-12-14T03:36:45.610ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1049 local_addr = [fd00:1122:3344:101::b]:56585 method = GET remote_addr = [fd00:1122:3344:101::d]:58979 req_id = be253c7f-5d76-4fca-9219-9e73554752cb response_code = 200 uri = /5f2fe413-3c4a-4994-b4a0-995c1da486b1
53182024-12-14T03:36:46.345ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 12 reason = Timeout
53192024-12-14T03:36:46.345ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
53202024-12-14T03:36:46.345ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 12 reason = Timeout
53212024-12-14T03:36:46.345ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53222024-12-14T03:36:46.345ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
53232024-12-14T03:36:46.345ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53242024-12-14T03:36:46.348ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53252024-12-14T03:36:46.350ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
53262024-12-14T03:36:46.350ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53272024-12-14T03:36:46.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53282024-12-14T03:36:46.352ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53292024-12-14T03:36:46.352ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53302024-12-14T03:36:46.354ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53312024-12-14T03:36:46.356ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1, lookup_type: ById(eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1) } result = Ok(())
53322024-12-14T03:36:46.356ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53332024-12-14T03:36:46.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53342024-12-14T03:36:46.368ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1 original_time_created = 2024-12-14 03:34:51.368980 UTC target_id = eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1 time_created = 2024-12-14 03:34:51.368980 UTC
53352024-12-14T03:36:46.368ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.865528ms iteration = 12 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1","time_created":"2024-12-14T03:34:51.368980Z"}
53362024-12-14T03:36:46.379ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
53372024-12-14T03:36:46.379ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
53382024-12-14T03:36:46.407ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 62.134845ms iteration = 12 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
53392024-12-14T03:36:51.148ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:45227
53402024-12-14T03:36:51.148ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:45227 req_id = d1f8a917-45cd-4ab2-b7f1-38d1c0797e11 roles = RoleSet { roles: {} } uri = /metrics/producers
53412024-12-14T03:36:51.149ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:45227 req_id = d1f8a917-45cd-4ab2-b7f1-38d1c0797e11 resource = Database result = Ok(()) uri = /metrics/producers
53422024-12-14T03:36:51.183ZINFOnexus: assigned collector to new producer collector_id = a321e00a-3126-4ea4-b26d-c0e3eea69166 file = nexus/src/app/oximeter.rs:76 producer_id = c4ff451e-ab57-4adc-b747-11f26d0ffcfa
53432024-12-14T03:36:51.183ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 34513 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:45227 req_id = d1f8a917-45cd-4ab2-b7f1-38d1c0797e11 response_code = 201 uri = /metrics/producers
53442024-12-14T03:36:55.600ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:56805 req_id = 6bfe0c4a-9303-4309-ba8f-53ecf91928f0 roles = RoleSet { roles: {} } uri = /metrics/collectors/a321e00a-3126-4ea4-b26d-c0e3eea69166/producers?sort_by=id_ascending
53452024-12-14T03:36:55.600ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:56805 req_id = 6bfe0c4a-9303-4309-ba8f-53ecf91928f0 resource = Database result = Ok(()) uri = /metrics/collectors/a321e00a-3126-4ea4-b26d-c0e3eea69166/producers?sort_by=id_ascending
53462024-12-14T03:36:55.604ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4440 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:56805 req_id = 6bfe0c4a-9303-4309-ba8f-53ecf91928f0 response_code = 200 uri = /metrics/collectors/a321e00a-3126-4ea4-b26d-c0e3eea69166/producers?sort_by=id_ascending
53472024-12-14T03:36:55.605ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:56805 req_id = 3a901277-db43-4b69-a6d0-d44d0bee356d roles = RoleSet { roles: {} } uri = /metrics/collectors/a321e00a-3126-4ea4-b26d-c0e3eea69166/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlOGQ5NjQ2Zi1hNTQxLTRjMTEtYjViMi1mOTUzNDI3Y2EyZjMifX0%3D
53482024-12-14T03:36:55.605ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:56805 req_id = 3a901277-db43-4b69-a6d0-d44d0bee356d resource = Database result = Ok(()) uri = /metrics/collectors/a321e00a-3126-4ea4-b26d-c0e3eea69166/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlOGQ5NjQ2Zi1hNTQxLTRjMTEtYjViMi1mOTUzNDI3Y2EyZjMifX0%3D
53492024-12-14T03:36:55.608ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2856 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:56805 req_id = 3a901277-db43-4b69-a6d0-d44d0bee356d response_code = 200 uri = /metrics/collectors/a321e00a-3126-4ea4-b26d-c0e3eea69166/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlOGQ5NjQ2Zi1hNTQxLTRjMTEtYjViMi1mOTUzNDI3Y2EyZjMifX0%3D
53502024-12-14T03:36:55.611ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 998 local_addr = [fd00:1122:3344:101::b]:56585 method = GET remote_addr = [fd00:1122:3344:101::d]:58979 req_id = fef1f78b-6e03-4505-824f-2712e6976986 response_code = 200 uri = /5f2fe413-3c4a-4994-b4a0-995c1da486b1
53512024-12-14T03:36:56.344ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 5 reason = Timeout
53522024-12-14T03:36:56.344ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 4 reason = Timeout
53532024-12-14T03:36:56.344ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
53542024-12-14T03:36:56.344ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
53552024-12-14T03:36:56.344ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
53562024-12-14T03:36:56.344ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 5 reason = Timeout
53572024-12-14T03:36:56.345ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 5 reason = Timeout
53582024-12-14T03:36:56.345ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
53592024-12-14T03:36:56.345ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 13 reason = Timeout
53602024-12-14T03:36:56.345ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 4 reason = Timeout
53612024-12-14T03:36:56.345ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 5 reason = Timeout
53622024-12-14T03:36:56.345ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
53632024-12-14T03:36:56.345ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 5 reason = Timeout
53642024-12-14T03:36:56.345ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
53652024-12-14T03:36:56.345ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 5 reason = Timeout
53662024-12-14T03:36:56.345ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
53672024-12-14T03:36:56.345ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
53682024-12-14T03:36:56.345ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
53692024-12-14T03:36:56.345ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 4 reason = Timeout
53702024-12-14T03:36:56.345ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 5 reason = Timeout
53712024-12-14T03:36:56.345ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
53722024-12-14T03:36:56.345ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 5 reason = Timeout
53732024-12-14T03:36:56.345ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
53742024-12-14T03:36:56.345ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 4 reason = Timeout
53752024-12-14T03:36:56.345ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1
53762024-12-14T03:36:56.345ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 13.13\u{b5}s iteration = 4 status = {"enabled":false,"target_id":"eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1"}
53772024-12-14T03:36:56.345ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 5 reason = Timeout
53782024-12-14T03:36:56.345ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
53792024-12-14T03:36:56.345ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 3 reason = Timeout
53802024-12-14T03:36:56.345ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 4 reason = Timeout
53812024-12-14T03:36:56.345ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-14 03:26:56.345104480 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
53822024-12-14T03:36:56.345ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
53832024-12-14T03:36:56.345ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
53842024-12-14T03:36:56.345ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 5 reason = Timeout
53852024-12-14T03:36:56.345ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
53862024-12-14T03:36:56.345ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 5 reason = Timeout
53872024-12-14T03:36:56.345ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
53882024-12-14T03:36:56.345ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 3 reason = Timeout
53892024-12-14T03:36:56.345ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
53902024-12-14T03:36:56.345ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
53912024-12-14T03:36:56.345ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 13 reason = Timeout
53922024-12-14T03:36:56.345ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53932024-12-14T03:36:56.345ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 7 reason = Timeout
53942024-12-14T03:36:56.345ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
53952024-12-14T03:36:56.345ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 5 reason = Timeout
53962024-12-14T03:36:56.345ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
53972024-12-14T03:36:56.345ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 6 reason = Timeout
53982024-12-14T03:36:56.345ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
53992024-12-14T03:36:56.345ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
54002024-12-14T03:36:56.345ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 4 reason = Timeout
54012024-12-14T03:36:56.345ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 3 reason = Timeout
54022024-12-14T03:36:56.345ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
54032024-12-14T03:36:56.345ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 3 reason = Timeout
54042024-12-14T03:36:56.345ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 3 reason = Timeout
54052024-12-14T03:36:56.345ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
54062024-12-14T03:36:56.345ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
54072024-12-14T03:36:56.345ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
54082024-12-14T03:36:56.345ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
54092024-12-14T03:36:56.345ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
54102024-12-14T03:36:56.345ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
54112024-12-14T03:36:56.345ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
54122024-12-14T03:36:56.345ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
54132024-12-14T03:36:56.345ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
54142024-12-14T03:36:56.345ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
54152024-12-14T03:36:56.345ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 5 reason = Timeout
54162024-12-14T03:36:56.345ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 5 reason = Timeout
54172024-12-14T03:36:56.345ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
54182024-12-14T03:36:56.345ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 5 reason = Timeout
54192024-12-14T03:36:56.345ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
54202024-12-14T03:36:56.345ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
54212024-12-14T03:36:56.345ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
54222024-12-14T03:36:56.345ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
54232024-12-14T03:36:56.345ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
54242024-12-14T03:36:56.345ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
54252024-12-14T03:36:56.345ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
54262024-12-14T03:36:56.345ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
54272024-12-14T03:36:56.345ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
54282024-12-14T03:36:56.345ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("3db8556d-0ae0-4824-8953-f38d8eef7409.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7b672843-049d-4d9c-b0a2-21d7b6323621.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("db39fe07-65c4-451a-a2bd-78fcdfc10040.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("db39fe07-65c4-451a-a2bd-78fcdfc10040.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1222, tv_nsec: 665913365 } })
54292024-12-14T03:36:56.345ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54302024-12-14T03:36:56.345ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
54312024-12-14T03:36:56.345ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("28f528f1-3159-4fbc-9304-37b7e4a50ae8.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7274e15f-a5f6-4975-bcdd-a2ef890c0230.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("7274e15f-a5f6-4975-bcdd-a2ef890c0230.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1222, tv_nsec: 665925665 } })
54322024-12-14T03:36:56.345ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
54332024-12-14T03:36:56.346ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
54342024-12-14T03:36:56.346ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
54352024-12-14T03:36:56.346ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
54362024-12-14T03:36:56.346ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
54372024-12-14T03:36:56.346ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
54382024-12-14T03:36:56.346ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
54392024-12-14T03:36:56.346ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
54402024-12-14T03:36:56.346ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
54412024-12-14T03:36:56.346ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.066262ms iteration = 4 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
54422024-12-14T03:36:56.346ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
54432024-12-14T03:36:56.346ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.4725ms iteration = 4 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
54442024-12-14T03:36:56.346ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
54452024-12-14T03:36:56.347ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54462024-12-14T03:36:56.348ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.002451ms iteration = 5 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
54472024-12-14T03:36:56.348ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8d70e61c-94ed-41ce-b36c-cb904f92c534.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8d70e61c-94ed-41ce-b36c-cb904f92c534.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1222, tv_nsec: 668972637 } })
54482024-12-14T03:36:56.349ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
54492024-12-14T03:36:56.349ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8d70e61c-94ed-41ce-b36c-cb904f92c534.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8d70e61c-94ed-41ce-b36c-cb904f92c534.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1222, tv_nsec: 669633120 } })
54502024-12-14T03:36:56.349ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
54512024-12-14T03:36:56.349ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
54522024-12-14T03:36:56.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
54532024-12-14T03:36:56.349ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
54542024-12-14T03:36:56.350ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-14 03:26:56.345104480 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
54552024-12-14T03:36:56.350ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 5.424529ms iteration = 3 status = {"expiration":"2024-12-14T03:26:56.345104480Z","pruned":[]}
54562024-12-14T03:36:56.351ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
54572024-12-14T03:36:56.351ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
54582024-12-14T03:36:56.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
54592024-12-14T03:36:56.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
54602024-12-14T03:36:56.352ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54612024-12-14T03:36:56.352ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54622024-12-14T03:36:56.352ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54632024-12-14T03:36:56.353ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54642024-12-14T03:36:56.355ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
54652024-12-14T03:36:56.355ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
54662024-12-14T03:36:56.355ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
54672024-12-14T03:36:56.355ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
54682024-12-14T03:36:56.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
54692024-12-14T03:36:56.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
54702024-12-14T03:36:56.355ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
54712024-12-14T03:36:56.355ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
54722024-12-14T03:36:56.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
54732024-12-14T03:36:56.356ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
54742024-12-14T03:36:56.356ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
54752024-12-14T03:36:56.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
54762024-12-14T03:36:56.356ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
54772024-12-14T03:36:56.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
54782024-12-14T03:36:56.357ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54792024-12-14T03:36:56.358ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54802024-12-14T03:36:56.358ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 13.382428ms iteration = 3 status = {"errors":[],"found_port_ok":[]}
54812024-12-14T03:36:56.359ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
54822024-12-14T03:36:56.359ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
54832024-12-14T03:36:56.359ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
54842024-12-14T03:36:56.359ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
54852024-12-14T03:36:56.360ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
54862024-12-14T03:36:56.360ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
54872024-12-14T03:36:56.361ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
54882024-12-14T03:36:56.361ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
54892024-12-14T03:36:56.361ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
54902024-12-14T03:36:56.361ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54912024-12-14T03:36:56.361ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
54922024-12-14T03:36:56.361ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54932024-12-14T03:36:56.362ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54942024-12-14T03:36:56.362ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 16.883318ms iteration = 5 status = {"errors":[],"records_set_to_done":[]}
54952024-12-14T03:36:56.363ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54962024-12-14T03:36:56.365ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
54972024-12-14T03:36:56.365ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
54982024-12-14T03:36:56.365ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
54992024-12-14T03:36:56.366ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
55002024-12-14T03:36:56.367ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55012024-12-14T03:36:56.368ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8d70e61c-94ed-41ce-b36c-cb904f92c534.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8d70e61c-94ed-41ce-b36c-cb904f92c534.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1222, tv_nsec: 687994787 } })
55022024-12-14T03:36:56.368ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200
55032024-12-14T03:36:56.369ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
55042024-12-14T03:36:56.369ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
55052024-12-14T03:36:56.371ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
55062024-12-14T03:36:56.373ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55072024-12-14T03:36:56.374ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
55082024-12-14T03:36:56.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
55092024-12-14T03:36:56.375ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 30.169564ms iteration = 5 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
55102024-12-14T03:36:56.375ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
55112024-12-14T03:36:56.375ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
55122024-12-14T03:36:56.375ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
55132024-12-14T03:36:56.375ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
55142024-12-14T03:36:56.375ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
55152024-12-14T03:36:56.376ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
55162024-12-14T03:36:56.376ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
55172024-12-14T03:36:56.376ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55182024-12-14T03:36:56.377ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55192024-12-14T03:36:56.378ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55202024-12-14T03:36:56.379ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55212024-12-14T03:36:56.381ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
55222024-12-14T03:36:56.381ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
55232024-12-14T03:36:56.382ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
55242024-12-14T03:36:56.383ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
55252024-12-14T03:36:56.384ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
55262024-12-14T03:36:56.384ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1, lookup_type: ById(eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1) } result = Ok(())
55272024-12-14T03:36:56.384ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55282024-12-14T03:36:56.384ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55292024-12-14T03:36:56.391ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
55302024-12-14T03:36:56.391ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
55312024-12-14T03:36:56.391ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 46.212106ms iteration = 3 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
55322024-12-14T03:36:56.393ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 47.658335ms iteration = 5 status = {"errors":[],"garbage_collect_requested":[]}
55332024-12-14T03:36:56.399ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1 original_time_created = 2024-12-14 03:34:51.368980 UTC target_id = eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1 time_created = 2024-12-14 03:34:51.368980 UTC
55342024-12-14T03:36:56.399ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 53.89535ms iteration = 13 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1","time_created":"2024-12-14T03:34:51.368980Z"}
55352024-12-14T03:36:56.399ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
55362024-12-14T03:36:56.399ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
55372024-12-14T03:36:56.404ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 59.159925ms iteration = 5 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
55382024-12-14T03:36:56.404ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
55392024-12-14T03:36:56.404ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 59.737407ms iteration = 13 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
55402024-12-14T03:36:56.404ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
55412024-12-14T03:36:56.406ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
55422024-12-14T03:36:56.407ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
55432024-12-14T03:36:56.410ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
55442024-12-14T03:36:56.410ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
55452024-12-14T03:36:56.410ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
55462024-12-14T03:36:56.410ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
55472024-12-14T03:36:56.410ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
55482024-12-14T03:36:56.411ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 65.634275ms iteration = 5 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
55492024-12-14T03:36:56.412ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
55502024-12-14T03:36:56.412ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 67.442861ms iteration = 5 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
55512024-12-14T03:36:56.412ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55522024-12-14T03:36:56.415ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
55532024-12-14T03:36:56.415ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
55542024-12-14T03:36:56.415ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
55552024-12-14T03:36:56.415ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
55562024-12-14T03:36:56.415ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
55572024-12-14T03:36:56.417ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
55582024-12-14T03:36:56.417ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = c7a5bbe9-1af5-4e36-80b5-da9e0053b676 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
55592024-12-14T03:36:56.417ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
55602024-12-14T03:36:56.417ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
55612024-12-14T03:36:56.418ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
55622024-12-14T03:36:56.418ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
55632024-12-14T03:36:56.420ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55642024-12-14T03:36:56.421ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55652024-12-14T03:36:56.421ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
55662024-12-14T03:36:56.421ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
55672024-12-14T03:36:56.421ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
55682024-12-14T03:36:56.421ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
55692024-12-14T03:36:56.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
55702024-12-14T03:36:56.423ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55712024-12-14T03:36:56.424ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 8d70e61c-94ed-41ce-b36c-cb904f92c534, lookup_type: ById(8d70e61c-94ed-41ce-b36c-cb904f92c534) } result = Ok(())
55722024-12-14T03:36:56.424ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
55732024-12-14T03:36:56.424ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
55742024-12-14T03:36:56.424ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
55752024-12-14T03:36:56.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
55762024-12-14T03:36:56.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
55772024-12-14T03:36:56.425ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
55782024-12-14T03:36:56.425ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
55792024-12-14T03:36:56.425ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 80.261477ms iteration = 5 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
55802024-12-14T03:36:56.426ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
55812024-12-14T03:36:56.426ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
55822024-12-14T03:36:56.426ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
55832024-12-14T03:36:56.429ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 84.89551ms iteration = 5 status = 0
55842024-12-14T03:36:56.431ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
55852024-12-14T03:36:56.431ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
55862024-12-14T03:36:56.431ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 85.986522ms iteration = 3 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
55872024-12-14T03:36:56.433ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
55882024-12-14T03:36:56.433ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 51f6df17-b3b5-47fe-9a42-d8752f961c5e dns_zone_name = oxide.test found_so_far = 0 version = 2
55892024-12-14T03:36:56.433ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
55902024-12-14T03:36:56.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
55912024-12-14T03:36:56.435ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55922024-12-14T03:36:56.438ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
55932024-12-14T03:36:56.438ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
55942024-12-14T03:36:56.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
55952024-12-14T03:36:56.440ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
55962024-12-14T03:36:56.440ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 51f6df17-b3b5-47fe-9a42-d8752f961c5e dns_zone_name = oxide.test found_so_far = 1 version = 2
55972024-12-14T03:36:56.440ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
55982024-12-14T03:36:56.440ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-14 03:35:40.905586 UTC dns_group = external generation = 2
55992024-12-14T03:36:56.440ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 95.680546ms iteration = 4 status = {"generation":2}
56002024-12-14T03:36:56.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
56012024-12-14T03:36:56.449ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56022024-12-14T03:36:56.452ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
56032024-12-14T03:36:56.452ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
56042024-12-14T03:36:56.452ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
56052024-12-14T03:36:56.455ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = c7a5bbe9-1af5-4e36-80b5-da9e0053b676 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
56062024-12-14T03:36:56.455ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
56072024-12-14T03:36:56.455ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-14 03:35:40.104814 UTC dns_group = internal generation = 1
56082024-12-14T03:36:56.455ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 110.781538ms iteration = 4 status = {"generation":1}
56092024-12-14T03:36:56.460ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
56102024-12-14T03:36:56.461ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
56112024-12-14T03:36:56.462ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56122024-12-14T03:36:56.465ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
56132024-12-14T03:36:56.465ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
56142024-12-14T03:36:56.465ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
56152024-12-14T03:36:56.475ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
56162024-12-14T03:36:56.480ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
56172024-12-14T03:36:56.480ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
56182024-12-14T03:36:56.480ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "860b4cd8-790b-4de9-a1e0-2bdf48642dda", "content-length": "26", "date": "Sat, 14 Dec 2024 03:36:56 GMT"} })
56192024-12-14T03:36:56.480ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
56202024-12-14T03:36:56.482ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
56212024-12-14T03:36:56.484ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
56222024-12-14T03:36:56.484ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
56232024-12-14T03:36:56.484ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
56242024-12-14T03:36:56.484ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4b29ddd4-e2c8-465b-9908-4cbd3604bb8d", "content-length": "26", "date": "Sat, 14 Dec 2024 03:36:56 GMT"} })
56252024-12-14T03:36:56.484ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
56262024-12-14T03:36:56.486ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
56272024-12-14T03:36:56.489ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
56282024-12-14T03:36:56.490ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
56292024-12-14T03:36:56.492ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56302024-12-14T03:36:56.493ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
56312024-12-14T03:36:56.493ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
56322024-12-14T03:36:56.494ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
56332024-12-14T03:36:56.495ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56342024-12-14T03:36:56.497ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
56352024-12-14T03:36:56.497ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
56362024-12-14T03:36:56.497ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
56372024-12-14T03:36:56.499ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 154.218519ms iteration = 7 status = {"physical_disks_added":0}
56382024-12-14T03:36:56.525ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (changed) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-14T03:34:54.541856Z, time_modified: 2024-12-14T03:34:54.541856Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, db_silo: Silo { identity: SiloIdentity { id: 578bc52c-ac81-41a6-a56b-dfc79805368e, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-14T03:35:40.848931Z, time_modified: 2024-12-14T03:35:40.848931Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "4dfc5e49ed154568e7a05c630983c79e7ad097d55e90f834bee8ffda0c5a5c9e" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, db_silo: Silo { identity: SiloIdentity { id: 578bc52c-ac81-41a6-a56b-dfc79805368e, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-14T03:35:40.848931Z, time_modified: 2024-12-14T03:35:40.848931Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "4dfc5e49ed154568e7a05c630983c79e7ad097d55e90f834bee8ffda0c5a5c9e" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:94
56392024-12-14T03:36:56.525ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 180.929864ms iteration = 4 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"578bc52c-ac81-41a6-a56b-dfc79805368e","tls_certs":["4dfc5e49ed154568e7a05c630983c79e7ad097d55e90f834bee8ffda0c5a5c9e"]}},"default_endpoint":{"silo_id":"578bc52c-ac81-41a6-a56b-dfc79805368e","tls_certs":["4dfc5e49ed154568e7a05c630983c79e7ad097d55e90f834bee8ffda0c5a5c9e"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
56402024-12-14T03:36:56.532ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
56412024-12-14T03:36:56.532ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 187.069707ms iteration = 3 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
56422024-12-14T03:36:56.566ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 zone_address = fd00:1122:3344:101::2
56432024-12-14T03:36:56.566ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
56442024-12-14T03:36:56.566ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "54bc9d13-51d7-469f-9b61-d824827586f2", "content-length": "26", "date": "Sat, 14 Dec 2024 03:36:56 GMT"} })
56452024-12-14T03:36:56.566ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
56462024-12-14T03:36:56.568ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200
56472024-12-14T03:36:56.675ZDEBGnexus (BackgroundTasks): client request SledAgent = 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
56482024-12-14T03:36:56.675ZDEBGnexus (BackgroundTasks): client response SledAgent = 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "23cc3307-3188-4288-8f22-387786c641bc", "content-length": "691", "date": "Sat, 14 Dec 2024 03:36:56 GMT"} })
56492024-12-14T03:36:56.675ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
56502024-12-14T03:36:56.675ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
56512024-12-14T03:36:56.675ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
56522024-12-14T03:36:56.676ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 331.920809ms iteration = 5 status = {}
56532024-12-14T03:36:56.685ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
56542024-12-14T03:36:56.690ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
56552024-12-14T03:36:56.690ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "67d0351d-f93e-4631-bc82-ef7609dd6c78", "date": "Sat, 14 Dec 2024 03:36:56 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
56562024-12-14T03:36:56.690ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
56572024-12-14T03:36:56.692ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "a1d410a9-b47e-4a21-9ba8-c52be037c5d6", "date": "Sat, 14 Dec 2024 03:36:56 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
56582024-12-14T03:36:56.692ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
56592024-12-14T03:36:56.693ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
56602024-12-14T03:36:56.693ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 348.688195ms iteration = 5 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
56612024-12-14T03:36:56.699ZINFOnexus (BackgroundTasks): VPC route manager sled 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
56622024-12-14T03:36:56.699ZDEBGnexus (BackgroundTasks): client request SledAgent = 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
56632024-12-14T03:36:56.700ZDEBGnexus (BackgroundTasks): client response SledAgent = 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "05c50749-a36c-436d-8e25-359a1e586d42", "content-length": "372", "date": "Sat, 14 Dec 2024 03:36:56 GMT"} })
56642024-12-14T03:36:56.700ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
56652024-12-14T03:36:56.700ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
56662024-12-14T03:36:56.757ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
56672024-12-14T03:36:56.757ZDEBGnexus (BackgroundTasks): client request SledAgent = 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
56682024-12-14T03:36:56.757ZDEBGnexus (BackgroundTasks): client response SledAgent = 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "405cf706-cc12-490b-b3f3-8c55e11835ab", "date": "Sat, 14 Dec 2024 03:36:56 GMT"} })
56692024-12-14T03:36:56.757ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
56702024-12-14T03:36:56.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
56712024-12-14T03:36:56.759ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
56722024-12-14T03:36:56.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
56732024-12-14T03:36:56.762ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
56742024-12-14T03:36:56.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
56752024-12-14T03:36:56.765ZINFOnexus (BackgroundTasks): VPC route manager sled 8d70e61c-94ed-41ce-b36c-cb904f92c534 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
56762024-12-14T03:36:56.765ZDEBGnexus (BackgroundTasks): client request SledAgent = 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
56772024-12-14T03:36:56.765ZDEBGnexus (BackgroundTasks): client response SledAgent = 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "ba40a7dd-0b3b-409b-ac96-934780d83331", "date": "Sat, 14 Dec 2024 03:36:56 GMT"} })
56782024-12-14T03:36:56.767ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 421.998444ms iteration = 6 status = {}
56792024-12-14T03:36:56.806ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
56802024-12-14T03:36:56.807ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "7465b5de-385c-4c87-b24f-24fdc914a471", "date": "Sat, 14 Dec 2024 03:36:56 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
56812024-12-14T03:36:56.807ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
56822024-12-14T03:36:56.809ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "4a3a621c-0fbd-486b-923c-813102a8cb2e", "date": "Sat, 14 Dec 2024 03:36:56 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
56832024-12-14T03:36:56.809ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
56842024-12-14T03:36:56.810ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "78de3538-bef4-4b1c-80b3-f987513d20ab", "date": "Sat, 14 Dec 2024 03:36:56 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
56852024-12-14T03:36:56.810ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
56862024-12-14T03:36:56.812ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
56872024-12-14T03:36:56.812ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 467.026365ms iteration = 5 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
56882024-12-14T03:36:56.859ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
56892024-12-14T03:36:56.859ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "08e98c21-4cca-4ad1-be4b-035ba6c9f4a9", "content-length": "1", "date": "Sat, 14 Dec 2024 03:36:56 GMT"} })
56902024-12-14T03:36:56.861ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
56912024-12-14T03:36:56.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
56922024-12-14T03:36:56.863ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 518.393255ms iteration = 5 status = null
56932024-12-14T03:36:56.866ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 521.709282ms iteration = 5 status = {}
56942024-12-14T03:36:56.930ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56952024-12-14T03:36:56.931ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56962024-12-14T03:36:56.933ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 45ca990e-42e9-4264-be3e-0adfed2cd99b, rack_id: a121ca05-bbee-41bf-b9db-9e03ff035200, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(811a570a-bdaf-4a1b-8eba-0c0e4977f7bb) } rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 switch_location = Switch0
56972024-12-14T03:36:56.933ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56982024-12-14T03:36:56.933ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56992024-12-14T03:36:56.942ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
57002024-12-14T03:36:56.943ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "31565ccd-2525-49bd-815a-e61be4ec686a", "content-length": "134", "date": "Sat, 14 Dec 2024 03:36:56 GMT"} })
57012024-12-14T03:36:56.943ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
57022024-12-14T03:36:56.943ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 811a570a-bdaf-4a1b-8eba-0c0e4977f7bb
57032024-12-14T03:36:56.943ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
57042024-12-14T03:36:56.943ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
57052024-12-14T03:36:56.943ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
57062024-12-14T03:36:56.943ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
57072024-12-14T03:36:56.943ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
57082024-12-14T03:36:56.943ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
57092024-12-14T03:36:56.943ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
57102024-12-14T03:36:56.943ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
57112024-12-14T03:36:56.943ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200
57122024-12-14T03:36:56.943ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
57132024-12-14T03:36:56.944ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
57142024-12-14T03:36:56.956ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
57152024-12-14T03:36:56.956ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "b3e37794-d35a-49a9-b4d2-00b5980944fe", "content-length": "2", "date": "Sat, 14 Dec 2024 03:36:56 GMT"} })
57162024-12-14T03:36:56.956ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
57172024-12-14T03:36:56.956ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "5b370b29-12e8-4d8a-9e35-383ebe041992", "content-length": "52", "date": "Sat, 14 Dec 2024 03:36:56 GMT"} })
57182024-12-14T03:36:56.956ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 switch_location = Switch0
57192024-12-14T03:36:56.956ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
57202024-12-14T03:36:57.052ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "75aa4acb-2a78-4e9d-b522-e7cb7ba64f49", "date": "Sat, 14 Dec 2024 03:36:56 GMT"} })
57212024-12-14T03:36:57.052ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 switch = Switch0
57222024-12-14T03:36:57.052ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
57232024-12-14T03:36:57.052ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "6d05041e-4b5b-467e-b582-dbb7c8350a90", "content-length": "682", "date": "Sat, 14 Dec 2024 03:36:56 GMT"} })
57242024-12-14T03:36:57.052ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
57252024-12-14T03:36:57.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
57262024-12-14T03:36:57.062ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
57272024-12-14T03:36:57.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
57282024-12-14T03:36:57.067ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
57292024-12-14T03:36:57.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
57302024-12-14T03:36:57.078ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
57312024-12-14T03:36:57.078ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
57322024-12-14T03:36:57.086ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 741.596107ms iteration = 5 status = {}
57332024-12-14T03:37:05.611ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1196 local_addr = [fd00:1122:3344:101::b]:56585 method = GET remote_addr = [fd00:1122:3344:101::d]:58979 req_id = cccbce32-a808-4bc6-9719-59823fbc0dce response_code = 200 uri = /5f2fe413-3c4a-4994-b4a0-995c1da486b1
57342024-12-14T03:37:06.345ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 14 reason = Timeout
57352024-12-14T03:37:06.345ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
57362024-12-14T03:37:06.345ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 14 reason = Timeout
57372024-12-14T03:37:06.345ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57382024-12-14T03:37:06.345ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
57392024-12-14T03:37:06.345ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57402024-12-14T03:37:06.347ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57412024-12-14T03:37:06.350ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
57422024-12-14T03:37:06.350ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57432024-12-14T03:37:06.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57442024-12-14T03:37:06.352ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57452024-12-14T03:37:06.353ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57462024-12-14T03:37:06.354ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57472024-12-14T03:37:06.357ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1, lookup_type: ById(eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1) } result = Ok(())
57482024-12-14T03:37:06.357ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57492024-12-14T03:37:06.357ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57502024-12-14T03:37:06.370ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1 original_time_created = 2024-12-14 03:34:51.368980 UTC target_id = eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1 time_created = 2024-12-14 03:34:51.368980 UTC
57512024-12-14T03:37:06.370ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.895538ms iteration = 14 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1","time_created":"2024-12-14T03:34:51.368980Z"}
57522024-12-14T03:37:06.380ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
57532024-12-14T03:37:06.380ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
57542024-12-14T03:37:06.382ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 37.099943ms iteration = 14 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
57552024-12-14T03:37:10.600ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:56805 req_id = a03cf832-7eb8-47b4-bd7e-b35e05de0e6b roles = RoleSet { roles: {} } uri = /metrics/collectors/a321e00a-3126-4ea4-b26d-c0e3eea69166/producers?sort_by=id_ascending
57562024-12-14T03:37:10.600ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:56805 req_id = a03cf832-7eb8-47b4-bd7e-b35e05de0e6b resource = Database result = Ok(()) uri = /metrics/collectors/a321e00a-3126-4ea4-b26d-c0e3eea69166/producers?sort_by=id_ascending
57572024-12-14T03:37:10.603ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2779 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:56805 req_id = a03cf832-7eb8-47b4-bd7e-b35e05de0e6b response_code = 200 uri = /metrics/collectors/a321e00a-3126-4ea4-b26d-c0e3eea69166/producers?sort_by=id_ascending
57582024-12-14T03:37:10.603ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:56805 req_id = b1eaa29e-945b-495c-be4b-025221cc572b roles = RoleSet { roles: {} } uri = /metrics/collectors/a321e00a-3126-4ea4-b26d-c0e3eea69166/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlOGQ5NjQ2Zi1hNTQxLTRjMTEtYjViMi1mOTUzNDI3Y2EyZjMifX0%3D
57592024-12-14T03:37:10.603ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:56805 req_id = b1eaa29e-945b-495c-be4b-025221cc572b resource = Database result = Ok(()) uri = /metrics/collectors/a321e00a-3126-4ea4-b26d-c0e3eea69166/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlOGQ5NjQ2Zi1hNTQxLTRjMTEtYjViMi1mOTUzNDI3Y2EyZjMifX0%3D
57602024-12-14T03:37:10.605ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2309 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:56805 req_id = b1eaa29e-945b-495c-be4b-025221cc572b response_code = 200 uri = /metrics/collectors/a321e00a-3126-4ea4-b26d-c0e3eea69166/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlOGQ5NjQ2Zi1hNTQxLTRjMTEtYjViMi1mOTUzNDI3Y2EyZjMifX0%3D
57612024-12-14T03:37:15.611ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1090 local_addr = [fd00:1122:3344:101::b]:56585 method = GET remote_addr = [fd00:1122:3344:101::d]:58979 req_id = c9f34352-a53d-4ea9-b3fe-cfe7d2f5b416 response_code = 200 uri = /5f2fe413-3c4a-4994-b4a0-995c1da486b1
57622024-12-14T03:37:16.345ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 15 reason = Timeout
57632024-12-14T03:37:16.345ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
57642024-12-14T03:37:16.345ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 15 reason = Timeout
57652024-12-14T03:37:16.345ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57662024-12-14T03:37:16.345ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
57672024-12-14T03:37:16.345ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57682024-12-14T03:37:16.347ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
57692024-12-14T03:37:16.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
57702024-12-14T03:37:16.347ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57712024-12-14T03:37:16.348ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.668954ms iteration = 15 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
57722024-12-14T03:37:16.350ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
57732024-12-14T03:37:16.350ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57742024-12-14T03:37:16.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57752024-12-14T03:37:16.352ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57762024-12-14T03:37:16.352ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57772024-12-14T03:37:16.354ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57782024-12-14T03:37:16.356ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1, lookup_type: ById(eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1) } result = Ok(())
57792024-12-14T03:37:16.356ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57802024-12-14T03:37:16.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57812024-12-14T03:37:16.368ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1 original_time_created = 2024-12-14 03:34:51.368980 UTC target_id = eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1 time_created = 2024-12-14 03:34:51.368980 UTC
57822024-12-14T03:37:16.368ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.099203ms iteration = 15 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1","time_created":"2024-12-14T03:34:51.368980Z"}
57832024-12-14T03:37:25.600ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:56805 req_id = 02776065-3bf6-46ec-a481-250f16575159 roles = RoleSet { roles: {} } uri = /metrics/collectors/a321e00a-3126-4ea4-b26d-c0e3eea69166/producers?sort_by=id_ascending
57842024-12-14T03:37:25.601ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:56805 req_id = 02776065-3bf6-46ec-a481-250f16575159 resource = Database result = Ok(()) uri = /metrics/collectors/a321e00a-3126-4ea4-b26d-c0e3eea69166/producers?sort_by=id_ascending
57852024-12-14T03:37:25.602ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1666 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:56805 req_id = 02776065-3bf6-46ec-a481-250f16575159 response_code = 200 uri = /metrics/collectors/a321e00a-3126-4ea4-b26d-c0e3eea69166/producers?sort_by=id_ascending
57862024-12-14T03:37:25.602ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:56805 req_id = ef11326b-fcab-43ed-8651-86391e207153 roles = RoleSet { roles: {} } uri = /metrics/collectors/a321e00a-3126-4ea4-b26d-c0e3eea69166/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlOGQ5NjQ2Zi1hNTQxLTRjMTEtYjViMi1mOTUzNDI3Y2EyZjMifX0%3D
57872024-12-14T03:37:25.603ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:56805 req_id = ef11326b-fcab-43ed-8651-86391e207153 resource = Database result = Ok(()) uri = /metrics/collectors/a321e00a-3126-4ea4-b26d-c0e3eea69166/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlOGQ5NjQ2Zi1hNTQxLTRjMTEtYjViMi1mOTUzNDI3Y2EyZjMifX0%3D
57882024-12-14T03:37:25.604ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2099 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:56805 req_id = ef11326b-fcab-43ed-8651-86391e207153 response_code = 200 uri = /metrics/collectors/a321e00a-3126-4ea4-b26d-c0e3eea69166/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlOGQ5NjQ2Zi1hNTQxLTRjMTEtYjViMi1mOTUzNDI3Y2EyZjMifX0%3D
57892024-12-14T03:37:25.611ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 986 local_addr = [fd00:1122:3344:101::b]:56585 method = GET remote_addr = [fd00:1122:3344:101::d]:58979 req_id = 16437cb8-ff70-453c-8e33-4f193d026d89 response_code = 200 uri = /5f2fe413-3c4a-4994-b4a0-995c1da486b1
57902024-12-14T03:37:25.877ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:51814
57912024-12-14T03:37:25.880ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:51814 req_id = ec747f0d-22ec-4428-a05b-7e0a4a14b8ae roles = RoleSet { roles: {} } uri = /metrics/producers
57922024-12-14T03:37:25.880ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:51814 req_id = ec747f0d-22ec-4428-a05b-7e0a4a14b8ae resource = Database result = Ok(()) uri = /metrics/producers
57932024-12-14T03:37:25.891ZINFOnexus: assigned collector to new producer collector_id = a321e00a-3126-4ea4-b26d-c0e3eea69166 file = nexus/src/app/oximeter.rs:76 producer_id = d278f717-338f-4586-9211-4636baa82004
57942024-12-14T03:37:25.891ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 10771 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:51814 req_id = ec747f0d-22ec-4428-a05b-7e0a4a14b8ae response_code = 201 uri = /metrics/producers
57952024-12-14T03:37:26.345ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 16 reason = Timeout
57962024-12-14T03:37:26.345ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 6 reason = Timeout
57972024-12-14T03:37:26.345ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57982024-12-14T03:37:26.345ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
57992024-12-14T03:37:26.345ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 6 reason = Timeout
58002024-12-14T03:37:26.345ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
58012024-12-14T03:37:26.345ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 6 reason = Timeout
58022024-12-14T03:37:26.345ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
58032024-12-14T03:37:26.345ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 6 reason = Timeout
58042024-12-14T03:37:26.345ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
58052024-12-14T03:37:26.345ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 6 reason = Timeout
58062024-12-14T03:37:26.345ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 6 reason = Timeout
58072024-12-14T03:37:26.345ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
58082024-12-14T03:37:26.345ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
58092024-12-14T03:37:26.346ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 16 reason = Timeout
58102024-12-14T03:37:26.346ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
58112024-12-14T03:37:26.346ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 6 reason = Timeout
58122024-12-14T03:37:26.346ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
58132024-12-14T03:37:26.346ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 6 reason = Timeout
58142024-12-14T03:37:26.346ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
58152024-12-14T03:37:26.346ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 6 reason = Timeout
58162024-12-14T03:37:26.346ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
58172024-12-14T03:37:26.346ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
58182024-12-14T03:37:26.346ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 7 reason = Timeout
58192024-12-14T03:37:26.346ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
58202024-12-14T03:37:26.346ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
58212024-12-14T03:37:26.346ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 8 reason = Timeout
58222024-12-14T03:37:26.346ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 6 reason = Timeout
58232024-12-14T03:37:26.346ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
58242024-12-14T03:37:26.346ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 6 reason = Timeout
58252024-12-14T03:37:26.346ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 6 reason = Timeout
58262024-12-14T03:37:26.346ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
58272024-12-14T03:37:26.346ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
58282024-12-14T03:37:26.346ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 6 reason = Timeout
58292024-12-14T03:37:26.346ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
58302024-12-14T03:37:26.346ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
58312024-12-14T03:37:26.346ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58322024-12-14T03:37:26.346ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
58332024-12-14T03:37:26.346ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
58342024-12-14T03:37:26.346ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
58352024-12-14T03:37:26.346ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
58362024-12-14T03:37:26.346ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
58372024-12-14T03:37:26.346ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
58382024-12-14T03:37:26.346ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
58392024-12-14T03:37:26.346ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
58402024-12-14T03:37:26.346ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
58412024-12-14T03:37:26.346ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
58422024-12-14T03:37:26.346ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
58432024-12-14T03:37:26.346ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
58442024-12-14T03:37:26.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
58452024-12-14T03:37:26.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
58462024-12-14T03:37:26.348ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58472024-12-14T03:37:26.349ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58482024-12-14T03:37:26.350ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8d70e61c-94ed-41ce-b36c-cb904f92c534.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8d70e61c-94ed-41ce-b36c-cb904f92c534.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1252, tv_nsec: 670180938 } })
58492024-12-14T03:37:26.350ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8d70e61c-94ed-41ce-b36c-cb904f92c534.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8d70e61c-94ed-41ce-b36c-cb904f92c534.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1252, tv_nsec: 670201369 } })
58502024-12-14T03:37:26.350ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
58512024-12-14T03:37:26.350ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
58522024-12-14T03:37:26.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
58532024-12-14T03:37:26.350ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
58542024-12-14T03:37:26.351ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
58552024-12-14T03:37:26.351ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
58562024-12-14T03:37:26.351ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 5.410128ms iteration = 6 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
58572024-12-14T03:37:26.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
58582024-12-14T03:37:26.352ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
58592024-12-14T03:37:26.352ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58602024-12-14T03:37:26.352ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58612024-12-14T03:37:26.353ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58622024-12-14T03:37:26.354ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58632024-12-14T03:37:26.354ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58642024-12-14T03:37:26.356ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
58652024-12-14T03:37:26.356ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
58662024-12-14T03:37:26.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
58672024-12-14T03:37:26.357ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
58682024-12-14T03:37:26.357ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
58692024-12-14T03:37:26.357ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
58702024-12-14T03:37:26.357ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
58712024-12-14T03:37:26.357ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
58722024-12-14T03:37:26.357ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
58732024-12-14T03:37:26.357ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
58742024-12-14T03:37:26.357ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
58752024-12-14T03:37:26.357ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
58762024-12-14T03:37:26.357ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
58772024-12-14T03:37:26.358ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 12.194214ms iteration = 6 status = {"errors":[],"garbage_collect_requested":[]}
58782024-12-14T03:37:26.359ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58792024-12-14T03:37:26.359ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 13.638473ms iteration = 6 status = {"errors":[],"records_set_to_done":[]}
58802024-12-14T03:37:26.361ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
58812024-12-14T03:37:26.361ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
58822024-12-14T03:37:26.361ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
58832024-12-14T03:37:26.367ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
58842024-12-14T03:37:26.367ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58852024-12-14T03:37:26.368ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
58862024-12-14T03:37:26.368ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58872024-12-14T03:37:26.370ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
58882024-12-14T03:37:26.370ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 24.319507ms iteration = 6 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
58892024-12-14T03:37:26.370ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58902024-12-14T03:37:26.371ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
58912024-12-14T03:37:26.371ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
58922024-12-14T03:37:26.371ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
58932024-12-14T03:37:26.371ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
58942024-12-14T03:37:26.371ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8d70e61c-94ed-41ce-b36c-cb904f92c534.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8d70e61c-94ed-41ce-b36c-cb904f92c534.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1252, tv_nsec: 691614068 } })
58952024-12-14T03:37:26.371ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
58962024-12-14T03:37:26.372ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
58972024-12-14T03:37:26.372ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200
58982024-12-14T03:37:26.372ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
58992024-12-14T03:37:26.372ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
59002024-12-14T03:37:26.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
59012024-12-14T03:37:26.374ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
59022024-12-14T03:37:26.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
59032024-12-14T03:37:26.375ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59042024-12-14T03:37:26.377ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
59052024-12-14T03:37:26.377ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
59062024-12-14T03:37:26.377ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
59072024-12-14T03:37:26.384ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
59082024-12-14T03:37:26.384ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
59092024-12-14T03:37:26.386ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59102024-12-14T03:37:26.387ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
59112024-12-14T03:37:26.387ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
59122024-12-14T03:37:26.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
59132024-12-14T03:37:26.389ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59142024-12-14T03:37:26.391ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
59152024-12-14T03:37:26.391ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
59162024-12-14T03:37:26.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
59172024-12-14T03:37:26.397ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
59182024-12-14T03:37:26.397ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
59192024-12-14T03:37:26.398ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
59202024-12-14T03:37:26.398ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
59212024-12-14T03:37:26.399ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 53.457511ms iteration = 16 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
59222024-12-14T03:37:26.400ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
59232024-12-14T03:37:26.400ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
59242024-12-14T03:37:26.404ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
59252024-12-14T03:37:26.405ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
59262024-12-14T03:37:26.405ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59272024-12-14T03:37:26.405ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
59282024-12-14T03:37:26.405ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
59292024-12-14T03:37:26.407ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1, lookup_type: ById(eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1) } result = Ok(())
59302024-12-14T03:37:26.407ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59312024-12-14T03:37:26.407ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59322024-12-14T03:37:26.409ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
59332024-12-14T03:37:26.409ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
59342024-12-14T03:37:26.409ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 63.567204ms iteration = 6 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
59352024-12-14T03:37:26.432ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 86.37707ms iteration = 6 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
59362024-12-14T03:37:26.445ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
59372024-12-14T03:37:26.445ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
59382024-12-14T03:37:26.445ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "117b6cea-623d-4f74-9c79-4ffd26902604", "content-length": "26", "date": "Sat, 14 Dec 2024 03:37:26 GMT"} })
59392024-12-14T03:37:26.445ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
59402024-12-14T03:37:26.446ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
59412024-12-14T03:37:26.467ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 121.715448ms iteration = 8 status = {"physical_disks_added":0}
59422024-12-14T03:37:26.500ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 zone_address = fd00:1122:3344:101::2
59432024-12-14T03:37:26.500ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
59442024-12-14T03:37:26.500ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "013652ed-a471-4da0-84a6-25cd38b22a86", "content-length": "26", "date": "Sat, 14 Dec 2024 03:37:26 GMT"} })
59452024-12-14T03:37:26.500ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
59462024-12-14T03:37:26.502ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200
59472024-12-14T03:37:26.514ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
59482024-12-14T03:37:26.514ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
59492024-12-14T03:37:26.515ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "bd1c2503-8ef4-4a3d-9cbb-38acb01e61bf", "content-length": "26", "date": "Sat, 14 Dec 2024 03:37:26 GMT"} })
59502024-12-14T03:37:26.515ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
59512024-12-14T03:37:26.517ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
59522024-12-14T03:37:26.582ZDEBGnexus (BackgroundTasks): client request SledAgent = 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
59532024-12-14T03:37:26.582ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
59542024-12-14T03:37:26.582ZDEBGnexus (BackgroundTasks): client response SledAgent = 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "c16b94ab-e837-44f7-89cb-4b74f48f7503", "content-length": "691", "date": "Sat, 14 Dec 2024 03:37:26 GMT"} })
59552024-12-14T03:37:26.582ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
59562024-12-14T03:37:26.582ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
59572024-12-14T03:37:26.582ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
59582024-12-14T03:37:26.582ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "0e895cfd-9962-4adf-8c0a-2cf1d8490199", "content-length": "1", "date": "Sat, 14 Dec 2024 03:37:26 GMT"} })
59592024-12-14T03:37:26.583ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
59602024-12-14T03:37:26.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
59612024-12-14T03:37:26.584ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 238.153301ms iteration = 6 status = {}
59622024-12-14T03:37:26.584ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59632024-12-14T03:37:26.586ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 8d70e61c-94ed-41ce-b36c-cb904f92c534, lookup_type: ById(8d70e61c-94ed-41ce-b36c-cb904f92c534) } result = Ok(())
59642024-12-14T03:37:26.586ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
59652024-12-14T03:37:26.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
59662024-12-14T03:37:26.588ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 243.024098ms iteration = 6 status = null
59672024-12-14T03:37:26.588ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 243.079079ms iteration = 6 status = 0
59682024-12-14T03:37:26.597ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1 original_time_created = 2024-12-14 03:34:51.368980 UTC target_id = eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1 time_created = 2024-12-14 03:34:51.368980 UTC
59692024-12-14T03:37:26.597ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 251.796094ms iteration = 16 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1","time_created":"2024-12-14T03:34:51.368980Z"}
59702024-12-14T03:37:26.609ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
59712024-12-14T03:37:26.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
59722024-12-14T03:37:26.611ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 265.523869ms iteration = 6 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
59732024-12-14T03:37:26.611ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 265.56112ms iteration = 6 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
59742024-12-14T03:37:26.619ZINFOnexus (BackgroundTasks): VPC route manager sled 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
59752024-12-14T03:37:26.619ZDEBGnexus (BackgroundTasks): client request SledAgent = 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
59762024-12-14T03:37:26.619ZDEBGnexus (BackgroundTasks): client response SledAgent = 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "7b65339d-cc5c-41ff-a39b-3a7b7dabdb36", "content-length": "372", "date": "Sat, 14 Dec 2024 03:37:26 GMT"} })
59772024-12-14T03:37:26.620ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
59782024-12-14T03:37:26.620ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
59792024-12-14T03:37:26.654ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 308.936009ms iteration = 6 status = {}
59802024-12-14T03:37:26.663ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
59812024-12-14T03:37:26.663ZDEBGnexus (BackgroundTasks): client request SledAgent = 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
59822024-12-14T03:37:26.663ZDEBGnexus (BackgroundTasks): client response SledAgent = 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "554104cd-0156-49d3-bd4c-180d08e3d359", "date": "Sat, 14 Dec 2024 03:37:26 GMT"} })
59832024-12-14T03:37:26.663ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
59842024-12-14T03:37:26.663ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
59852024-12-14T03:37:26.665ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
59862024-12-14T03:37:26.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
59872024-12-14T03:37:26.668ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
59882024-12-14T03:37:26.669ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
59892024-12-14T03:37:26.671ZINFOnexus (BackgroundTasks): VPC route manager sled 8d70e61c-94ed-41ce-b36c-cb904f92c534 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
59902024-12-14T03:37:26.671ZDEBGnexus (BackgroundTasks): client request SledAgent = 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
59912024-12-14T03:37:26.671ZDEBGnexus (BackgroundTasks): client response SledAgent = 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "2ca7e380-874d-4266-916c-d2c19eafcfaf", "date": "Sat, 14 Dec 2024 03:37:26 GMT"} })
59922024-12-14T03:37:26.673ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 327.229835ms iteration = 7 status = {}
59932024-12-14T03:37:26.692ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
59942024-12-14T03:37:26.692ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
59952024-12-14T03:37:26.694ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 45ca990e-42e9-4264-be3e-0adfed2cd99b, rack_id: a121ca05-bbee-41bf-b9db-9e03ff035200, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(811a570a-bdaf-4a1b-8eba-0c0e4977f7bb) } rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 switch_location = Switch0
59962024-12-14T03:37:26.694ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
59972024-12-14T03:37:26.695ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
59982024-12-14T03:37:26.703ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
59992024-12-14T03:37:26.703ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "c52d8525-3a62-4447-9483-e01018faa4dd", "content-length": "134", "date": "Sat, 14 Dec 2024 03:37:26 GMT"} })
60002024-12-14T03:37:26.703ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
60012024-12-14T03:37:26.703ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 811a570a-bdaf-4a1b-8eba-0c0e4977f7bb
60022024-12-14T03:37:26.703ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
60032024-12-14T03:37:26.703ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
60042024-12-14T03:37:26.703ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
60052024-12-14T03:37:26.703ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
60062024-12-14T03:37:26.703ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
60072024-12-14T03:37:26.703ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
60082024-12-14T03:37:26.703ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
60092024-12-14T03:37:26.703ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
60102024-12-14T03:37:26.704ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200
60112024-12-14T03:37:26.704ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60122024-12-14T03:37:26.704ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60132024-12-14T03:37:26.705ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
60142024-12-14T03:37:26.706ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "d571431a-fb18-44b9-8234-a40730e78a71", "content-length": "2", "date": "Sat, 14 Dec 2024 03:37:26 GMT"} })
60152024-12-14T03:37:26.706ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
60162024-12-14T03:37:26.706ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "c4fa1ef4-38e8-4be5-9fbd-1e20464922a0", "content-length": "52", "date": "Sat, 14 Dec 2024 03:37:26 GMT"} })
60172024-12-14T03:37:26.706ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 switch_location = Switch0
60182024-12-14T03:37:26.706ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
60192024-12-14T03:37:26.796ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "3ec3bb8c-39c9-438e-9609-263bd5319862", "date": "Sat, 14 Dec 2024 03:37:26 GMT"} })
60202024-12-14T03:37:26.796ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 switch = Switch0
60212024-12-14T03:37:26.796ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
60222024-12-14T03:37:26.796ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "bab2c389-b081-4266-80a4-f980dea70e86", "content-length": "682", "date": "Sat, 14 Dec 2024 03:37:26 GMT"} })
60232024-12-14T03:37:26.796ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60242024-12-14T03:37:26.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60252024-12-14T03:37:26.799ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60262024-12-14T03:37:26.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60272024-12-14T03:37:26.803ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60282024-12-14T03:37:26.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60292024-12-14T03:37:26.805ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60302024-12-14T03:37:26.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60312024-12-14T03:37:26.813ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 467.271231ms iteration = 6 status = {}
60322024-12-14T03:37:35.611ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1184 local_addr = [fd00:1122:3344:101::b]:56585 method = GET remote_addr = [fd00:1122:3344:101::d]:58979 req_id = 58ba8104-7dc0-4be0-8c49-3ed6745ce456 response_code = 200 uri = /5f2fe413-3c4a-4994-b4a0-995c1da486b1
60332024-12-14T03:37:36.345ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 17 reason = Timeout
60342024-12-14T03:37:36.345ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 17 reason = Timeout
60352024-12-14T03:37:36.345ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60362024-12-14T03:37:36.345ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
60372024-12-14T03:37:36.346ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
60382024-12-14T03:37:36.346ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60392024-12-14T03:37:36.348ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60402024-12-14T03:37:36.350ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
60412024-12-14T03:37:36.350ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60422024-12-14T03:37:36.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60432024-12-14T03:37:36.353ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60442024-12-14T03:37:36.353ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60452024-12-14T03:37:36.354ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60462024-12-14T03:37:36.357ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1, lookup_type: ById(eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1) } result = Ok(())
60472024-12-14T03:37:36.357ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60482024-12-14T03:37:36.357ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60492024-12-14T03:37:36.371ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1 original_time_created = 2024-12-14 03:34:51.368980 UTC target_id = eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1 time_created = 2024-12-14 03:34:51.368980 UTC
60502024-12-14T03:37:36.371ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 25.695644ms iteration = 17 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1","time_created":"2024-12-14T03:34:51.368980Z"}
60512024-12-14T03:37:36.378ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
60522024-12-14T03:37:36.379ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
60532024-12-14T03:37:36.407ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 62.024193ms iteration = 17 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
60542024-12-14T03:37:45.612ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1011 local_addr = [fd00:1122:3344:101::b]:56585 method = GET remote_addr = [fd00:1122:3344:101::d]:58979 req_id = 94e99aa6-09a2-4f2b-b715-cc8bfce987da response_code = 200 uri = /5f2fe413-3c4a-4994-b4a0-995c1da486b1
60552024-12-14T03:37:46.345ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 18 reason = Timeout
60562024-12-14T03:37:46.345ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
60572024-12-14T03:37:46.345ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 18 reason = Timeout
60582024-12-14T03:37:46.345ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60592024-12-14T03:37:46.345ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
60602024-12-14T03:37:46.345ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60612024-12-14T03:37:46.347ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
60622024-12-14T03:37:46.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
60632024-12-14T03:37:46.374ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60642024-12-14T03:37:46.377ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
60652024-12-14T03:37:46.377ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60662024-12-14T03:37:46.377ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60672024-12-14T03:37:46.379ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60682024-12-14T03:37:46.380ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60692024-12-14T03:37:46.381ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 36.123064ms iteration = 18 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
60702024-12-14T03:37:46.408ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60712024-12-14T03:37:46.411ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1, lookup_type: ById(eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1) } result = Ok(())
60722024-12-14T03:37:46.411ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60732024-12-14T03:37:46.411ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60742024-12-14T03:37:46.423ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1 original_time_created = 2024-12-14 03:34:51.368980 UTC target_id = eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1 time_created = 2024-12-14 03:34:51.368980 UTC
60752024-12-14T03:37:46.424ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 78.648995ms iteration = 18 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1","time_created":"2024-12-14T03:34:51.368980Z"}
60762024-12-14T03:37:55.611ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1110 local_addr = [fd00:1122:3344:101::b]:56585 method = GET remote_addr = [fd00:1122:3344:101::d]:58979 req_id = 4c46154c-31f9-4826-9fc7-21795a4512ba response_code = 200 uri = /5f2fe413-3c4a-4994-b4a0-995c1da486b1
60772024-12-14T03:37:56.346ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 9 reason = Timeout
60782024-12-14T03:37:56.346ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
60792024-12-14T03:37:56.346ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 5 reason = Timeout
60802024-12-14T03:37:56.346ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
60812024-12-14T03:37:56.346ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
60822024-12-14T03:37:56.346ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 7 reason = Timeout
60832024-12-14T03:37:56.346ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 4 reason = Timeout
60842024-12-14T03:37:56.346ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-14 03:27:56.346100956 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
60852024-12-14T03:37:56.346ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
60862024-12-14T03:37:56.346ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
60872024-12-14T03:37:56.346ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 7 reason = Timeout
60882024-12-14T03:37:56.346ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 4 reason = Timeout
60892024-12-14T03:37:56.346ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
60902024-12-14T03:37:56.346ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
60912024-12-14T03:37:56.346ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 7 reason = Timeout
60922024-12-14T03:37:56.346ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
60932024-12-14T03:37:56.346ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 4 reason = Timeout
60942024-12-14T03:37:56.346ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
60952024-12-14T03:37:56.346ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 19 reason = Timeout
60962024-12-14T03:37:56.346ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
60972024-12-14T03:37:56.346ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 7 reason = Timeout
60982024-12-14T03:37:56.346ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 6 reason = Timeout
60992024-12-14T03:37:56.346ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 7 reason = Timeout
61002024-12-14T03:37:56.346ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 7 reason = Timeout
61012024-12-14T03:37:56.346ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 5 reason = Timeout
61022024-12-14T03:37:56.346ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
61032024-12-14T03:37:56.346ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
61042024-12-14T03:37:56.346ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 4 reason = Timeout
61052024-12-14T03:37:56.346ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
61062024-12-14T03:37:56.346ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
61072024-12-14T03:37:56.346ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 19 reason = Timeout
61082024-12-14T03:37:56.346ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 4 reason = Timeout
61092024-12-14T03:37:56.346ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61102024-12-14T03:37:56.346ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
61112024-12-14T03:37:56.346ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 5 reason = Timeout
61122024-12-14T03:37:56.346ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
61132024-12-14T03:37:56.346ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 8 reason = Timeout
61142024-12-14T03:37:56.346ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
61152024-12-14T03:37:56.346ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
61162024-12-14T03:37:56.346ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 7 reason = Timeout
61172024-12-14T03:37:56.346ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
61182024-12-14T03:37:56.346ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 3 reason = Timeout
61192024-12-14T03:37:56.346ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 7 reason = Timeout
61202024-12-14T03:37:56.346ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 7 reason = Timeout
61212024-12-14T03:37:56.346ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
61222024-12-14T03:37:56.346ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
61232024-12-14T03:37:56.346ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
61242024-12-14T03:37:56.346ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
61252024-12-14T03:37:56.346ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 6 reason = Timeout
61262024-12-14T03:37:56.346ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 5 reason = Timeout
61272024-12-14T03:37:56.346ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
61282024-12-14T03:37:56.346ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
61292024-12-14T03:37:56.346ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 7 reason = Timeout
61302024-12-14T03:37:56.346ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
61312024-12-14T03:37:56.346ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 5 reason = Timeout
61322024-12-14T03:37:56.346ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1
61332024-12-14T03:37:56.346ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 5 reason = Timeout
61342024-12-14T03:37:56.346ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 13.69\u{b5}s iteration = 5 status = {"enabled":false,"target_id":"eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1"}
61352024-12-14T03:37:56.346ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 7 reason = Timeout
61362024-12-14T03:37:56.346ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
61372024-12-14T03:37:56.346ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 7 reason = Timeout
61382024-12-14T03:37:56.346ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
61392024-12-14T03:37:56.346ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 7 reason = Timeout
61402024-12-14T03:37:56.346ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
61412024-12-14T03:37:56.346ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
61422024-12-14T03:37:56.346ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
61432024-12-14T03:37:56.346ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
61442024-12-14T03:37:56.346ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
61452024-12-14T03:37:56.346ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
61462024-12-14T03:37:56.346ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
61472024-12-14T03:37:56.346ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
61482024-12-14T03:37:56.346ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
61492024-12-14T03:37:56.346ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
61502024-12-14T03:37:56.346ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
61512024-12-14T03:37:56.346ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
61522024-12-14T03:37:56.346ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61532024-12-14T03:37:56.346ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
61542024-12-14T03:37:56.346ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
61552024-12-14T03:37:56.346ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
61562024-12-14T03:37:56.346ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
61572024-12-14T03:37:56.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
61582024-12-14T03:37:56.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
61592024-12-14T03:37:56.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
61602024-12-14T03:37:56.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
61612024-12-14T03:37:56.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
61622024-12-14T03:37:56.347ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("3db8556d-0ae0-4824-8953-f38d8eef7409.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7b672843-049d-4d9c-b0a2-21d7b6323621.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("db39fe07-65c4-451a-a2bd-78fcdfc10040.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("db39fe07-65c4-451a-a2bd-78fcdfc10040.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1282, tv_nsec: 666439713 } })
61632024-12-14T03:37:56.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
61642024-12-14T03:37:56.347ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
61652024-12-14T03:37:56.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
61662024-12-14T03:37:56.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
61672024-12-14T03:37:56.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
61682024-12-14T03:37:56.347ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("28f528f1-3159-4fbc-9304-37b7e4a50ae8.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7274e15f-a5f6-4975-bcdd-a2ef890c0230.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("7274e15f-a5f6-4975-bcdd-a2ef890c0230.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1282, tv_nsec: 666596716 } })
61692024-12-14T03:37:56.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
61702024-12-14T03:37:56.347ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
61712024-12-14T03:37:56.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
61722024-12-14T03:37:56.347ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
61732024-12-14T03:37:56.347ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
61742024-12-14T03:37:56.347ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
61752024-12-14T03:37:56.347ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.316106ms iteration = 5 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
61762024-12-14T03:37:56.347ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
61772024-12-14T03:37:56.347ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.158643ms iteration = 5 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
61782024-12-14T03:37:56.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
61792024-12-14T03:37:56.347ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
61802024-12-14T03:37:56.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
61812024-12-14T03:37:56.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
61822024-12-14T03:37:56.349ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61832024-12-14T03:37:56.350ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8d70e61c-94ed-41ce-b36c-cb904f92c534.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8d70e61c-94ed-41ce-b36c-cb904f92c534.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1282, tv_nsec: 669717728 } })
61842024-12-14T03:37:56.350ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.249825ms iteration = 7 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
61852024-12-14T03:37:56.350ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-14 03:27:56.346100956 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
61862024-12-14T03:37:56.350ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 4.396968ms iteration = 4 status = {"expiration":"2024-12-14T03:27:56.346100956Z","pruned":[]}
61872024-12-14T03:37:56.350ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
61882024-12-14T03:37:56.351ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
61892024-12-14T03:37:56.351ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
61902024-12-14T03:37:56.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
61912024-12-14T03:37:56.352ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
61922024-12-14T03:37:56.352ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
61932024-12-14T03:37:56.352ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 6.071732ms iteration = 4 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
61942024-12-14T03:37:56.353ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61952024-12-14T03:37:56.353ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61962024-12-14T03:37:56.354ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 8.215994ms iteration = 4 status = {"errors":[],"found_port_ok":[]}
61972024-12-14T03:37:56.355ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
61982024-12-14T03:37:56.355ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
61992024-12-14T03:37:56.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
62002024-12-14T03:37:56.356ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
62012024-12-14T03:37:56.356ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
62022024-12-14T03:37:56.357ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
62032024-12-14T03:37:56.357ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62042024-12-14T03:37:56.357ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62052024-12-14T03:37:56.358ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
62062024-12-14T03:37:56.358ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
62072024-12-14T03:37:56.358ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
62082024-12-14T03:37:56.358ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
62092024-12-14T03:37:56.359ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
62102024-12-14T03:37:56.359ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
62112024-12-14T03:37:56.360ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
62122024-12-14T03:37:56.360ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
62132024-12-14T03:37:56.360ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
62142024-12-14T03:37:56.360ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
62152024-12-14T03:37:56.363ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
62162024-12-14T03:37:56.363ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
62172024-12-14T03:37:56.366ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8d70e61c-94ed-41ce-b36c-cb904f92c534.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8d70e61c-94ed-41ce-b36c-cb904f92c534.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1282, tv_nsec: 685886472 } })
62182024-12-14T03:37:56.366ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62192024-12-14T03:37:56.366ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
62202024-12-14T03:37:56.367ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62212024-12-14T03:37:56.368ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
62222024-12-14T03:37:56.368ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
62232024-12-14T03:37:56.368ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
62242024-12-14T03:37:56.369ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
62252024-12-14T03:37:56.369ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
62262024-12-14T03:37:56.369ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
62272024-12-14T03:37:56.371ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62282024-12-14T03:37:56.373ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
62292024-12-14T03:37:56.373ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
62302024-12-14T03:37:56.373ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
62312024-12-14T03:37:56.373ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
62322024-12-14T03:37:56.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
62332024-12-14T03:37:56.373ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62342024-12-14T03:37:56.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
62352024-12-14T03:37:56.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
62362024-12-14T03:37:56.375ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
62372024-12-14T03:37:56.375ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
62382024-12-14T03:37:56.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
62392024-12-14T03:37:56.380ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
62402024-12-14T03:37:56.382ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
62412024-12-14T03:37:56.383ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
62422024-12-14T03:37:56.384ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
62432024-12-14T03:37:56.384ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62442024-12-14T03:37:56.389ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
62452024-12-14T03:37:56.393ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62462024-12-14T03:37:56.396ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
62472024-12-14T03:37:56.396ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
62482024-12-14T03:37:56.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
62492024-12-14T03:37:56.399ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8d70e61c-94ed-41ce-b36c-cb904f92c534.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8d70e61c-94ed-41ce-b36c-cb904f92c534.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1282, tv_nsec: 718797902 } })
62502024-12-14T03:37:56.399ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200
62512024-12-14T03:37:56.400ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62522024-12-14T03:37:56.402ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
62532024-12-14T03:37:56.402ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
62542024-12-14T03:37:56.402ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
62552024-12-14T03:37:56.406ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
62562024-12-14T03:37:56.406ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
62572024-12-14T03:37:56.408ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
62582024-12-14T03:37:56.408ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
62592024-12-14T03:37:56.408ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
62602024-12-14T03:37:56.409ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
62612024-12-14T03:37:56.412ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
62622024-12-14T03:37:56.412ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62632024-12-14T03:37:56.412ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
62642024-12-14T03:37:56.413ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 66.538903ms iteration = 7 status = {"errors":[],"records_set_to_done":[]}
62652024-12-14T03:37:56.413ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62662024-12-14T03:37:56.414ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
62672024-12-14T03:37:56.414ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 68.268418ms iteration = 7 status = {"errors":[],"garbage_collect_requested":[]}
62682024-12-14T03:37:56.414ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
62692024-12-14T03:37:56.416ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1, lookup_type: ById(eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1) } result = Ok(())
62702024-12-14T03:37:56.416ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
62712024-12-14T03:37:56.416ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
62722024-12-14T03:37:56.416ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
62732024-12-14T03:37:56.416ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
62742024-12-14T03:37:56.416ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
62752024-12-14T03:37:56.416ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 69.84377ms iteration = 4 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
62762024-12-14T03:37:56.416ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
62772024-12-14T03:37:56.416ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
62782024-12-14T03:37:56.418ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
62792024-12-14T03:37:56.418ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 71.843749ms iteration = 7 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
62802024-12-14T03:37:56.418ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
62812024-12-14T03:37:56.419ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62822024-12-14T03:37:56.419ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62832024-12-14T03:37:56.420ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62842024-12-14T03:37:56.421ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
62852024-12-14T03:37:56.421ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
62862024-12-14T03:37:56.421ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
62872024-12-14T03:37:56.422ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
62882024-12-14T03:37:56.422ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
62892024-12-14T03:37:56.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
62902024-12-14T03:37:56.422ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62912024-12-14T03:37:56.423ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
62922024-12-14T03:37:56.424ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
62932024-12-14T03:37:56.424ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
62942024-12-14T03:37:56.424ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
62952024-12-14T03:37:56.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
62962024-12-14T03:37:56.424ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
62972024-12-14T03:37:56.424ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
62982024-12-14T03:37:56.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
62992024-12-14T03:37:56.425ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
63002024-12-14T03:37:56.425ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
63012024-12-14T03:37:56.425ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
63022024-12-14T03:37:56.425ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
63032024-12-14T03:37:56.425ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
63042024-12-14T03:37:56.426ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 80.011873ms iteration = 3 status = {"nsuccess":5}
63052024-12-14T03:37:56.426ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
63062024-12-14T03:37:56.426ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
63072024-12-14T03:37:56.428ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
63082024-12-14T03:37:56.429ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
63092024-12-14T03:37:56.429ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
63102024-12-14T03:37:56.429ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
63112024-12-14T03:37:56.431ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1 original_time_created = 2024-12-14 03:34:51.368980 UTC target_id = eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1 time_created = 2024-12-14 03:34:51.368980 UTC
63122024-12-14T03:37:56.431ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 85.114886ms iteration = 19 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1","time_created":"2024-12-14T03:34:51.368980Z"}
63132024-12-14T03:37:56.438ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63142024-12-14T03:37:56.443ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
63152024-12-14T03:37:56.443ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
63162024-12-14T03:37:56.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
63172024-12-14T03:37:56.445ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 99.436992ms iteration = 19 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
63182024-12-14T03:37:56.457ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63192024-12-14T03:37:56.458ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
63202024-12-14T03:37:56.458ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 111.884871ms iteration = 7 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
63212024-12-14T03:37:56.460ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
63222024-12-14T03:37:56.460ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
63232024-12-14T03:37:56.460ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
63242024-12-14T03:37:56.463ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 116.725059ms iteration = 7 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
63252024-12-14T03:37:56.466ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
63262024-12-14T03:37:56.466ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
63272024-12-14T03:37:56.466ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
63282024-12-14T03:37:56.466ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
63292024-12-14T03:37:56.466ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
63302024-12-14T03:37:56.466ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
63312024-12-14T03:37:56.466ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 119.867622ms iteration = 7 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
63322024-12-14T03:37:56.466ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
63332024-12-14T03:37:56.468ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 122.29806ms iteration = 7 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
63342024-12-14T03:37:56.492ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
63352024-12-14T03:37:56.521ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
63362024-12-14T03:37:56.521ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
63372024-12-14T03:37:56.526ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
63382024-12-14T03:37:56.526ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
63392024-12-14T03:37:56.527ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d63884be-0c1c-4945-b304-2d1c570f665a", "content-length": "26", "date": "Sat, 14 Dec 2024 03:37:56 GMT"} })
63402024-12-14T03:37:56.527ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
63412024-12-14T03:37:56.529ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
63422024-12-14T03:37:56.532ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 186.6929ms iteration = 9 status = {"physical_disks_added":0}
63432024-12-14T03:37:56.563ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 zone_address = fd00:1122:3344:101::2
63442024-12-14T03:37:56.563ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
63452024-12-14T03:37:56.564ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "7d2b5a2d-b2eb-47bb-9f67-856a8ba9f880", "content-length": "26", "date": "Sat, 14 Dec 2024 03:37:56 GMT"} })
63462024-12-14T03:37:56.564ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
63472024-12-14T03:37:56.565ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200
63482024-12-14T03:37:56.605ZINFOnexus (BackgroundTasks): VPC route manager sled 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
63492024-12-14T03:37:56.605ZDEBGnexus (BackgroundTasks): client request SledAgent = 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
63502024-12-14T03:37:56.605ZDEBGnexus (BackgroundTasks): client response SledAgent = 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "b5fe8b1e-a6fa-4921-95b9-67124e619ed2", "content-length": "372", "date": "Sat, 14 Dec 2024 03:37:56 GMT"} })
63512024-12-14T03:37:56.606ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
63522024-12-14T03:37:56.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
63532024-12-14T03:37:56.607ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63542024-12-14T03:37:56.609ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63552024-12-14T03:37:56.609ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63562024-12-14T03:37:56.611ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 8d70e61c-94ed-41ce-b36c-cb904f92c534, lookup_type: ById(8d70e61c-94ed-41ce-b36c-cb904f92c534) } result = Ok(())
63572024-12-14T03:37:56.611ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
63582024-12-14T03:37:56.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
63592024-12-14T03:37:56.612ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
63602024-12-14T03:37:56.612ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
63612024-12-14T03:37:56.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
63622024-12-14T03:37:56.613ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
63632024-12-14T03:37:56.613ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
63642024-12-14T03:37:56.613ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 267.194523ms iteration = 7 status = 0
63652024-12-14T03:37:56.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
63662024-12-14T03:37:56.643ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
63672024-12-14T03:37:56.643ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = c7a5bbe9-1af5-4e36-80b5-da9e0053b676 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
63682024-12-14T03:37:56.643ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
63692024-12-14T03:37:56.643ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
63702024-12-14T03:37:56.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
63712024-12-14T03:37:56.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
63722024-12-14T03:37:56.644ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63732024-12-14T03:37:56.644ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
63742024-12-14T03:37:56.644ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
63752024-12-14T03:37:56.645ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63762024-12-14T03:37:56.645ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "110c7ffc-8ec0-48cd-926b-5fc3364a27ac", "content-length": "26", "date": "Sat, 14 Dec 2024 03:37:56 GMT"} })
63772024-12-14T03:37:56.645ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
63782024-12-14T03:37:56.645ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
63792024-12-14T03:37:56.645ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
63802024-12-14T03:37:56.645ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 51f6df17-b3b5-47fe-9a42-d8752f961c5e dns_zone_name = oxide.test found_so_far = 0 version = 2
63812024-12-14T03:37:56.645ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
63822024-12-14T03:37:56.645ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
63832024-12-14T03:37:56.646ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
63842024-12-14T03:37:56.646ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
63852024-12-14T03:37:56.646ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
63862024-12-14T03:37:56.646ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
63872024-12-14T03:37:56.646ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63882024-12-14T03:37:56.648ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
63892024-12-14T03:37:56.648ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
63902024-12-14T03:37:56.648ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
63912024-12-14T03:37:56.649ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
63922024-12-14T03:37:56.649ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
63932024-12-14T03:37:56.649ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
63942024-12-14T03:37:56.651ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = c7a5bbe9-1af5-4e36-80b5-da9e0053b676 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
63952024-12-14T03:37:56.651ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
63962024-12-14T03:37:56.651ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-14 03:35:40.104814 UTC dns_group = internal generation = 1
63972024-12-14T03:37:56.651ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 305.225095ms iteration = 5 status = {"generation":1}
63982024-12-14T03:37:56.654ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
63992024-12-14T03:37:56.654ZDEBGnexus (BackgroundTasks): client request SledAgent = 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
64002024-12-14T03:37:56.654ZDEBGnexus (BackgroundTasks): client response SledAgent = 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "5c75bc93-31c7-4a35-aa9c-baa61ffb295d", "date": "Sat, 14 Dec 2024 03:37:56 GMT"} })
64012024-12-14T03:37:56.654ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
64022024-12-14T03:37:56.654ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
64032024-12-14T03:37:56.664ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
64042024-12-14T03:37:56.678ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64052024-12-14T03:37:56.680ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
64062024-12-14T03:37:56.680ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
64072024-12-14T03:37:56.681ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
64082024-12-14T03:37:56.707ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
64092024-12-14T03:37:56.708ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 361.691536ms iteration = 4 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
64102024-12-14T03:37:56.808ZDEBGnexus (BackgroundTasks): client request SledAgent = 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
64112024-12-14T03:37:56.808ZDEBGnexus (BackgroundTasks): client response SledAgent = 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "c9e94b64-b3d3-4f0b-b799-b8cce97551cf", "content-length": "691", "date": "Sat, 14 Dec 2024 03:37:56 GMT"} })
64122024-12-14T03:37:56.808ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
64132024-12-14T03:37:56.808ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
64142024-12-14T03:37:56.808ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
64152024-12-14T03:37:56.810ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 51f6df17-b3b5-47fe-9a42-d8752f961c5e dns_zone_name = oxide.test found_so_far = 1 version = 2
64162024-12-14T03:37:56.810ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
64172024-12-14T03:37:56.810ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-14 03:35:40.905586 UTC dns_group = external generation = 2
64182024-12-14T03:37:56.810ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 464.366633ms iteration = 5 status = {"generation":2}
64192024-12-14T03:37:56.810ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 464.887823ms iteration = 7 status = {}
64202024-12-14T03:37:56.811ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
64212024-12-14T03:37:56.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
64222024-12-14T03:37:56.814ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
64232024-12-14T03:37:56.814ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
64242024-12-14T03:37:56.817ZINFOnexus (BackgroundTasks): VPC route manager sled 8d70e61c-94ed-41ce-b36c-cb904f92c534 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
64252024-12-14T03:37:56.817ZDEBGnexus (BackgroundTasks): client request SledAgent = 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
64262024-12-14T03:37:56.817ZDEBGnexus (BackgroundTasks): client response SledAgent = 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "8cfddb75-e361-4b01-98ea-d42256797508", "date": "Sat, 14 Dec 2024 03:37:56 GMT"} })
64272024-12-14T03:37:56.819ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 473.062087ms iteration = 8 status = {}
64282024-12-14T03:37:56.832ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
64292024-12-14T03:37:56.832ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "e8abd5c7-e55a-4e12-97af-af09ba449e48", "date": "Sat, 14 Dec 2024 03:37:56 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
64302024-12-14T03:37:56.832ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
64312024-12-14T03:37:56.833ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "9d3cc387-9d32-448d-ad2c-e6e794618b58", "date": "Sat, 14 Dec 2024 03:37:56 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
64322024-12-14T03:37:56.833ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
64332024-12-14T03:37:56.834ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "d9eb5440-364a-446b-87d2-8f5f4b54acf0", "date": "Sat, 14 Dec 2024 03:37:56 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
64342024-12-14T03:37:56.834ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
64352024-12-14T03:37:56.836ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
64362024-12-14T03:37:56.836ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 490.13081ms iteration = 6 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
64372024-12-14T03:37:56.844ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-14T03:34:54.541856Z, time_modified: 2024-12-14T03:34:54.541856Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, db_silo: Silo { identity: SiloIdentity { id: 578bc52c-ac81-41a6-a56b-dfc79805368e, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-14T03:35:40.848931Z, time_modified: 2024-12-14T03:35:40.848931Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "4dfc5e49ed154568e7a05c630983c79e7ad097d55e90f834bee8ffda0c5a5c9e" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, db_silo: Silo { identity: SiloIdentity { id: 578bc52c-ac81-41a6-a56b-dfc79805368e, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-14T03:35:40.848931Z, time_modified: 2024-12-14T03:35:40.848931Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "4dfc5e49ed154568e7a05c630983c79e7ad097d55e90f834bee8ffda0c5a5c9e" }] }) }
64382024-12-14T03:37:56.844ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 497.884445ms iteration = 5 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"578bc52c-ac81-41a6-a56b-dfc79805368e","tls_certs":["4dfc5e49ed154568e7a05c630983c79e7ad097d55e90f834bee8ffda0c5a5c9e"]}},"default_endpoint":{"silo_id":"578bc52c-ac81-41a6-a56b-dfc79805368e","tls_certs":["4dfc5e49ed154568e7a05c630983c79e7ad097d55e90f834bee8ffda0c5a5c9e"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
64392024-12-14T03:37:56.956ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
64402024-12-14T03:37:56.956ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "f5f8b926-310d-466c-88e6-f97badfb3fee", "content-length": "1", "date": "Sat, 14 Dec 2024 03:37:56 GMT"} })
64412024-12-14T03:37:56.958ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
64422024-12-14T03:37:56.958ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
64432024-12-14T03:37:56.960ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 614.460921ms iteration = 7 status = null
64442024-12-14T03:37:56.988ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64452024-12-14T03:37:56.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64462024-12-14T03:37:56.990ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 644.757508ms iteration = 7 status = {}
64472024-12-14T03:37:56.990ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 45ca990e-42e9-4264-be3e-0adfed2cd99b, rack_id: a121ca05-bbee-41bf-b9db-9e03ff035200, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(811a570a-bdaf-4a1b-8eba-0c0e4977f7bb) } rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 switch_location = Switch0
64482024-12-14T03:37:56.990ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64492024-12-14T03:37:56.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64502024-12-14T03:37:56.991ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
64512024-12-14T03:37:56.992ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "8c1a9051-0001-41a6-a7f5-5d3f39688790", "date": "Sat, 14 Dec 2024 03:37:56 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
64522024-12-14T03:37:56.992ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
64532024-12-14T03:37:56.993ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "cdd1e735-4c9d-4f8f-a5ef-b0b28d1e7c9e", "date": "Sat, 14 Dec 2024 03:37:56 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
64542024-12-14T03:37:56.993ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
64552024-12-14T03:37:56.995ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
64562024-12-14T03:37:56.995ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 648.89796ms iteration = 6 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
64572024-12-14T03:37:56.999ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
64582024-12-14T03:37:56.999ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "3bfdf35a-8a98-47d3-82bb-c8182fcd062f", "content-length": "134", "date": "Sat, 14 Dec 2024 03:37:56 GMT"} })
64592024-12-14T03:37:56.999ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
64602024-12-14T03:37:56.999ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 811a570a-bdaf-4a1b-8eba-0c0e4977f7bb
64612024-12-14T03:37:56.999ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
64622024-12-14T03:37:56.999ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
64632024-12-14T03:37:56.999ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
64642024-12-14T03:37:56.999ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
64652024-12-14T03:37:56.999ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
64662024-12-14T03:37:56.999ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
64672024-12-14T03:37:56.999ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
64682024-12-14T03:37:56.999ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
64692024-12-14T03:37:57.000ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200
64702024-12-14T03:37:57.000ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64712024-12-14T03:37:57.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64722024-12-14T03:37:57.002ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
64732024-12-14T03:37:57.002ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "b6b21942-484f-4ab4-865c-67d556e4d46c", "content-length": "2", "date": "Sat, 14 Dec 2024 03:37:56 GMT"} })
64742024-12-14T03:37:57.002ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
64752024-12-14T03:37:57.002ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "b8aa4f7c-ca9e-4bb5-8d3e-f9fe219249ae", "content-length": "52", "date": "Sat, 14 Dec 2024 03:37:56 GMT"} })
64762024-12-14T03:37:57.002ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 switch_location = Switch0
64772024-12-14T03:37:57.002ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
64782024-12-14T03:37:57.078ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:45254
64792024-12-14T03:37:57.078ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:45254 req_id = c8fdb546-68b5-4d01-9273-68eeae78bcc4 roles = RoleSet { roles: {} } uri = /metrics/producers
64802024-12-14T03:37:57.078ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:45254 req_id = c8fdb546-68b5-4d01-9273-68eeae78bcc4 resource = Database result = Ok(()) uri = /metrics/producers
64812024-12-14T03:37:57.096ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "8292e495-58bf-4bdb-a301-9137211ff57d", "date": "Sat, 14 Dec 2024 03:37:56 GMT"} })
64822024-12-14T03:37:57.096ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 switch = Switch0
64832024-12-14T03:37:57.096ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
64842024-12-14T03:37:57.097ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "fd44e016-f8ef-4f0d-b9af-ab37aefd2d2a", "content-length": "682", "date": "Sat, 14 Dec 2024 03:37:56 GMT"} })
64852024-12-14T03:37:57.097ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64862024-12-14T03:37:57.097ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64872024-12-14T03:37:57.100ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64882024-12-14T03:37:57.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64892024-12-14T03:37:57.104ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64902024-12-14T03:37:57.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64912024-12-14T03:37:57.107ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64922024-12-14T03:37:57.107ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64932024-12-14T03:37:57.114ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 768.620099ms iteration = 7 status = {}
64942024-12-14T03:37:57.115ZINFOnexus: assigned collector to new producer collector_id = a321e00a-3126-4ea4-b26d-c0e3eea69166 file = nexus/src/app/oximeter.rs:76 producer_id = db02be0a-738a-45e5-a854-a5c5be80bed4
64952024-12-14T03:37:57.115ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 37176 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:45254 req_id = c8fdb546-68b5-4d01-9273-68eeae78bcc4 response_code = 201 uri = /metrics/producers
64962024-12-14T03:38:05.611ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1062 local_addr = [fd00:1122:3344:101::b]:56585 method = GET remote_addr = [fd00:1122:3344:101::d]:58979 req_id = 1deffcd3-db0f-49a2-a45a-6dadc2d824bd response_code = 200 uri = /5f2fe413-3c4a-4994-b4a0-995c1da486b1
64972024-12-14T03:38:06.345ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 20 reason = Timeout
64982024-12-14T03:38:06.345ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
64992024-12-14T03:38:06.345ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 20 reason = Timeout
65002024-12-14T03:38:06.345ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65012024-12-14T03:38:06.346ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
65022024-12-14T03:38:06.346ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65032024-12-14T03:38:06.381ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
65042024-12-14T03:38:06.381ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
65052024-12-14T03:38:06.382ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65062024-12-14T03:38:06.385ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
65072024-12-14T03:38:06.385ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65082024-12-14T03:38:06.385ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65092024-12-14T03:38:06.387ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65102024-12-14T03:38:06.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65112024-12-14T03:38:06.388ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65122024-12-14T03:38:06.390ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1, lookup_type: ById(eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1) } result = Ok(())
65132024-12-14T03:38:06.390ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65142024-12-14T03:38:06.390ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65152024-12-14T03:38:06.406ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1 original_time_created = 2024-12-14 03:34:51.368980 UTC target_id = eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1 time_created = 2024-12-14 03:34:51.368980 UTC
65162024-12-14T03:38:06.406ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 60.329949ms iteration = 20 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1","time_created":"2024-12-14T03:34:51.368980Z"}
65172024-12-14T03:38:06.417ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 71.586514ms iteration = 20 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
65182024-12-14T03:38:08.638ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:50478
65192024-12-14T03:38:08.638ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:50478 req_id = 8d81aa9a-1191-458b-9fb8-af70609127ef roles = RoleSet { roles: {} } uri = /metrics/producers
65202024-12-14T03:38:08.639ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:50478 req_id = 8d81aa9a-1191-458b-9fb8-af70609127ef resource = Database result = Ok(()) uri = /metrics/producers
65212024-12-14T03:38:08.675ZINFOnexus: assigned collector to new producer collector_id = a321e00a-3126-4ea4-b26d-c0e3eea69166 file = nexus/src/app/oximeter.rs:76 producer_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534
65222024-12-14T03:38:08.675ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 36719 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:50478 req_id = 8d81aa9a-1191-458b-9fb8-af70609127ef response_code = 201 uri = /metrics/producers
65232024-12-14T03:38:10.601ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:56805 req_id = 9ed2de58-ad68-435e-a67f-b39973cd646d roles = RoleSet { roles: {} } uri = /metrics/collectors/a321e00a-3126-4ea4-b26d-c0e3eea69166/producers?sort_by=id_ascending
65242024-12-14T03:38:10.601ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:56805 req_id = 9ed2de58-ad68-435e-a67f-b39973cd646d resource = Database result = Ok(()) uri = /metrics/collectors/a321e00a-3126-4ea4-b26d-c0e3eea69166/producers?sort_by=id_ascending
65252024-12-14T03:38:10.603ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2837 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:56805 req_id = 9ed2de58-ad68-435e-a67f-b39973cd646d response_code = 200 uri = /metrics/collectors/a321e00a-3126-4ea4-b26d-c0e3eea69166/producers?sort_by=id_ascending
65262024-12-14T03:38:10.604ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:56805 req_id = e7b5fd4f-1b71-4aa6-848b-eb5c9b42ccfa roles = RoleSet { roles: {} } uri = /metrics/collectors/a321e00a-3126-4ea4-b26d-c0e3eea69166/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlOGQ5NjQ2Zi1hNTQxLTRjMTEtYjViMi1mOTUzNDI3Y2EyZjMifX0%3D
65272024-12-14T03:38:10.604ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:56805 req_id = e7b5fd4f-1b71-4aa6-848b-eb5c9b42ccfa resource = Database result = Ok(()) uri = /metrics/collectors/a321e00a-3126-4ea4-b26d-c0e3eea69166/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlOGQ5NjQ2Zi1hNTQxLTRjMTEtYjViMi1mOTUzNDI3Y2EyZjMifX0%3D
65282024-12-14T03:38:10.606ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2487 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:56805 req_id = e7b5fd4f-1b71-4aa6-848b-eb5c9b42ccfa response_code = 200 uri = /metrics/collectors/a321e00a-3126-4ea4-b26d-c0e3eea69166/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlOGQ5NjQ2Zi1hNTQxLTRjMTEtYjViMi1mOTUzNDI3Y2EyZjMifX0%3D
65292024-12-14T03:38:11.574ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
65302024-12-14T03:38:11.574ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::b]:12221
65312024-12-14T03:38:11.604ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
65322024-12-14T03:38:11.605ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::b]:50126
65332024-12-14T03:38:11.605ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:50126 req_id = d27707d9-f122-42ad-ad88-4826044c1bfb roles = RoleSet { roles: {} } uri = /metrics/producers
65342024-12-14T03:38:11.605ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:50126 req_id = d27707d9-f122-42ad-ad88-4826044c1bfb resource = Database result = Ok(()) uri = /metrics/producers
65352024-12-14T03:38:11.624ZINFOnexus: assigned collector to new producer collector_id = a321e00a-3126-4ea4-b26d-c0e3eea69166 file = nexus/src/app/oximeter.rs:76 producer_id = 5f2fe413-3c4a-4994-b4a0-995c1da486b1
65362024-12-14T03:38:11.624ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 19073 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:50126 req_id = d27707d9-f122-42ad-ad88-4826044c1bfb response_code = 201 uri = /metrics/producers
65372024-12-14T03:38:11.624ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "d27707d9-f122-42ad-ad88-4826044c1bfb", "content-length": "41", "date": "Sat, 14 Dec 2024 03:38:11 GMT"} })
65382024-12-14T03:38:11.625ZDEBGnexus (producer-registration-task): registered with nexus successfully
65392024-12-14T03:38:11.625ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
65402024-12-14T03:38:15.611ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1228 local_addr = [fd00:1122:3344:101::b]:56585 method = GET remote_addr = [fd00:1122:3344:101::d]:58979 req_id = b3a6b148-75af-48dd-97f4-3e24f1bed325 response_code = 200 uri = /5f2fe413-3c4a-4994-b4a0-995c1da486b1
65412024-12-14T03:38:16.345ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 21 reason = Timeout
65422024-12-14T03:38:16.346ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
65432024-12-14T03:38:16.346ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 21 reason = Timeout
65442024-12-14T03:38:16.346ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65452024-12-14T03:38:16.346ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
65462024-12-14T03:38:16.346ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65472024-12-14T03:38:16.348ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
65482024-12-14T03:38:16.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
65492024-12-14T03:38:16.349ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.911098ms iteration = 21 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
65502024-12-14T03:38:16.373ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65512024-12-14T03:38:16.376ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
65522024-12-14T03:38:16.376ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65532024-12-14T03:38:16.376ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65542024-12-14T03:38:16.378ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65552024-12-14T03:38:16.378ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65562024-12-14T03:38:16.380ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65572024-12-14T03:38:16.382ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1, lookup_type: ById(eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1) } result = Ok(())
65582024-12-14T03:38:16.382ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65592024-12-14T03:38:16.383ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65602024-12-14T03:38:16.394ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1 original_time_created = 2024-12-14 03:34:51.368980 UTC target_id = eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1 time_created = 2024-12-14 03:34:51.368980 UTC
65612024-12-14T03:38:16.394ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 48.43515ms iteration = 21 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1","time_created":"2024-12-14T03:34:51.368980Z"}
65622024-12-14T03:38:21.936ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:53994
65632024-12-14T03:38:21.936ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:53994 req_id = 5d69e2c9-2b90-4066-ba82-d9460daa797a roles = RoleSet { roles: {} } uri = /metrics/producers
65642024-12-14T03:38:21.937ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:53994 req_id = 5d69e2c9-2b90-4066-ba82-d9460daa797a resource = Database result = Ok(()) uri = /metrics/producers
65652024-12-14T03:38:21.998ZINFOnexus: assigned collector to new producer collector_id = a321e00a-3126-4ea4-b26d-c0e3eea69166 file = nexus/src/app/oximeter.rs:76 producer_id = 232a98a5-5cb7-4d84-a629-b03087fbd5b7
65662024-12-14T03:38:21.998ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 61491 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:53994 req_id = 5d69e2c9-2b90-4066-ba82-d9460daa797a response_code = 201 uri = /metrics/producers
65672024-12-14T03:38:25.612ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1131 local_addr = [fd00:1122:3344:101::b]:56585 method = GET remote_addr = [fd00:1122:3344:101::d]:58979 req_id = b06b4512-ef35-4af1-88dd-aa89d1a88b63 response_code = 200 uri = /5f2fe413-3c4a-4994-b4a0-995c1da486b1
65682024-12-14T03:38:26.346ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 9 reason = Timeout
65692024-12-14T03:38:26.346ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
65702024-12-14T03:38:26.346ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 8 reason = Timeout
65712024-12-14T03:38:26.346ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
65722024-12-14T03:38:26.346ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 8 reason = Timeout
65732024-12-14T03:38:26.346ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 10 reason = Timeout
65742024-12-14T03:38:26.346ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
65752024-12-14T03:38:26.346ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 22 reason = Timeout
65762024-12-14T03:38:26.346ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 8 reason = Timeout
65772024-12-14T03:38:26.346ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
65782024-12-14T03:38:26.346ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65792024-12-14T03:38:26.346ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
65802024-12-14T03:38:26.346ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 8 reason = Timeout
65812024-12-14T03:38:26.346ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
65822024-12-14T03:38:26.346ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 8 reason = Timeout
65832024-12-14T03:38:26.346ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
65842024-12-14T03:38:26.346ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 8 reason = Timeout
65852024-12-14T03:38:26.346ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 8 reason = Timeout
65862024-12-14T03:38:26.346ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
65872024-12-14T03:38:26.346ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 8 reason = Timeout
65882024-12-14T03:38:26.346ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
65892024-12-14T03:38:26.346ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
65902024-12-14T03:38:26.346ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 8 reason = Timeout
65912024-12-14T03:38:26.346ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
65922024-12-14T03:38:26.346ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 8 reason = Timeout
65932024-12-14T03:38:26.346ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
65942024-12-14T03:38:26.346ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
65952024-12-14T03:38:26.346ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 22 reason = Timeout
65962024-12-14T03:38:26.346ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
65972024-12-14T03:38:26.346ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 8 reason = Timeout
65982024-12-14T03:38:26.346ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
65992024-12-14T03:38:26.346ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 8 reason = Timeout
66002024-12-14T03:38:26.346ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
66012024-12-14T03:38:26.346ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
66022024-12-14T03:38:26.346ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 8 reason = Timeout
66032024-12-14T03:38:26.346ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
66042024-12-14T03:38:26.346ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
66052024-12-14T03:38:26.346ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
66062024-12-14T03:38:26.346ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66072024-12-14T03:38:26.346ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
66082024-12-14T03:38:26.346ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
66092024-12-14T03:38:26.346ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
66102024-12-14T03:38:26.346ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
66112024-12-14T03:38:26.346ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
66122024-12-14T03:38:26.346ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
66132024-12-14T03:38:26.346ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
66142024-12-14T03:38:26.346ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
66152024-12-14T03:38:26.346ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
66162024-12-14T03:38:26.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
66172024-12-14T03:38:26.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
66182024-12-14T03:38:26.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
66192024-12-14T03:38:26.349ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66202024-12-14T03:38:26.350ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66212024-12-14T03:38:26.350ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.251535ms iteration = 8 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
66222024-12-14T03:38:26.351ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
66232024-12-14T03:38:26.351ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
66242024-12-14T03:38:26.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
66252024-12-14T03:38:26.354ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
66262024-12-14T03:38:26.354ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66272024-12-14T03:38:26.354ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66282024-12-14T03:38:26.356ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8d70e61c-94ed-41ce-b36c-cb904f92c534.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8d70e61c-94ed-41ce-b36c-cb904f92c534.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1312, tv_nsec: 675351868 } })
66292024-12-14T03:38:26.356ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
66302024-12-14T03:38:26.357ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66312024-12-14T03:38:26.358ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8d70e61c-94ed-41ce-b36c-cb904f92c534.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8d70e61c-94ed-41ce-b36c-cb904f92c534.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1312, tv_nsec: 677852658 } })
66322024-12-14T03:38:26.358ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
66332024-12-14T03:38:26.360ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
66342024-12-14T03:38:26.360ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
66352024-12-14T03:38:26.360ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66362024-12-14T03:38:26.360ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
66372024-12-14T03:38:26.360ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
66382024-12-14T03:38:26.360ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66392024-12-14T03:38:26.361ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
66402024-12-14T03:38:26.391ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66412024-12-14T03:38:26.394ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
66422024-12-14T03:38:26.394ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
66432024-12-14T03:38:26.397ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
66442024-12-14T03:38:26.399ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
66452024-12-14T03:38:26.399ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
66462024-12-14T03:38:26.399ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
66472024-12-14T03:38:26.399ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
66482024-12-14T03:38:26.399ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
66492024-12-14T03:38:26.399ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
66502024-12-14T03:38:26.400ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66512024-12-14T03:38:26.401ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8d70e61c-94ed-41ce-b36c-cb904f92c534.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8d70e61c-94ed-41ce-b36c-cb904f92c534.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1312, tv_nsec: 720278908 } })
66522024-12-14T03:38:26.401ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200
66532024-12-14T03:38:26.403ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66542024-12-14T03:38:26.403ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
66552024-12-14T03:38:26.403ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
66562024-12-14T03:38:26.404ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
66572024-12-14T03:38:26.404ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
66582024-12-14T03:38:26.404ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
66592024-12-14T03:38:26.405ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66602024-12-14T03:38:26.405ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 58.792798ms iteration = 8 status = {"errors":[],"records_set_to_done":[]}
66612024-12-14T03:38:26.405ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
66622024-12-14T03:38:26.405ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
66632024-12-14T03:38:26.405ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
66642024-12-14T03:38:26.406ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
66652024-12-14T03:38:26.406ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
66662024-12-14T03:38:26.407ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
66672024-12-14T03:38:26.407ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
66682024-12-14T03:38:26.408ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
66692024-12-14T03:38:26.408ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
66702024-12-14T03:38:26.408ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
66712024-12-14T03:38:26.408ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66722024-12-14T03:38:26.410ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 63.38742ms iteration = 8 status = {"errors":[],"garbage_collect_requested":[]}
66732024-12-14T03:38:26.411ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
66742024-12-14T03:38:26.411ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 65.556434ms iteration = 8 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
66752024-12-14T03:38:26.412ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1, lookup_type: ById(eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1) } result = Ok(())
66762024-12-14T03:38:26.412ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66772024-12-14T03:38:26.412ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66782024-12-14T03:38:26.414ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
66792024-12-14T03:38:26.415ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
66802024-12-14T03:38:26.428ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
66812024-12-14T03:38:26.428ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
66822024-12-14T03:38:26.428ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c8cd72d7-7d44-4156-8d51-db57040b5692", "content-length": "26", "date": "Sat, 14 Dec 2024 03:38:26 GMT"} })
66832024-12-14T03:38:26.428ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
66842024-12-14T03:38:26.428ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1 original_time_created = 2024-12-14 03:34:51.368980 UTC target_id = eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1 time_created = 2024-12-14 03:34:51.368980 UTC
66852024-12-14T03:38:26.428ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 82.588804ms iteration = 22 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1","time_created":"2024-12-14T03:34:51.368980Z"}
66862024-12-14T03:38:26.429ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
66872024-12-14T03:38:26.433ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
66882024-12-14T03:38:26.433ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
66892024-12-14T03:38:26.433ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 87.639875ms iteration = 8 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
66902024-12-14T03:38:26.433ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e83c1381-c1eb-47cc-b6f1-527eaf1b8345", "content-length": "26", "date": "Sat, 14 Dec 2024 03:38:26 GMT"} })
66912024-12-14T03:38:26.434ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
66922024-12-14T03:38:26.435ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
66932024-12-14T03:38:26.435ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
66942024-12-14T03:38:26.435ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
66952024-12-14T03:38:26.435ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
66962024-12-14T03:38:26.436ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
66972024-12-14T03:38:26.437ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
66982024-12-14T03:38:26.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
66992024-12-14T03:38:26.439ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
67002024-12-14T03:38:26.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
67012024-12-14T03:38:26.441ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67022024-12-14T03:38:26.441ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67032024-12-14T03:38:26.442ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 96.485032ms iteration = 22 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
67042024-12-14T03:38:26.443ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 96.8865ms iteration = 8 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
67052024-12-14T03:38:26.444ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 8d70e61c-94ed-41ce-b36c-cb904f92c534, lookup_type: ById(8d70e61c-94ed-41ce-b36c-cb904f92c534) } result = Ok(())
67062024-12-14T03:38:26.444ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
67072024-12-14T03:38:26.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
67082024-12-14T03:38:26.445ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
67092024-12-14T03:38:26.445ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
67102024-12-14T03:38:26.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
67112024-12-14T03:38:26.445ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 99.518883ms iteration = 8 status = 0
67122024-12-14T03:38:26.453ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
67132024-12-14T03:38:26.453ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
67142024-12-14T03:38:26.465ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
67152024-12-14T03:38:26.465ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
67162024-12-14T03:38:26.465ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 119.33234ms iteration = 8 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
67172024-12-14T03:38:26.483ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 136.614746ms iteration = 8 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
67182024-12-14T03:38:26.484ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
67192024-12-14T03:38:26.484ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
67202024-12-14T03:38:26.497ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 zone_address = fd00:1122:3344:101::2
67212024-12-14T03:38:26.497ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
67222024-12-14T03:38:26.497ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4a9b114b-40f7-495f-a159-bbd07471afa4", "content-length": "26", "date": "Sat, 14 Dec 2024 03:38:26 GMT"} })
67232024-12-14T03:38:26.497ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
67242024-12-14T03:38:26.499ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200
67252024-12-14T03:38:26.515ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 169.813691ms iteration = 10 status = {"physical_disks_added":0}
67262024-12-14T03:38:26.576ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
67272024-12-14T03:38:26.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
67282024-12-14T03:38:26.578ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67292024-12-14T03:38:26.580ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
67302024-12-14T03:38:26.580ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
67312024-12-14T03:38:26.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
67322024-12-14T03:38:26.620ZINFOnexus (BackgroundTasks): VPC route manager sled 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
67332024-12-14T03:38:26.620ZDEBGnexus (BackgroundTasks): client request SledAgent = 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
67342024-12-14T03:38:26.620ZDEBGnexus (BackgroundTasks): client response SledAgent = 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "01c01090-c9f4-47c5-b7b7-30ab59ab3c09", "content-length": "372", "date": "Sat, 14 Dec 2024 03:38:26 GMT"} })
67352024-12-14T03:38:26.620ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
67362024-12-14T03:38:26.621ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
67372024-12-14T03:38:26.653ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67382024-12-14T03:38:26.655ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
67392024-12-14T03:38:26.655ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
67402024-12-14T03:38:26.655ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
67412024-12-14T03:38:26.667ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
67422024-12-14T03:38:26.667ZDEBGnexus (BackgroundTasks): client request SledAgent = 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
67432024-12-14T03:38:26.667ZDEBGnexus (BackgroundTasks): client response SledAgent = 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "a04caf55-006c-4efb-b9dc-e0495c718dc3", "date": "Sat, 14 Dec 2024 03:38:26 GMT"} })
67442024-12-14T03:38:26.667ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
67452024-12-14T03:38:26.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
67462024-12-14T03:38:26.670ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
67472024-12-14T03:38:26.670ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
67482024-12-14T03:38:26.672ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
67492024-12-14T03:38:26.673ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
67502024-12-14T03:38:26.676ZINFOnexus (BackgroundTasks): VPC route manager sled 8d70e61c-94ed-41ce-b36c-cb904f92c534 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
67512024-12-14T03:38:26.676ZDEBGnexus (BackgroundTasks): client request SledAgent = 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
67522024-12-14T03:38:26.676ZDEBGnexus (BackgroundTasks): client response SledAgent = 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "073dac89-dfb4-465a-8458-ca8188033a2a", "date": "Sat, 14 Dec 2024 03:38:26 GMT"} })
67532024-12-14T03:38:26.677ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 331.757545ms iteration = 9 status = {}
67542024-12-14T03:38:26.683ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
67552024-12-14T03:38:26.683ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "ef9331e5-008b-4a94-bdf7-61303ae1bd37", "content-length": "1", "date": "Sat, 14 Dec 2024 03:38:25 GMT"} })
67562024-12-14T03:38:26.685ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
67572024-12-14T03:38:26.685ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
67582024-12-14T03:38:26.687ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 341.329157ms iteration = 8 status = null
67592024-12-14T03:38:26.699ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 353.028442ms iteration = 8 status = {}
67602024-12-14T03:38:26.733ZDEBGnexus (BackgroundTasks): client request SledAgent = 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
67612024-12-14T03:38:26.733ZDEBGnexus (BackgroundTasks): client response SledAgent = 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "0ff63d66-e900-44bd-b88c-0e5030c01de2", "content-length": "691", "date": "Sat, 14 Dec 2024 03:38:26 GMT"} })
67622024-12-14T03:38:26.733ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
67632024-12-14T03:38:26.733ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
67642024-12-14T03:38:26.733ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
67652024-12-14T03:38:26.734ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 388.228698ms iteration = 8 status = {}
67662024-12-14T03:38:26.788ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
67672024-12-14T03:38:26.789ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
67682024-12-14T03:38:26.790ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 45ca990e-42e9-4264-be3e-0adfed2cd99b, rack_id: a121ca05-bbee-41bf-b9db-9e03ff035200, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(811a570a-bdaf-4a1b-8eba-0c0e4977f7bb) } rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 switch_location = Switch0
67692024-12-14T03:38:26.790ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
67702024-12-14T03:38:26.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
67712024-12-14T03:38:26.800ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
67722024-12-14T03:38:26.800ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "1ce88f87-a232-4c2e-9bbb-c0ad795a1bb4", "content-length": "134", "date": "Sat, 14 Dec 2024 03:38:25 GMT"} })
67732024-12-14T03:38:26.800ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
67742024-12-14T03:38:26.800ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 811a570a-bdaf-4a1b-8eba-0c0e4977f7bb
67752024-12-14T03:38:26.801ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
67762024-12-14T03:38:26.801ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
67772024-12-14T03:38:26.801ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
67782024-12-14T03:38:26.801ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
67792024-12-14T03:38:26.801ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
67802024-12-14T03:38:26.801ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
67812024-12-14T03:38:26.801ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
67822024-12-14T03:38:26.801ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
67832024-12-14T03:38:26.801ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200
67842024-12-14T03:38:26.801ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
67852024-12-14T03:38:26.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
67862024-12-14T03:38:26.803ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
67872024-12-14T03:38:26.803ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "99db264d-7373-46db-8d57-2f3865480c60", "content-length": "2", "date": "Sat, 14 Dec 2024 03:38:25 GMT"} })
67882024-12-14T03:38:26.803ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
67892024-12-14T03:38:26.803ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "918741ad-a9a4-4360-b8af-d3bd030afd75", "content-length": "52", "date": "Sat, 14 Dec 2024 03:38:25 GMT"} })
67902024-12-14T03:38:26.803ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 switch_location = Switch0
67912024-12-14T03:38:26.803ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
67922024-12-14T03:38:26.891ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "0ce9bca0-2f2b-4aef-8c7c-0184fb89bf56", "date": "Sat, 14 Dec 2024 03:38:26 GMT"} })
67932024-12-14T03:38:26.891ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 switch = Switch0
67942024-12-14T03:38:26.891ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
67952024-12-14T03:38:26.892ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "f1826b19-9299-4478-85f2-96ebcbea621b", "content-length": "682", "date": "Sat, 14 Dec 2024 03:38:26 GMT"} })
67962024-12-14T03:38:26.892ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
67972024-12-14T03:38:26.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
67982024-12-14T03:38:26.896ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
67992024-12-14T03:38:26.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
68002024-12-14T03:38:26.899ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
68012024-12-14T03:38:26.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
68022024-12-14T03:38:26.901ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
68032024-12-14T03:38:26.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
68042024-12-14T03:38:26.908ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 561.970878ms iteration = 8 status = {}
68052024-12-14T03:38:35.611ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1144 local_addr = [fd00:1122:3344:101::b]:56585 method = GET remote_addr = [fd00:1122:3344:101::d]:58979 req_id = bfe472e8-3f17-4452-aeae-3415a70d5e29 response_code = 200 uri = /5f2fe413-3c4a-4994-b4a0-995c1da486b1
68062024-12-14T03:38:36.346ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 23 reason = Timeout
68072024-12-14T03:38:36.346ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 23 reason = Timeout
68082024-12-14T03:38:36.346ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
68092024-12-14T03:38:36.346ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68102024-12-14T03:38:36.346ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
68112024-12-14T03:38:36.346ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68122024-12-14T03:38:36.348ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68132024-12-14T03:38:36.350ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
68142024-12-14T03:38:36.350ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68152024-12-14T03:38:36.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68162024-12-14T03:38:36.353ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68172024-12-14T03:38:36.353ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68182024-12-14T03:38:36.354ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68192024-12-14T03:38:36.357ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1, lookup_type: ById(eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1) } result = Ok(())
68202024-12-14T03:38:36.357ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68212024-12-14T03:38:36.357ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68222024-12-14T03:38:36.368ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1 original_time_created = 2024-12-14 03:34:51.368980 UTC target_id = eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1 time_created = 2024-12-14 03:34:51.368980 UTC
68232024-12-14T03:38:36.368ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.810077ms iteration = 23 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1","time_created":"2024-12-14T03:34:51.368980Z"}
68242024-12-14T03:38:36.381ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
68252024-12-14T03:38:36.381ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
68262024-12-14T03:38:36.410ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 64.83989ms iteration = 23 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
68272024-12-14T03:38:40.601ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:56805 req_id = 7be33282-c90a-41d0-afb1-9e7e8a50e596 roles = RoleSet { roles: {} } uri = /metrics/collectors/a321e00a-3126-4ea4-b26d-c0e3eea69166/producers?sort_by=id_ascending
68282024-12-14T03:38:40.602ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:56805 req_id = 7be33282-c90a-41d0-afb1-9e7e8a50e596 resource = Database result = Ok(()) uri = /metrics/collectors/a321e00a-3126-4ea4-b26d-c0e3eea69166/producers?sort_by=id_ascending
68292024-12-14T03:38:40.604ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2595 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:56805 req_id = 7be33282-c90a-41d0-afb1-9e7e8a50e596 response_code = 200 uri = /metrics/collectors/a321e00a-3126-4ea4-b26d-c0e3eea69166/producers?sort_by=id_ascending
68302024-12-14T03:38:40.604ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:56805 req_id = f383436f-98c5-4744-99dc-924e47eeea12 roles = RoleSet { roles: {} } uri = /metrics/collectors/a321e00a-3126-4ea4-b26d-c0e3eea69166/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlOGQ5NjQ2Zi1hNTQxLTRjMTEtYjViMi1mOTUzNDI3Y2EyZjMifX0%3D
68312024-12-14T03:38:40.604ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:56805 req_id = f383436f-98c5-4744-99dc-924e47eeea12 resource = Database result = Ok(()) uri = /metrics/collectors/a321e00a-3126-4ea4-b26d-c0e3eea69166/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlOGQ5NjQ2Zi1hNTQxLTRjMTEtYjViMi1mOTUzNDI3Y2EyZjMifX0%3D
68322024-12-14T03:38:40.606ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2027 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:56805 req_id = f383436f-98c5-4744-99dc-924e47eeea12 response_code = 200 uri = /metrics/collectors/a321e00a-3126-4ea4-b26d-c0e3eea69166/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlOGQ5NjQ2Zi1hNTQxLTRjMTEtYjViMi1mOTUzNDI3Y2EyZjMifX0%3D
68332024-12-14T03:38:44.678ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:41833
68342024-12-14T03:38:44.679ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:41833 req_id = b8a7bc0d-1d0d-4a3e-91af-2cc11faf4d6e roles = RoleSet { roles: {} } uri = /metrics/producers
68352024-12-14T03:38:44.679ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:41833 req_id = b8a7bc0d-1d0d-4a3e-91af-2cc11faf4d6e resource = Database result = Ok(()) uri = /metrics/producers
68362024-12-14T03:38:44.798ZINFOnexus: assigned collector to new producer collector_id = a321e00a-3126-4ea4-b26d-c0e3eea69166 file = nexus/src/app/oximeter.rs:76 producer_id = b4254c81-0366-4d7b-a36b-86b73748c2f7
68372024-12-14T03:38:44.798ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 119264 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:41833 req_id = b8a7bc0d-1d0d-4a3e-91af-2cc11faf4d6e response_code = 201 uri = /metrics/producers
68382024-12-14T03:38:45.612ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1222 local_addr = [fd00:1122:3344:101::b]:56585 method = GET remote_addr = [fd00:1122:3344:101::d]:58979 req_id = 4cb158b4-be45-4403-8e85-40790c67e5f5 response_code = 200 uri = /5f2fe413-3c4a-4994-b4a0-995c1da486b1
68392024-12-14T03:38:46.346ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 24 reason = Timeout
68402024-12-14T03:38:46.346ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 24 reason = Timeout
68412024-12-14T03:38:46.346ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
68422024-12-14T03:38:46.346ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68432024-12-14T03:38:46.346ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68442024-12-14T03:38:46.346ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
68452024-12-14T03:38:46.348ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68462024-12-14T03:38:46.348ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
68472024-12-14T03:38:46.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
68482024-12-14T03:38:46.351ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
68492024-12-14T03:38:46.351ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68502024-12-14T03:38:46.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68512024-12-14T03:38:46.353ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68522024-12-14T03:38:46.353ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68532024-12-14T03:38:46.354ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68542024-12-14T03:38:46.357ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1, lookup_type: ById(eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1) } result = Ok(())
68552024-12-14T03:38:46.357ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68562024-12-14T03:38:46.357ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68572024-12-14T03:38:46.365ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1 original_time_created = 2024-12-14 03:34:51.368980 UTC target_id = eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1 time_created = 2024-12-14 03:34:51.368980 UTC
68582024-12-14T03:38:46.365ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.450559ms iteration = 24 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1","time_created":"2024-12-14T03:34:51.368980Z"}
68592024-12-14T03:38:46.375ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 28.973881ms iteration = 24 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
68602024-12-14T03:38:55.601ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:56805 req_id = d8a5f76a-309d-4903-9aae-ec63c8d06e8e roles = RoleSet { roles: {} } uri = /metrics/collectors/a321e00a-3126-4ea4-b26d-c0e3eea69166/producers?sort_by=id_ascending
68612024-12-14T03:38:55.601ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:56805 req_id = d8a5f76a-309d-4903-9aae-ec63c8d06e8e resource = Database result = Ok(()) uri = /metrics/collectors/a321e00a-3126-4ea4-b26d-c0e3eea69166/producers?sort_by=id_ascending
68622024-12-14T03:38:55.603ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2591 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:56805 req_id = d8a5f76a-309d-4903-9aae-ec63c8d06e8e response_code = 200 uri = /metrics/collectors/a321e00a-3126-4ea4-b26d-c0e3eea69166/producers?sort_by=id_ascending
68632024-12-14T03:38:55.603ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:56805 req_id = 88348f84-630c-4bfa-a225-2b4b7a933468 roles = RoleSet { roles: {} } uri = /metrics/collectors/a321e00a-3126-4ea4-b26d-c0e3eea69166/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlOGQ5NjQ2Zi1hNTQxLTRjMTEtYjViMi1mOTUzNDI3Y2EyZjMifX0%3D
68642024-12-14T03:38:55.604ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:56805 req_id = 88348f84-630c-4bfa-a225-2b4b7a933468 resource = Database result = Ok(()) uri = /metrics/collectors/a321e00a-3126-4ea4-b26d-c0e3eea69166/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlOGQ5NjQ2Zi1hNTQxLTRjMTEtYjViMi1mOTUzNDI3Y2EyZjMifX0%3D
68652024-12-14T03:38:55.606ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2824 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:56805 req_id = 88348f84-630c-4bfa-a225-2b4b7a933468 response_code = 200 uri = /metrics/collectors/a321e00a-3126-4ea4-b26d-c0e3eea69166/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlOGQ5NjQ2Zi1hNTQxLTRjMTEtYjViMi1mOTUzNDI3Y2EyZjMifX0%3D
68662024-12-14T03:38:55.611ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1095 local_addr = [fd00:1122:3344:101::b]:56585 method = GET remote_addr = [fd00:1122:3344:101::d]:58979 req_id = a211a16e-fa92-4e21-9f5b-7d71d9a168d9 response_code = 200 uri = /5f2fe413-3c4a-4994-b4a0-995c1da486b1
68672024-12-14T03:38:56.346ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 11 reason = Timeout
68682024-12-14T03:38:56.346ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
68692024-12-14T03:38:56.346ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 6 reason = Timeout
68702024-12-14T03:38:56.346ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
68712024-12-14T03:38:56.346ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
68722024-12-14T03:38:56.346ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 9 reason = Timeout
68732024-12-14T03:38:56.346ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 25 reason = Timeout
68742024-12-14T03:38:56.346ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
68752024-12-14T03:38:56.346ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 6 reason = Timeout
68762024-12-14T03:38:56.346ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68772024-12-14T03:38:56.346ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
68782024-12-14T03:38:56.346ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 9 reason = Timeout
68792024-12-14T03:38:56.346ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
68802024-12-14T03:38:56.346ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
68812024-12-14T03:38:56.346ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 25 reason = Timeout
68822024-12-14T03:38:56.346ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
68832024-12-14T03:38:56.346ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 7 reason = Timeout
68842024-12-14T03:38:56.346ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 9 reason = Timeout
68852024-12-14T03:38:56.346ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 7 reason = Timeout
68862024-12-14T03:38:56.346ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 9 reason = Timeout
68872024-12-14T03:38:56.346ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 6 reason = Timeout
68882024-12-14T03:38:56.346ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
68892024-12-14T03:38:56.346ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 9 reason = Timeout
68902024-12-14T03:38:56.346ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 9 reason = Timeout
68912024-12-14T03:38:56.346ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
68922024-12-14T03:38:56.346ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
68932024-12-14T03:38:56.346ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 5 reason = Timeout
68942024-12-14T03:38:56.346ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
68952024-12-14T03:38:56.346ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 9 reason = Timeout
68962024-12-14T03:38:56.346ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
68972024-12-14T03:38:56.346ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 9 reason = Timeout
68982024-12-14T03:38:56.346ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
68992024-12-14T03:38:56.346ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 10 reason = Timeout
69002024-12-14T03:38:56.346ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
69012024-12-14T03:38:56.346ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
69022024-12-14T03:38:56.346ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 6 reason = Timeout
69032024-12-14T03:38:56.346ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1
69042024-12-14T03:38:56.346ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 16.861\u{b5}s iteration = 6 status = {"enabled":false,"target_id":"eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1"}
69052024-12-14T03:38:56.346ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 5 reason = Timeout
69062024-12-14T03:38:56.347ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-14 03:28:56.346831134 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
69072024-12-14T03:38:56.347ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 6 reason = Timeout
69082024-12-14T03:38:56.347ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 6 reason = Timeout
69092024-12-14T03:38:56.347ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
69102024-12-14T03:38:56.347ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
69112024-12-14T03:38:56.347ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
69122024-12-14T03:38:56.347ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 9 reason = Timeout
69132024-12-14T03:38:56.347ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
69142024-12-14T03:38:56.347ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 9 reason = Timeout
69152024-12-14T03:38:56.347ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
69162024-12-14T03:38:56.347ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 5 reason = Timeout
69172024-12-14T03:38:56.347ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
69182024-12-14T03:38:56.347ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 5 reason = Timeout
69192024-12-14T03:38:56.347ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
69202024-12-14T03:38:56.347ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 5 reason = Timeout
69212024-12-14T03:38:56.347ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
69222024-12-14T03:38:56.347ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
69232024-12-14T03:38:56.347ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 9 reason = Timeout
69242024-12-14T03:38:56.347ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
69252024-12-14T03:38:56.347ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 9 reason = Timeout
69262024-12-14T03:38:56.347ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
69272024-12-14T03:38:56.347ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 9 reason = Timeout
69282024-12-14T03:38:56.347ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
69292024-12-14T03:38:56.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
69302024-12-14T03:38:56.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
69312024-12-14T03:38:56.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69322024-12-14T03:38:56.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
69332024-12-14T03:38:56.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
69342024-12-14T03:38:56.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
69352024-12-14T03:38:56.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
69362024-12-14T03:38:56.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
69372024-12-14T03:38:56.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
69382024-12-14T03:38:56.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
69392024-12-14T03:38:56.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
69402024-12-14T03:38:56.347ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("28f528f1-3159-4fbc-9304-37b7e4a50ae8.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7274e15f-a5f6-4975-bcdd-a2ef890c0230.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("7274e15f-a5f6-4975-bcdd-a2ef890c0230.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1342, tv_nsec: 666716632 } })
69412024-12-14T03:38:56.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
69422024-12-14T03:38:56.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
69432024-12-14T03:38:56.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
69442024-12-14T03:38:56.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
69452024-12-14T03:38:56.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
69462024-12-14T03:38:56.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
69472024-12-14T03:38:56.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
69482024-12-14T03:38:56.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
69492024-12-14T03:38:56.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
69502024-12-14T03:38:56.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
69512024-12-14T03:38:56.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
69522024-12-14T03:38:56.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
69532024-12-14T03:38:56.347ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("3db8556d-0ae0-4824-8953-f38d8eef7409.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7b672843-049d-4d9c-b0a2-21d7b6323621.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("db39fe07-65c4-451a-a2bd-78fcdfc10040.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("db39fe07-65c4-451a-a2bd-78fcdfc10040.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1342, tv_nsec: 666833354 } })
69542024-12-14T03:38:56.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
69552024-12-14T03:38:56.348ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
69562024-12-14T03:38:56.348ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.419269ms iteration = 6 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
69572024-12-14T03:38:56.348ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
69582024-12-14T03:38:56.348ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.814366ms iteration = 6 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
69592024-12-14T03:38:56.349ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
69602024-12-14T03:38:56.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
69612024-12-14T03:38:56.350ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69622024-12-14T03:38:56.350ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69632024-12-14T03:38:56.351ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.451359ms iteration = 9 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
69642024-12-14T03:38:56.351ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69652024-12-14T03:38:56.351ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69662024-12-14T03:38:56.354ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
69672024-12-14T03:38:56.354ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69682024-12-14T03:38:56.354ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
69692024-12-14T03:38:56.354ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
69702024-12-14T03:38:56.354ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69712024-12-14T03:38:56.354ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
69722024-12-14T03:38:56.354ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
69732024-12-14T03:38:56.354ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
69742024-12-14T03:38:56.354ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
69752024-12-14T03:38:56.354ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
69762024-12-14T03:38:56.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
69772024-12-14T03:38:56.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
69782024-12-14T03:38:56.356ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8d70e61c-94ed-41ce-b36c-cb904f92c534.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8d70e61c-94ed-41ce-b36c-cb904f92c534.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1342, tv_nsec: 675548039 } })
69792024-12-14T03:38:56.356ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69802024-12-14T03:38:56.356ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
69812024-12-14T03:38:56.357ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69822024-12-14T03:38:56.358ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8d70e61c-94ed-41ce-b36c-cb904f92c534.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8d70e61c-94ed-41ce-b36c-cb904f92c534.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1342, tv_nsec: 676951597 } })
69832024-12-14T03:38:56.358ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
69842024-12-14T03:38:56.360ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
69852024-12-14T03:38:56.360ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
69862024-12-14T03:38:56.360ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
69872024-12-14T03:38:56.360ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
69882024-12-14T03:38:56.360ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
69892024-12-14T03:38:56.360ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
69902024-12-14T03:38:56.361ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
69912024-12-14T03:38:56.361ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
69922024-12-14T03:38:56.362ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 16.083092ms iteration = 5 status = {"errors":[],"found_port_ok":[]}
69932024-12-14T03:38:56.363ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-14 03:28:56.346831134 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
69942024-12-14T03:38:56.363ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 16.352038ms iteration = 5 status = {"expiration":"2024-12-14T03:28:56.346831134Z","pruned":[]}
69952024-12-14T03:38:56.365ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 18.4826ms iteration = 9 status = {"errors":[],"garbage_collect_requested":[]}
69962024-12-14T03:38:56.366ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69972024-12-14T03:38:56.366ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69982024-12-14T03:38:56.368ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
69992024-12-14T03:38:56.368ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
70002024-12-14T03:38:56.368ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
70012024-12-14T03:38:56.368ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
70022024-12-14T03:38:56.368ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
70032024-12-14T03:38:56.368ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
70042024-12-14T03:38:56.369ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8d70e61c-94ed-41ce-b36c-cb904f92c534.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8d70e61c-94ed-41ce-b36c-cb904f92c534.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1342, tv_nsec: 688558810 } })
70052024-12-14T03:38:56.369ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200
70062024-12-14T03:38:56.370ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70072024-12-14T03:38:56.376ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1, lookup_type: ById(eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1) } result = Ok(())
70082024-12-14T03:38:56.376ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70092024-12-14T03:38:56.376ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70102024-12-14T03:38:56.386ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
70112024-12-14T03:38:56.386ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
70122024-12-14T03:38:56.386ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
70132024-12-14T03:38:56.386ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
70142024-12-14T03:38:56.391ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70152024-12-14T03:38:56.395ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
70162024-12-14T03:38:56.395ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
70172024-12-14T03:38:56.395ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
70182024-12-14T03:38:56.398ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
70192024-12-14T03:38:56.399ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
70202024-12-14T03:38:56.401ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
70212024-12-14T03:38:56.402ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
70222024-12-14T03:38:56.403ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
70232024-12-14T03:38:56.403ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
70242024-12-14T03:38:56.403ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
70252024-12-14T03:38:56.403ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 56.834119ms iteration = 5 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
70262024-12-14T03:38:56.404ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
70272024-12-14T03:38:56.404ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
70282024-12-14T03:38:56.404ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
70292024-12-14T03:38:56.404ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70302024-12-14T03:38:56.406ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 59.941601ms iteration = 9 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
70312024-12-14T03:38:56.407ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
70322024-12-14T03:38:56.407ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
70332024-12-14T03:38:56.407ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
70342024-12-14T03:38:56.409ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1 original_time_created = 2024-12-14 03:34:51.368980 UTC target_id = eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1 time_created = 2024-12-14 03:34:51.368980 UTC
70352024-12-14T03:38:56.409ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 63.180386ms iteration = 25 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1","time_created":"2024-12-14T03:34:51.368980Z"}
70362024-12-14T03:38:56.410ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
70372024-12-14T03:38:56.410ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 63.505272ms iteration = 9 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
70382024-12-14T03:38:56.410ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
70392024-12-14T03:38:56.411ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
70402024-12-14T03:38:56.412ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70412024-12-14T03:38:56.413ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
70422024-12-14T03:38:56.413ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
70432024-12-14T03:38:56.416ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70442024-12-14T03:38:56.416ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70452024-12-14T03:38:56.417ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 8d70e61c-94ed-41ce-b36c-cb904f92c534, lookup_type: ById(8d70e61c-94ed-41ce-b36c-cb904f92c534) } result = Ok(())
70462024-12-14T03:38:56.417ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
70472024-12-14T03:38:56.417ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
70482024-12-14T03:38:56.418ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 70.987032ms iteration = 9 status = {"errors":[],"records_set_to_done":[]}
70492024-12-14T03:38:56.419ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
70502024-12-14T03:38:56.419ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
70512024-12-14T03:38:56.419ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
70522024-12-14T03:38:56.420ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
70532024-12-14T03:38:56.421ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 75.425601ms iteration = 9 status = 0
70542024-12-14T03:38:56.423ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70552024-12-14T03:38:56.423ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70562024-12-14T03:38:56.426ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
70572024-12-14T03:38:56.426ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
70582024-12-14T03:38:56.427ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
70592024-12-14T03:38:56.427ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
70602024-12-14T03:38:56.427ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
70612024-12-14T03:38:56.427ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70622024-12-14T03:38:56.428ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
70632024-12-14T03:38:56.430ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
70642024-12-14T03:38:56.430ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
70652024-12-14T03:38:56.430ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
70662024-12-14T03:38:56.449ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 102.726787ms iteration = 9 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
70672024-12-14T03:38:56.451ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
70682024-12-14T03:38:56.451ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
70692024-12-14T03:38:56.451ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
70702024-12-14T03:38:56.451ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
70712024-12-14T03:38:56.453ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 107.146236ms iteration = 25 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
70722024-12-14T03:38:56.454ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
70732024-12-14T03:38:56.454ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
70742024-12-14T03:38:56.454ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 107.462333ms iteration = 5 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
70752024-12-14T03:38:56.460ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
70762024-12-14T03:38:56.461ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
70772024-12-14T03:38:56.461ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
70782024-12-14T03:38:56.461ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
70792024-12-14T03:38:56.461ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
70802024-12-14T03:38:56.465ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70812024-12-14T03:38:56.465ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
70822024-12-14T03:38:56.466ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
70832024-12-14T03:38:56.469ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 122.371011ms iteration = 9 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
70842024-12-14T03:38:56.469ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
70852024-12-14T03:38:56.469ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
70862024-12-14T03:38:56.469ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
70872024-12-14T03:38:56.469ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
70882024-12-14T03:38:56.469ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
70892024-12-14T03:38:56.470ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
70902024-12-14T03:38:56.470ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
70912024-12-14T03:38:56.470ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
70922024-12-14T03:38:56.472ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70932024-12-14T03:38:56.475ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
70942024-12-14T03:38:56.475ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
70952024-12-14T03:38:56.475ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
70962024-12-14T03:38:56.476ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
70972024-12-14T03:38:56.476ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
70982024-12-14T03:38:56.482ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
70992024-12-14T03:38:56.483ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
71002024-12-14T03:38:56.494ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
71012024-12-14T03:38:56.494ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
71022024-12-14T03:38:56.494ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 148.112947ms iteration = 9 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
71032024-12-14T03:38:56.503ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
71042024-12-14T03:38:56.503ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
71052024-12-14T03:38:56.504ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
71062024-12-14T03:38:56.504ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
71072024-12-14T03:38:56.504ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "aaac32ee-c522-4299-8e70-0500468c9d03", "content-length": "26", "date": "Sat, 14 Dec 2024 03:38:56 GMT"} })
71082024-12-14T03:38:56.504ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
71092024-12-14T03:38:56.504ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
71102024-12-14T03:38:56.504ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 51f6df17-b3b5-47fe-9a42-d8752f961c5e dns_zone_name = oxide.test found_so_far = 0 version = 2
71112024-12-14T03:38:56.504ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
71122024-12-14T03:38:56.505ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
71132024-12-14T03:38:56.506ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
71142024-12-14T03:38:56.507ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71152024-12-14T03:38:56.510ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
71162024-12-14T03:38:56.510ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
71172024-12-14T03:38:56.510ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71182024-12-14T03:38:56.510ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
71192024-12-14T03:38:56.510ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = c7a5bbe9-1af5-4e36-80b5-da9e0053b676 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
71202024-12-14T03:38:56.510ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
71212024-12-14T03:38:56.510ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
71222024-12-14T03:38:56.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
71232024-12-14T03:38:56.514ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
71242024-12-14T03:38:56.514ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
71252024-12-14T03:38:56.514ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
71262024-12-14T03:38:56.517ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 51f6df17-b3b5-47fe-9a42-d8752f961c5e dns_zone_name = oxide.test found_so_far = 1 version = 2
71272024-12-14T03:38:56.517ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
71282024-12-14T03:38:56.517ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-14 03:35:40.905586 UTC dns_group = external generation = 2
71292024-12-14T03:38:56.517ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 171.505986ms iteration = 6 status = {"generation":2}
71302024-12-14T03:38:56.525ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
71312024-12-14T03:38:56.525ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 178.394483ms iteration = 5 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
71322024-12-14T03:38:56.542ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 195.997155ms iteration = 11 status = {"physical_disks_added":0}
71332024-12-14T03:38:56.604ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
71342024-12-14T03:38:56.604ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
71352024-12-14T03:38:56.604ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "fbd047f8-cbd7-435e-9f00-2db6c35e3d89", "content-length": "26", "date": "Sat, 14 Dec 2024 03:38:56 GMT"} })
71362024-12-14T03:38:56.604ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
71372024-12-14T03:38:56.606ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
71382024-12-14T03:38:56.624ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 zone_address = fd00:1122:3344:101::2
71392024-12-14T03:38:56.624ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
71402024-12-14T03:38:56.624ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
71412024-12-14T03:38:56.624ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "5f26f6a8-e46d-485c-bb1d-1ed6e5f5478c", "content-length": "26", "date": "Sat, 14 Dec 2024 03:38:56 GMT"} })
71422024-12-14T03:38:56.624ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
71432024-12-14T03:38:56.625ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
71442024-12-14T03:38:56.627ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200
71452024-12-14T03:38:56.637ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
71462024-12-14T03:38:56.639ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
71472024-12-14T03:38:56.639ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "1c3a15c2-8c0b-410b-89a2-4a5d3b995e0c", "date": "Sat, 14 Dec 2024 03:38:56 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
71482024-12-14T03:38:56.639ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
71492024-12-14T03:38:56.640ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "f70cfde8-7ad2-4ab9-b61c-ac8a1b33362b", "date": "Sat, 14 Dec 2024 03:38:56 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
71502024-12-14T03:38:56.640ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
71512024-12-14T03:38:56.642ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
71522024-12-14T03:38:56.642ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 296.086371ms iteration = 7 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
71532024-12-14T03:38:56.724ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 377.408091ms iteration = 9 status = {}
71542024-12-14T03:38:56.739ZINFOnexus (BackgroundTasks): VPC route manager sled 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
71552024-12-14T03:38:56.739ZDEBGnexus (BackgroundTasks): client request SledAgent = 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
71562024-12-14T03:38:56.740ZDEBGnexus (BackgroundTasks): client response SledAgent = 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "7a7b6ea6-6a43-4501-80c3-f525dbf95705", "content-length": "372", "date": "Sat, 14 Dec 2024 03:38:56 GMT"} })
71572024-12-14T03:38:56.740ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
71582024-12-14T03:38:56.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
71592024-12-14T03:38:56.742ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71602024-12-14T03:38:56.745ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
71612024-12-14T03:38:56.745ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
71622024-12-14T03:38:56.745ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
71632024-12-14T03:38:56.747ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
71642024-12-14T03:38:56.747ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "df7640bb-3811-4563-8b48-a88368db21f4", "content-length": "1", "date": "Sat, 14 Dec 2024 03:38:55 GMT"} })
71652024-12-14T03:38:56.748ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
71662024-12-14T03:38:56.749ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
71672024-12-14T03:38:56.750ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
71682024-12-14T03:38:56.751ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 404.909912ms iteration = 9 status = null
71692024-12-14T03:38:56.751ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "8b951b56-8371-4a9c-bfed-e1c464a17d97", "date": "Sat, 14 Dec 2024 03:38:56 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
71702024-12-14T03:38:56.751ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
71712024-12-14T03:38:56.754ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "682c430a-33ab-4d75-87a9-3a5c177c5407", "date": "Sat, 14 Dec 2024 03:38:56 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
71722024-12-14T03:38:56.754ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
71732024-12-14T03:38:56.757ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "efc64548-6b53-41e8-b692-77a91b0b5160", "date": "Sat, 14 Dec 2024 03:38:56 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
71742024-12-14T03:38:56.757ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
71752024-12-14T03:38:56.759ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
71762024-12-14T03:38:56.759ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 413.075335ms iteration = 7 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
71772024-12-14T03:38:56.761ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
71782024-12-14T03:38:56.761ZDEBGnexus (BackgroundTasks): client request SledAgent = 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
71792024-12-14T03:38:56.761ZDEBGnexus (BackgroundTasks): client response SledAgent = 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "d563b26e-93a7-4da1-8704-cae727ea1e05", "date": "Sat, 14 Dec 2024 03:38:56 GMT"} })
71802024-12-14T03:38:56.761ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
71812024-12-14T03:38:56.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
71822024-12-14T03:38:56.764ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
71832024-12-14T03:38:56.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
71842024-12-14T03:38:56.773ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
71852024-12-14T03:38:56.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
71862024-12-14T03:38:56.778ZINFOnexus (BackgroundTasks): VPC route manager sled 8d70e61c-94ed-41ce-b36c-cb904f92c534 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
71872024-12-14T03:38:56.778ZDEBGnexus (BackgroundTasks): client request SledAgent = 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
71882024-12-14T03:38:56.779ZDEBGnexus (BackgroundTasks): client response SledAgent = 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "2fa4fe66-ecea-4fe6-a16c-42e7e4d0b6d6", "date": "Sat, 14 Dec 2024 03:38:56 GMT"} })
71892024-12-14T03:38:56.780ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71902024-12-14T03:38:56.780ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 433.973704ms iteration = 10 status = {}
71912024-12-14T03:38:56.784ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
71922024-12-14T03:38:56.784ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
71932024-12-14T03:38:56.784ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
71942024-12-14T03:38:56.786ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71952024-12-14T03:38:56.787ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-14T03:34:54.541856Z, time_modified: 2024-12-14T03:34:54.541856Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, db_silo: Silo { identity: SiloIdentity { id: 578bc52c-ac81-41a6-a56b-dfc79805368e, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-14T03:35:40.848931Z, time_modified: 2024-12-14T03:35:40.848931Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "4dfc5e49ed154568e7a05c630983c79e7ad097d55e90f834bee8ffda0c5a5c9e" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, db_silo: Silo { identity: SiloIdentity { id: 578bc52c-ac81-41a6-a56b-dfc79805368e, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-14T03:35:40.848931Z, time_modified: 2024-12-14T03:35:40.848931Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "4dfc5e49ed154568e7a05c630983c79e7ad097d55e90f834bee8ffda0c5a5c9e" }] }) }
71962024-12-14T03:38:56.787ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 440.501484ms iteration = 6 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"578bc52c-ac81-41a6-a56b-dfc79805368e","tls_certs":["4dfc5e49ed154568e7a05c630983c79e7ad097d55e90f834bee8ffda0c5a5c9e"]}},"default_endpoint":{"silo_id":"578bc52c-ac81-41a6-a56b-dfc79805368e","tls_certs":["4dfc5e49ed154568e7a05c630983c79e7ad097d55e90f834bee8ffda0c5a5c9e"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
71972024-12-14T03:38:56.787ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = c7a5bbe9-1af5-4e36-80b5-da9e0053b676 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
71982024-12-14T03:38:56.787ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
71992024-12-14T03:38:56.787ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-14 03:35:40.104814 UTC dns_group = internal generation = 1
72002024-12-14T03:38:56.787ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 440.800591ms iteration = 6 status = {"generation":1}
72012024-12-14T03:38:56.789ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
72022024-12-14T03:38:56.789ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
72032024-12-14T03:38:56.789ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
72042024-12-14T03:38:56.831ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
72052024-12-14T03:38:56.831ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
72062024-12-14T03:38:56.834ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 45ca990e-42e9-4264-be3e-0adfed2cd99b, rack_id: a121ca05-bbee-41bf-b9db-9e03ff035200, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(811a570a-bdaf-4a1b-8eba-0c0e4977f7bb) } rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 switch_location = Switch0
72072024-12-14T03:38:56.834ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
72082024-12-14T03:38:56.835ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
72092024-12-14T03:38:56.848ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
72102024-12-14T03:38:56.848ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "89c048a1-07b6-4811-acb7-24f1e511f954", "content-length": "134", "date": "Sat, 14 Dec 2024 03:38:55 GMT"} })
72112024-12-14T03:38:56.849ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
72122024-12-14T03:38:56.849ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 811a570a-bdaf-4a1b-8eba-0c0e4977f7bb
72132024-12-14T03:38:56.849ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
72142024-12-14T03:38:56.849ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
72152024-12-14T03:38:56.849ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
72162024-12-14T03:38:56.849ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
72172024-12-14T03:38:56.849ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
72182024-12-14T03:38:56.849ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
72192024-12-14T03:38:56.849ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
72202024-12-14T03:38:56.849ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
72212024-12-14T03:38:56.850ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200
72222024-12-14T03:38:56.850ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
72232024-12-14T03:38:56.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
72242024-12-14T03:38:56.853ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
72252024-12-14T03:38:56.853ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "c37e022b-fb48-4bd9-8ffc-a8eac2d52731", "content-length": "2", "date": "Sat, 14 Dec 2024 03:38:55 GMT"} })
72262024-12-14T03:38:56.853ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
72272024-12-14T03:38:56.853ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "6e0a6d5f-09cc-483b-a27e-e446e64f8df2", "content-length": "52", "date": "Sat, 14 Dec 2024 03:38:55 GMT"} })
72282024-12-14T03:38:56.853ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 switch_location = Switch0
72292024-12-14T03:38:56.853ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
72302024-12-14T03:38:56.904ZDEBGnexus (BackgroundTasks): client request SledAgent = 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
72312024-12-14T03:38:56.990ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "4e2b1c89-3251-481f-bdf3-1f4303c4eeae", "date": "Sat, 14 Dec 2024 03:38:56 GMT"} })
72322024-12-14T03:38:56.990ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 switch = Switch0
72332024-12-14T03:38:56.990ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
72342024-12-14T03:38:56.991ZDEBGnexus (BackgroundTasks): client response SledAgent = 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "c54a363d-4dc5-4d8e-9a27-0dc2a09771a8", "content-length": "691", "date": "Sat, 14 Dec 2024 03:38:56 GMT"} })
72352024-12-14T03:38:56.991ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
72362024-12-14T03:38:56.991ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
72372024-12-14T03:38:56.991ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
72382024-12-14T03:38:56.991ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "df228799-9a8d-4cc5-9255-a26286c3a011", "content-length": "682", "date": "Sat, 14 Dec 2024 03:38:56 GMT"} })
72392024-12-14T03:38:56.991ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
72402024-12-14T03:38:56.992ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
72412024-12-14T03:38:56.993ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 646.39588ms iteration = 9 status = {}
72422024-12-14T03:38:56.996ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
72432024-12-14T03:38:56.997ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
72442024-12-14T03:38:57.001ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
72452024-12-14T03:38:57.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
72462024-12-14T03:38:57.005ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
72472024-12-14T03:38:57.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
72482024-12-14T03:38:57.015ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 669.097805ms iteration = 9 status = {}
72492024-12-14T03:39:05.612ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1081 local_addr = [fd00:1122:3344:101::b]:56585 method = GET remote_addr = [fd00:1122:3344:101::d]:58979 req_id = 4d71a4dc-54c5-4532-93dd-6c552f23be1a response_code = 200 uri = /5f2fe413-3c4a-4994-b4a0-995c1da486b1
72502024-12-14T03:39:06.346ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 26 reason = Timeout
72512024-12-14T03:39:06.346ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 26 reason = Timeout
72522024-12-14T03:39:06.346ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
72532024-12-14T03:39:06.346ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
72542024-12-14T03:39:06.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
72552024-12-14T03:39:06.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
72562024-12-14T03:39:06.348ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72572024-12-14T03:39:06.351ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
72582024-12-14T03:39:06.351ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
72592024-12-14T03:39:06.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
72602024-12-14T03:39:06.353ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
72612024-12-14T03:39:06.353ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
72622024-12-14T03:39:06.373ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
72632024-12-14T03:39:06.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
72642024-12-14T03:39:06.383ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72652024-12-14T03:39:06.385ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1, lookup_type: ById(eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1) } result = Ok(())
72662024-12-14T03:39:06.385ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
72672024-12-14T03:39:06.385ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
72682024-12-14T03:39:06.397ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1 original_time_created = 2024-12-14 03:34:51.368980 UTC target_id = eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1 time_created = 2024-12-14 03:34:51.368980 UTC
72692024-12-14T03:39:06.397ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 50.372399ms iteration = 26 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1","time_created":"2024-12-14T03:34:51.368980Z"}
72702024-12-14T03:39:06.400ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 54.186465ms iteration = 26 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
72712024-12-14T03:39:15.612ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1155 local_addr = [fd00:1122:3344:101::b]:56585 method = GET remote_addr = [fd00:1122:3344:101::d]:58979 req_id = d3d42166-e915-442d-8a6c-5f424bce5f8b response_code = 200 uri = /5f2fe413-3c4a-4994-b4a0-995c1da486b1
72722024-12-14T03:39:16.346ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 27 reason = Timeout
72732024-12-14T03:39:16.346ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
72742024-12-14T03:39:16.346ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 27 reason = Timeout
72752024-12-14T03:39:16.346ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
72762024-12-14T03:39:16.346ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
72772024-12-14T03:39:16.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
72782024-12-14T03:39:16.348ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
72792024-12-14T03:39:16.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
72802024-12-14T03:39:16.349ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72812024-12-14T03:39:16.351ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
72822024-12-14T03:39:16.351ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
72832024-12-14T03:39:16.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
72842024-12-14T03:39:16.354ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
72852024-12-14T03:39:16.354ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
72862024-12-14T03:39:16.355ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72872024-12-14T03:39:16.358ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1, lookup_type: ById(eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1) } result = Ok(())
72882024-12-14T03:39:16.358ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
72892024-12-14T03:39:16.358ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
72902024-12-14T03:39:16.370ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1 original_time_created = 2024-12-14 03:34:51.368980 UTC target_id = eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1 time_created = 2024-12-14 03:34:51.368980 UTC
72912024-12-14T03:39:16.370ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.605204ms iteration = 27 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1","time_created":"2024-12-14T03:34:51.368980Z"}
72922024-12-14T03:39:16.377ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.792287ms iteration = 27 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
72932024-12-14T03:39:21.225ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:48828
72942024-12-14T03:39:21.225ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:48828 req_id = 55aea7fa-60be-4ec0-8b4a-41eb47543289 roles = RoleSet { roles: {} } uri = /metrics/producers
72952024-12-14T03:39:21.225ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:48828 req_id = 55aea7fa-60be-4ec0-8b4a-41eb47543289 resource = Database result = Ok(()) uri = /metrics/producers
72962024-12-14T03:39:21.263ZINFOnexus: assigned collector to new producer collector_id = a321e00a-3126-4ea4-b26d-c0e3eea69166 file = nexus/src/app/oximeter.rs:76 producer_id = c4ff451e-ab57-4adc-b747-11f26d0ffcfa
72972024-12-14T03:39:21.264ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 38931 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:48828 req_id = 55aea7fa-60be-4ec0-8b4a-41eb47543289 response_code = 201 uri = /metrics/producers
72982024-12-14T03:39:25.601ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:56805 req_id = b3232a49-c99d-4206-8975-b6c6a1222422 roles = RoleSet { roles: {} } uri = /metrics/collectors/a321e00a-3126-4ea4-b26d-c0e3eea69166/producers?sort_by=id_ascending
72992024-12-14T03:39:25.602ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:56805 req_id = b3232a49-c99d-4206-8975-b6c6a1222422 resource = Database result = Ok(()) uri = /metrics/collectors/a321e00a-3126-4ea4-b26d-c0e3eea69166/producers?sort_by=id_ascending
73002024-12-14T03:39:25.604ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3319 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:56805 req_id = b3232a49-c99d-4206-8975-b6c6a1222422 response_code = 200 uri = /metrics/collectors/a321e00a-3126-4ea4-b26d-c0e3eea69166/producers?sort_by=id_ascending
73012024-12-14T03:39:25.605ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:56805 req_id = 7c7e914e-73bf-41db-bd14-4dd93b07d7d0 roles = RoleSet { roles: {} } uri = /metrics/collectors/a321e00a-3126-4ea4-b26d-c0e3eea69166/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlOGQ5NjQ2Zi1hNTQxLTRjMTEtYjViMi1mOTUzNDI3Y2EyZjMifX0%3D
73022024-12-14T03:39:25.605ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:56805 req_id = 7c7e914e-73bf-41db-bd14-4dd93b07d7d0 resource = Database result = Ok(()) uri = /metrics/collectors/a321e00a-3126-4ea4-b26d-c0e3eea69166/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlOGQ5NjQ2Zi1hNTQxLTRjMTEtYjViMi1mOTUzNDI3Y2EyZjMifX0%3D
73032024-12-14T03:39:25.607ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2231 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:56805 req_id = 7c7e914e-73bf-41db-bd14-4dd93b07d7d0 response_code = 200 uri = /metrics/collectors/a321e00a-3126-4ea4-b26d-c0e3eea69166/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlOGQ5NjQ2Zi1hNTQxLTRjMTEtYjViMi1mOTUzNDI3Y2EyZjMifX0%3D
73042024-12-14T03:39:25.612ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1174 local_addr = [fd00:1122:3344:101::b]:56585 method = GET remote_addr = [fd00:1122:3344:101::d]:58979 req_id = 275125aa-3bdc-4aaa-a049-d3ac72a4795e response_code = 200 uri = /5f2fe413-3c4a-4994-b4a0-995c1da486b1
73052024-12-14T03:39:26.346ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 11 reason = Timeout
73062024-12-14T03:39:26.346ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
73072024-12-14T03:39:26.346ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
73082024-12-14T03:39:26.346ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 10 reason = Timeout
73092024-12-14T03:39:26.346ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 10 reason = Timeout
73102024-12-14T03:39:26.346ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
73112024-12-14T03:39:26.346ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
73122024-12-14T03:39:26.346ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 10 reason = Timeout
73132024-12-14T03:39:26.346ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 28 reason = Timeout
73142024-12-14T03:39:26.346ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
73152024-12-14T03:39:26.346ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 10 reason = Timeout
73162024-12-14T03:39:26.346ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73172024-12-14T03:39:26.346ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
73182024-12-14T03:39:26.346ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 10 reason = Timeout
73192024-12-14T03:39:26.346ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
73202024-12-14T03:39:26.346ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 10 reason = Timeout
73212024-12-14T03:39:26.346ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 10 reason = Timeout
73222024-12-14T03:39:26.346ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
73232024-12-14T03:39:26.346ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
73242024-12-14T03:39:26.346ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 12 reason = Timeout
73252024-12-14T03:39:26.346ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
73262024-12-14T03:39:26.346ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 10 reason = Timeout
73272024-12-14T03:39:26.346ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
73282024-12-14T03:39:26.346ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 10 reason = Timeout
73292024-12-14T03:39:26.346ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 28 reason = Timeout
73302024-12-14T03:39:26.346ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
73312024-12-14T03:39:26.346ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
73322024-12-14T03:39:26.346ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 10 reason = Timeout
73332024-12-14T03:39:26.346ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
73342024-12-14T03:39:26.346ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
73352024-12-14T03:39:26.346ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
73362024-12-14T03:39:26.346ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
73372024-12-14T03:39:26.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
73382024-12-14T03:39:26.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
73392024-12-14T03:39:26.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
73402024-12-14T03:39:26.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73412024-12-14T03:39:26.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
73422024-12-14T03:39:26.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
73432024-12-14T03:39:26.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
73442024-12-14T03:39:26.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
73452024-12-14T03:39:26.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
73462024-12-14T03:39:26.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
73472024-12-14T03:39:26.347ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 10 reason = Timeout
73482024-12-14T03:39:26.347ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
73492024-12-14T03:39:26.347ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 10 reason = Timeout
73502024-12-14T03:39:26.347ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
73512024-12-14T03:39:26.347ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 10 reason = Timeout
73522024-12-14T03:39:26.347ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
73532024-12-14T03:39:26.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
73542024-12-14T03:39:26.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
73552024-12-14T03:39:26.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
73562024-12-14T03:39:26.348ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73572024-12-14T03:39:26.349ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8d70e61c-94ed-41ce-b36c-cb904f92c534.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8d70e61c-94ed-41ce-b36c-cb904f92c534.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1372, tv_nsec: 668287430 } })
73582024-12-14T03:39:26.349ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
73592024-12-14T03:39:26.350ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8d70e61c-94ed-41ce-b36c-cb904f92c534.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8d70e61c-94ed-41ce-b36c-cb904f92c534.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1372, tv_nsec: 669209418 } })
73602024-12-14T03:39:26.350ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
73612024-12-14T03:39:26.350ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
73622024-12-14T03:39:26.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
73632024-12-14T03:39:26.350ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.568991ms iteration = 10 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
73642024-12-14T03:39:26.350ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
73652024-12-14T03:39:26.352ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73662024-12-14T03:39:26.354ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
73672024-12-14T03:39:26.354ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73682024-12-14T03:39:26.354ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73692024-12-14T03:39:26.356ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73702024-12-14T03:39:26.359ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
73712024-12-14T03:39:26.359ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
73722024-12-14T03:39:26.359ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
73732024-12-14T03:39:26.364ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73742024-12-14T03:39:26.364ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73752024-12-14T03:39:26.389ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
73762024-12-14T03:39:26.389ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
73772024-12-14T03:39:26.389ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
73782024-12-14T03:39:26.389ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
73792024-12-14T03:39:26.393ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
73802024-12-14T03:39:26.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
73812024-12-14T03:39:26.397ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73822024-12-14T03:39:26.399ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
73832024-12-14T03:39:26.399ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
73842024-12-14T03:39:26.399ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
73852024-12-14T03:39:26.399ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
73862024-12-14T03:39:26.399ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
73872024-12-14T03:39:26.399ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
73882024-12-14T03:39:26.399ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
73892024-12-14T03:39:26.399ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73902024-12-14T03:39:26.400ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73912024-12-14T03:39:26.402ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
73922024-12-14T03:39:26.402ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
73932024-12-14T03:39:26.402ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
73942024-12-14T03:39:26.402ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
73952024-12-14T03:39:26.403ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
73962024-12-14T03:39:26.403ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
73972024-12-14T03:39:26.403ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
73982024-12-14T03:39:26.403ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
73992024-12-14T03:39:26.403ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
74002024-12-14T03:39:26.403ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 55.8843ms iteration = 10 status = {"errors":[],"garbage_collect_requested":[]}
74012024-12-14T03:39:26.403ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
74022024-12-14T03:39:26.405ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
74032024-12-14T03:39:26.405ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
74042024-12-14T03:39:26.406ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
74052024-12-14T03:39:26.406ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
74062024-12-14T03:39:26.406ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8d70e61c-94ed-41ce-b36c-cb904f92c534.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8d70e61c-94ed-41ce-b36c-cb904f92c534.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1372, tv_nsec: 725452105 } })
74072024-12-14T03:39:26.407ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200
74082024-12-14T03:39:26.407ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74092024-12-14T03:39:26.407ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74102024-12-14T03:39:26.408ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 60.537793ms iteration = 10 status = {"errors":[],"records_set_to_done":[]}
74112024-12-14T03:39:26.409ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
74122024-12-14T03:39:26.409ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
74132024-12-14T03:39:26.409ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
74142024-12-14T03:39:26.409ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
74152024-12-14T03:39:26.409ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
74162024-12-14T03:39:26.409ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
74172024-12-14T03:39:26.420ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74182024-12-14T03:39:26.423ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1, lookup_type: ById(eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1) } result = Ok(())
74192024-12-14T03:39:26.423ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74202024-12-14T03:39:26.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74212024-12-14T03:39:26.423ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
74222024-12-14T03:39:26.423ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
74232024-12-14T03:39:26.423ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
74242024-12-14T03:39:26.424ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
74252024-12-14T03:39:26.424ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 77.82151ms iteration = 10 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
74262024-12-14T03:39:26.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
74272024-12-14T03:39:26.428ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 82.149015ms iteration = 28 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
74282024-12-14T03:39:26.435ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1 original_time_created = 2024-12-14 03:34:51.368980 UTC target_id = eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1 time_created = 2024-12-14 03:34:51.368980 UTC
74292024-12-14T03:39:26.435ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 88.802549ms iteration = 28 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1","time_created":"2024-12-14T03:34:51.368980Z"}
74302024-12-14T03:39:26.435ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 89.000093ms iteration = 10 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
74312024-12-14T03:39:26.436ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 90.549924ms iteration = 10 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
74322024-12-14T03:39:26.436ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
74332024-12-14T03:39:26.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
74342024-12-14T03:39:26.438ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
74352024-12-14T03:39:26.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
74362024-12-14T03:39:26.443ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
74372024-12-14T03:39:26.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
74382024-12-14T03:39:26.457ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
74392024-12-14T03:39:26.457ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
74402024-12-14T03:39:26.457ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 111.540845ms iteration = 10 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
74412024-12-14T03:39:26.473ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74422024-12-14T03:39:26.475ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 8d70e61c-94ed-41ce-b36c-cb904f92c534, lookup_type: ById(8d70e61c-94ed-41ce-b36c-cb904f92c534) } result = Ok(())
74432024-12-14T03:39:26.475ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
74442024-12-14T03:39:26.475ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
74452024-12-14T03:39:26.476ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 129.065886ms iteration = 10 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
74462024-12-14T03:39:26.477ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 131.361612ms iteration = 10 status = 0
74472024-12-14T03:39:26.504ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
74482024-12-14T03:39:26.504ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 zone_address = fd00:1122:3344:101::2
74492024-12-14T03:39:26.504ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
74502024-12-14T03:39:26.504ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
74512024-12-14T03:39:26.504ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e1dacc5c-eef9-46d6-85c9-cd0de8906897", "content-length": "26", "date": "Sat, 14 Dec 2024 03:39:26 GMT"} })
74522024-12-14T03:39:26.504ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
74532024-12-14T03:39:26.505ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74542024-12-14T03:39:26.506ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200
74552024-12-14T03:39:26.507ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
74562024-12-14T03:39:26.507ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
74572024-12-14T03:39:26.507ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 161.645628ms iteration = 12 status = {"physical_disks_added":0}
74582024-12-14T03:39:26.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
74592024-12-14T03:39:26.539ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
74602024-12-14T03:39:26.539ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
74612024-12-14T03:39:26.539ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8352e8db-60e1-4d99-97c1-645564e789dc", "content-length": "26", "date": "Sat, 14 Dec 2024 03:39:26 GMT"} })
74622024-12-14T03:39:26.539ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
74632024-12-14T03:39:26.539ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
74642024-12-14T03:39:26.539ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
74652024-12-14T03:39:26.539ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "7a43318c-a5f0-4586-94e0-a0fd08531ba4", "content-length": "26", "date": "Sat, 14 Dec 2024 03:39:26 GMT"} })
74662024-12-14T03:39:26.539ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
74672024-12-14T03:39:26.542ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
74682024-12-14T03:39:26.543ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
74692024-12-14T03:39:26.578ZINFOnexus (BackgroundTasks): VPC route manager sled 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
74702024-12-14T03:39:26.578ZDEBGnexus (BackgroundTasks): client request SledAgent = 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
74712024-12-14T03:39:26.578ZDEBGnexus (BackgroundTasks): client response SledAgent = 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "b1f4dc29-3d2e-4fff-9d0f-b9b92677254d", "content-length": "372", "date": "Sat, 14 Dec 2024 03:39:26 GMT"} })
74722024-12-14T03:39:26.579ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
74732024-12-14T03:39:26.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
74742024-12-14T03:39:26.580ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74752024-12-14T03:39:26.582ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
74762024-12-14T03:39:26.582ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
74772024-12-14T03:39:26.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
74782024-12-14T03:39:26.624ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
74792024-12-14T03:39:26.624ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "aae9a1b7-569c-45d2-9e68-7b3ee76a2d3e", "content-length": "1", "date": "Sat, 14 Dec 2024 03:39:25 GMT"} })
74802024-12-14T03:39:26.626ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
74812024-12-14T03:39:26.626ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
74822024-12-14T03:39:26.627ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 280.725564ms iteration = 10 status = {}
74832024-12-14T03:39:26.628ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 282.650503ms iteration = 10 status = null
74842024-12-14T03:39:26.630ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
74852024-12-14T03:39:26.630ZDEBGnexus (BackgroundTasks): client request SledAgent = 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
74862024-12-14T03:39:26.630ZDEBGnexus (BackgroundTasks): client response SledAgent = 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "4929d549-4112-4b51-92ee-f6b188ac7177", "date": "Sat, 14 Dec 2024 03:39:26 GMT"} })
74872024-12-14T03:39:26.630ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
74882024-12-14T03:39:26.631ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
74892024-12-14T03:39:26.633ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
74902024-12-14T03:39:26.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
74912024-12-14T03:39:26.636ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
74922024-12-14T03:39:26.636ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
74932024-12-14T03:39:26.639ZINFOnexus (BackgroundTasks): VPC route manager sled 8d70e61c-94ed-41ce-b36c-cb904f92c534 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
74942024-12-14T03:39:26.640ZDEBGnexus (BackgroundTasks): client request SledAgent = 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
74952024-12-14T03:39:26.640ZDEBGnexus (BackgroundTasks): client response SledAgent = 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "7deb1cc1-63a6-42a0-8af0-f800f2ae61c2", "date": "Sat, 14 Dec 2024 03:39:26 GMT"} })
74962024-12-14T03:39:26.641ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 295.846967ms iteration = 11 status = {}
74972024-12-14T03:39:26.677ZDEBGnexus (BackgroundTasks): client request SledAgent = 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
74982024-12-14T03:39:26.677ZDEBGnexus (BackgroundTasks): client response SledAgent = 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "e94b67c8-7c95-472b-9c0a-a3789a6625e4", "content-length": "691", "date": "Sat, 14 Dec 2024 03:39:26 GMT"} })
74992024-12-14T03:39:26.678ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
75002024-12-14T03:39:26.678ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
75012024-12-14T03:39:26.678ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
75022024-12-14T03:39:26.678ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 332.39894ms iteration = 10 status = {}
75032024-12-14T03:39:26.683ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
75042024-12-14T03:39:26.683ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
75052024-12-14T03:39:26.685ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 45ca990e-42e9-4264-be3e-0adfed2cd99b, rack_id: a121ca05-bbee-41bf-b9db-9e03ff035200, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(811a570a-bdaf-4a1b-8eba-0c0e4977f7bb) } rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 switch_location = Switch0
75062024-12-14T03:39:26.685ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
75072024-12-14T03:39:26.685ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
75082024-12-14T03:39:26.692ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
75092024-12-14T03:39:26.692ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "944fb12e-0e37-454c-9820-d51ac226598b", "content-length": "134", "date": "Sat, 14 Dec 2024 03:39:25 GMT"} })
75102024-12-14T03:39:26.692ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
75112024-12-14T03:39:26.692ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 811a570a-bdaf-4a1b-8eba-0c0e4977f7bb
75122024-12-14T03:39:26.693ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
75132024-12-14T03:39:26.693ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
75142024-12-14T03:39:26.693ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
75152024-12-14T03:39:26.693ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
75162024-12-14T03:39:26.693ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
75172024-12-14T03:39:26.693ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
75182024-12-14T03:39:26.693ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
75192024-12-14T03:39:26.693ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
75202024-12-14T03:39:26.693ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200
75212024-12-14T03:39:26.693ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
75222024-12-14T03:39:26.693ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
75232024-12-14T03:39:26.695ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
75242024-12-14T03:39:26.695ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "e7c5e647-5f4a-49c0-8eda-1c89bf36f663", "content-length": "2", "date": "Sat, 14 Dec 2024 03:39:25 GMT"} })
75252024-12-14T03:39:26.695ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
75262024-12-14T03:39:26.695ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "e8e43fcf-38fb-40f1-8727-17d20b5abc4b", "content-length": "52", "date": "Sat, 14 Dec 2024 03:39:25 GMT"} })
75272024-12-14T03:39:26.695ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 switch_location = Switch0
75282024-12-14T03:39:26.695ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
75292024-12-14T03:39:26.791ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "15fd975b-da8f-4f80-86bd-ed23d1adfd33", "date": "Sat, 14 Dec 2024 03:39:26 GMT"} })
75302024-12-14T03:39:26.791ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 switch = Switch0
75312024-12-14T03:39:26.791ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
75322024-12-14T03:39:26.791ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "6df2e19b-d1ae-44e9-8ca2-fa05d07ea06a", "content-length": "682", "date": "Sat, 14 Dec 2024 03:39:26 GMT"} })
75332024-12-14T03:39:26.791ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
75342024-12-14T03:39:26.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
75352024-12-14T03:39:26.794ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
75362024-12-14T03:39:26.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
75372024-12-14T03:39:26.797ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
75382024-12-14T03:39:26.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
75392024-12-14T03:39:26.799ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
75402024-12-14T03:39:26.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
75412024-12-14T03:39:26.806ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 460.623269ms iteration = 10 status = {}
75422024-12-14T03:39:35.612ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1011 local_addr = [fd00:1122:3344:101::b]:56585 method = GET remote_addr = [fd00:1122:3344:101::d]:58979 req_id = 75d2d6c9-f052-4656-a0b9-1ccdb7067f28 response_code = 200 uri = /5f2fe413-3c4a-4994-b4a0-995c1da486b1
75432024-12-14T03:39:36.346ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 29 reason = Timeout
75442024-12-14T03:39:36.346ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 29 reason = Timeout
75452024-12-14T03:39:36.346ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
75462024-12-14T03:39:36.346ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
75472024-12-14T03:39:36.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
75482024-12-14T03:39:36.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
75492024-12-14T03:39:36.376ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75502024-12-14T03:39:36.379ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
75512024-12-14T03:39:36.379ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
75522024-12-14T03:39:36.379ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
75532024-12-14T03:39:36.381ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
75542024-12-14T03:39:36.381ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
75552024-12-14T03:39:36.381ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
75562024-12-14T03:39:36.381ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
75572024-12-14T03:39:36.383ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75582024-12-14T03:39:36.386ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1, lookup_type: ById(eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1) } result = Ok(())
75592024-12-14T03:39:36.386ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
75602024-12-14T03:39:36.386ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
75612024-12-14T03:39:36.398ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1 original_time_created = 2024-12-14 03:34:51.368980 UTC target_id = eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1 time_created = 2024-12-14 03:34:51.368980 UTC
75622024-12-14T03:39:36.398ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 51.554223ms iteration = 29 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1","time_created":"2024-12-14T03:34:51.368980Z"}
75632024-12-14T03:39:36.416ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 69.770208ms iteration = 29 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
75642024-12-14T03:39:45.612ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1032 local_addr = [fd00:1122:3344:101::b]:56585 method = GET remote_addr = [fd00:1122:3344:101::d]:58979 req_id = d6f81937-e6fd-4afe-b90b-2ea017aa1806 response_code = 200 uri = /5f2fe413-3c4a-4994-b4a0-995c1da486b1
75652024-12-14T03:39:46.346ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 30 reason = Timeout
75662024-12-14T03:39:46.347ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 30 reason = Timeout
75672024-12-14T03:39:46.347ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
75682024-12-14T03:39:46.347ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
75692024-12-14T03:39:46.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
75702024-12-14T03:39:46.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
75712024-12-14T03:39:46.349ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75722024-12-14T03:39:46.349ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
75732024-12-14T03:39:46.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
75742024-12-14T03:39:46.351ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.928279ms iteration = 30 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
75752024-12-14T03:39:46.351ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
75762024-12-14T03:39:46.351ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
75772024-12-14T03:39:46.352ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
75782024-12-14T03:39:46.354ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
75792024-12-14T03:39:46.354ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
75802024-12-14T03:39:46.356ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75812024-12-14T03:39:46.358ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1, lookup_type: ById(eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1) } result = Ok(())
75822024-12-14T03:39:46.358ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
75832024-12-14T03:39:46.358ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
75842024-12-14T03:39:46.367ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1 original_time_created = 2024-12-14 03:34:51.368980 UTC target_id = eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1 time_created = 2024-12-14 03:34:51.368980 UTC
75852024-12-14T03:39:46.367ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.281766ms iteration = 30 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1","time_created":"2024-12-14T03:34:51.368980Z"}
75862024-12-14T03:39:55.601ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:56805 req_id = d4ee1232-01ca-4460-897a-0385be20459b roles = RoleSet { roles: {} } uri = /metrics/collectors/a321e00a-3126-4ea4-b26d-c0e3eea69166/producers?sort_by=id_ascending
75872024-12-14T03:39:55.602ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:56805 req_id = d4ee1232-01ca-4460-897a-0385be20459b resource = Database result = Ok(()) uri = /metrics/collectors/a321e00a-3126-4ea4-b26d-c0e3eea69166/producers?sort_by=id_ascending
75882024-12-14T03:39:55.604ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3088 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:56805 req_id = d4ee1232-01ca-4460-897a-0385be20459b response_code = 200 uri = /metrics/collectors/a321e00a-3126-4ea4-b26d-c0e3eea69166/producers?sort_by=id_ascending
75892024-12-14T03:39:55.605ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:56805 req_id = 45a75e36-dde9-41c0-ac52-dfce3921666a roles = RoleSet { roles: {} } uri = /metrics/collectors/a321e00a-3126-4ea4-b26d-c0e3eea69166/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlOGQ5NjQ2Zi1hNTQxLTRjMTEtYjViMi1mOTUzNDI3Y2EyZjMifX0%3D
75902024-12-14T03:39:55.605ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:56805 req_id = 45a75e36-dde9-41c0-ac52-dfce3921666a resource = Database result = Ok(()) uri = /metrics/collectors/a321e00a-3126-4ea4-b26d-c0e3eea69166/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlOGQ5NjQ2Zi1hNTQxLTRjMTEtYjViMi1mOTUzNDI3Y2EyZjMifX0%3D
75912024-12-14T03:39:55.607ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2568 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:56805 req_id = 45a75e36-dde9-41c0-ac52-dfce3921666a response_code = 200 uri = /metrics/collectors/a321e00a-3126-4ea4-b26d-c0e3eea69166/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlOGQ5NjQ2Zi1hNTQxLTRjMTEtYjViMi1mOTUzNDI3Y2EyZjMifX0%3D
75922024-12-14T03:39:55.612ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1243 local_addr = [fd00:1122:3344:101::b]:56585 method = GET remote_addr = [fd00:1122:3344:101::d]:58979 req_id = e68a1098-a809-427a-80b7-ea2cd9925d0b response_code = 200 uri = /5f2fe413-3c4a-4994-b4a0-995c1da486b1
75932024-12-14T03:39:55.928ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:56055
75942024-12-14T03:39:55.928ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:56055 req_id = 1d7abf14-0eff-439e-a716-2de5d95005e5 roles = RoleSet { roles: {} } uri = /metrics/producers
75952024-12-14T03:39:55.928ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:56055 req_id = 1d7abf14-0eff-439e-a716-2de5d95005e5 resource = Database result = Ok(()) uri = /metrics/producers
75962024-12-14T03:39:55.973ZINFOnexus: assigned collector to new producer collector_id = a321e00a-3126-4ea4-b26d-c0e3eea69166 file = nexus/src/app/oximeter.rs:76 producer_id = d278f717-338f-4586-9211-4636baa82004
75972024-12-14T03:39:55.973ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 45315 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:56055 req_id = 1d7abf14-0eff-439e-a716-2de5d95005e5 response_code = 201 uri = /metrics/producers
75982024-12-14T03:39:56.346ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 12 reason = Timeout
75992024-12-14T03:39:56.346ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
76002024-12-14T03:39:56.346ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 11 reason = Timeout
76012024-12-14T03:39:56.346ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 11 reason = Timeout
76022024-12-14T03:39:56.346ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
76032024-12-14T03:39:56.346ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
76042024-12-14T03:39:56.346ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
76052024-12-14T03:39:56.346ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 8 reason = Timeout
76062024-12-14T03:39:56.346ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 7 reason = Timeout
76072024-12-14T03:39:56.346ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
76082024-12-14T03:39:56.346ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
76092024-12-14T03:39:56.346ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 11 reason = Timeout
76102024-12-14T03:39:56.346ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
76112024-12-14T03:39:56.346ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
76122024-12-14T03:39:56.346ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 11 reason = Timeout
76132024-12-14T03:39:56.346ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 7 reason = Timeout
76142024-12-14T03:39:56.346ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
76152024-12-14T03:39:56.346ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 31 reason = Timeout
76162024-12-14T03:39:56.346ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 7 reason = Timeout
76172024-12-14T03:39:56.346ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
76182024-12-14T03:39:56.346ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
76192024-12-14T03:39:56.346ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
76202024-12-14T03:39:56.346ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 31 reason = Timeout
76212024-12-14T03:39:56.346ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 11 reason = Timeout
76222024-12-14T03:39:56.346ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
76232024-12-14T03:39:56.346ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
76242024-12-14T03:39:56.346ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 11 reason = Timeout
76252024-12-14T03:39:56.346ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 6 reason = Timeout
76262024-12-14T03:39:56.346ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
76272024-12-14T03:39:56.346ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
76282024-12-14T03:39:56.346ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 7 reason = Timeout
76292024-12-14T03:39:56.346ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1
76302024-12-14T03:39:56.346ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 6 reason = Timeout
76312024-12-14T03:39:56.346ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 11 reason = Timeout
76322024-12-14T03:39:56.346ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 11.31\u{b5}s iteration = 7 status = {"enabled":false,"target_id":"eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1"}
76332024-12-14T03:39:56.346ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
76342024-12-14T03:39:56.346ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
76352024-12-14T03:39:56.346ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 2 reason = Timeout
76362024-12-14T03:39:56.346ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 13 reason = Timeout
76372024-12-14T03:39:56.346ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
76382024-12-14T03:39:56.346ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 7 reason = Timeout
76392024-12-14T03:39:56.346ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
76402024-12-14T03:39:56.346ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
76412024-12-14T03:39:56.346ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 11 reason = Timeout
76422024-12-14T03:39:56.346ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
76432024-12-14T03:39:56.346ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 11 reason = Timeout
76442024-12-14T03:39:56.346ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
76452024-12-14T03:39:56.346ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 11 reason = Timeout
76462024-12-14T03:39:56.346ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
76472024-12-14T03:39:56.347ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 6 reason = Timeout
76482024-12-14T03:39:56.347ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-14 03:29:56.346853531 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
76492024-12-14T03:39:56.347ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
76502024-12-14T03:39:56.347ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 6 reason = Timeout
76512024-12-14T03:39:56.347ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
76522024-12-14T03:39:56.347ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 6 reason = Timeout
76532024-12-14T03:39:56.347ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
76542024-12-14T03:39:56.347ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 7 reason = Timeout
76552024-12-14T03:39:56.347ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 8 reason = Timeout
76562024-12-14T03:39:56.347ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
76572024-12-14T03:39:56.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
76582024-12-14T03:39:56.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
76592024-12-14T03:39:56.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
76602024-12-14T03:39:56.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
76612024-12-14T03:39:56.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
76622024-12-14T03:39:56.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
76632024-12-14T03:39:56.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
76642024-12-14T03:39:56.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
76652024-12-14T03:39:56.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
76662024-12-14T03:39:56.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
76672024-12-14T03:39:56.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
76682024-12-14T03:39:56.347ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 11 reason = Timeout
76692024-12-14T03:39:56.347ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 11 reason = Timeout
76702024-12-14T03:39:56.347ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
76712024-12-14T03:39:56.347ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 11 reason = Timeout
76722024-12-14T03:39:56.347ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
76732024-12-14T03:39:56.347ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
76742024-12-14T03:39:56.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
76752024-12-14T03:39:56.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
76762024-12-14T03:39:56.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
76772024-12-14T03:39:56.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
76782024-12-14T03:39:56.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
76792024-12-14T03:39:56.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
76802024-12-14T03:39:56.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
76812024-12-14T03:39:56.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
76822024-12-14T03:39:56.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
76832024-12-14T03:39:56.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
76842024-12-14T03:39:56.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
76852024-12-14T03:39:56.347ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("28f528f1-3159-4fbc-9304-37b7e4a50ae8.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7274e15f-a5f6-4975-bcdd-a2ef890c0230.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("7274e15f-a5f6-4975-bcdd-a2ef890c0230.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1402, tv_nsec: 665956563 } })
76862024-12-14T03:39:56.347ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("3db8556d-0ae0-4824-8953-f38d8eef7409.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7b672843-049d-4d9c-b0a2-21d7b6323621.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("db39fe07-65c4-451a-a2bd-78fcdfc10040.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("db39fe07-65c4-451a-a2bd-78fcdfc10040.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1402, tv_nsec: 665959193 } })
76872024-12-14T03:39:56.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
76882024-12-14T03:39:56.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
76892024-12-14T03:39:56.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
76902024-12-14T03:39:56.347ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
76912024-12-14T03:39:56.348ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.184554ms iteration = 7 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
76922024-12-14T03:39:56.348ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
76932024-12-14T03:39:56.348ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.366608ms iteration = 7 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
76942024-12-14T03:39:56.348ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
76952024-12-14T03:39:56.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
76962024-12-14T03:39:56.348ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76972024-12-14T03:39:56.349ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.093452ms iteration = 11 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
76982024-12-14T03:39:56.350ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76992024-12-14T03:39:56.350ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8d70e61c-94ed-41ce-b36c-cb904f92c534.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8d70e61c-94ed-41ce-b36c-cb904f92c534.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1402, tv_nsec: 669159627 } })
77002024-12-14T03:39:56.350ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
77012024-12-14T03:39:56.351ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
77022024-12-14T03:39:56.351ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
77032024-12-14T03:39:56.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
77042024-12-14T03:39:56.352ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
77052024-12-14T03:39:56.352ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
77062024-12-14T03:39:56.352ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
77072024-12-14T03:39:56.353ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77082024-12-14T03:39:56.353ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
77092024-12-14T03:39:56.353ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
77102024-12-14T03:39:56.354ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77112024-12-14T03:39:56.355ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
77122024-12-14T03:39:56.355ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
77132024-12-14T03:39:56.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
77142024-12-14T03:39:56.357ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
77152024-12-14T03:39:56.357ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77162024-12-14T03:39:56.357ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77172024-12-14T03:39:56.360ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77182024-12-14T03:39:56.360ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8d70e61c-94ed-41ce-b36c-cb904f92c534.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8d70e61c-94ed-41ce-b36c-cb904f92c534.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1402, tv_nsec: 679248739 } })
77192024-12-14T03:39:56.361ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
77202024-12-14T03:39:56.362ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
77212024-12-14T03:39:56.362ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
77222024-12-14T03:39:56.362ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
77232024-12-14T03:39:56.363ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
77242024-12-14T03:39:56.363ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77252024-12-14T03:39:56.363ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
77262024-12-14T03:39:56.364ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 17.548181ms iteration = 6 status = {"errors":[],"found_port_ok":[]}
77272024-12-14T03:39:56.365ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
77282024-12-14T03:39:56.365ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
77292024-12-14T03:39:56.365ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
77302024-12-14T03:39:56.365ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-14 03:29:56.346853531 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
77312024-12-14T03:39:56.365ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 18.798847ms iteration = 6 status = {"expiration":"2024-12-14T03:29:56.346853531Z","pruned":[]}
77322024-12-14T03:39:56.371ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77332024-12-14T03:39:56.371ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77342024-12-14T03:39:56.371ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77352024-12-14T03:39:56.372ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8d70e61c-94ed-41ce-b36c-cb904f92c534.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8d70e61c-94ed-41ce-b36c-cb904f92c534.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1402, tv_nsec: 690518535 } })
77362024-12-14T03:39:56.372ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200
77372024-12-14T03:39:56.375ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
77382024-12-14T03:39:56.377ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77392024-12-14T03:39:56.378ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
77402024-12-14T03:39:56.378ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
77412024-12-14T03:39:56.378ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
77422024-12-14T03:39:56.378ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
77432024-12-14T03:39:56.378ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
77442024-12-14T03:39:56.380ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1, lookup_type: ById(eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1) } result = Ok(())
77452024-12-14T03:39:56.380ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77462024-12-14T03:39:56.381ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77472024-12-14T03:39:56.391ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
77482024-12-14T03:39:56.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
77492024-12-14T03:39:56.392ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
77502024-12-14T03:39:56.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
77512024-12-14T03:39:56.394ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77522024-12-14T03:39:56.395ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
77532024-12-14T03:39:56.396ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
77542024-12-14T03:39:56.396ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
77552024-12-14T03:39:56.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
77562024-12-14T03:39:56.397ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
77572024-12-14T03:39:56.397ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
77582024-12-14T03:39:56.398ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
77592024-12-14T03:39:56.399ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77602024-12-14T03:39:56.400ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
77612024-12-14T03:39:56.400ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
77622024-12-14T03:39:56.402ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
77632024-12-14T03:39:56.402ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
77642024-12-14T03:39:56.402ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
77652024-12-14T03:39:56.404ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
77662024-12-14T03:39:56.405ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
77672024-12-14T03:39:56.405ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
77682024-12-14T03:39:56.405ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
77692024-12-14T03:39:56.405ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
77702024-12-14T03:39:56.405ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
77712024-12-14T03:39:56.406ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 59.38503ms iteration = 11 status = {"errors":[],"records_set_to_done":[]}
77722024-12-14T03:39:56.407ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
77732024-12-14T03:39:56.407ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1 original_time_created = 2024-12-14 03:34:51.368980 UTC target_id = eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1 time_created = 2024-12-14 03:34:51.368980 UTC
77742024-12-14T03:39:56.407ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 60.89308ms iteration = 31 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1","time_created":"2024-12-14T03:34:51.368980Z"}
77752024-12-14T03:39:56.407ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
77762024-12-14T03:39:56.407ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
77772024-12-14T03:39:56.408ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
77782024-12-14T03:39:56.408ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77792024-12-14T03:39:56.409ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77802024-12-14T03:39:56.409ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 62.261898ms iteration = 11 status = {"errors":[],"garbage_collect_requested":[]}
77812024-12-14T03:39:56.410ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
77822024-12-14T03:39:56.410ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
77832024-12-14T03:39:56.410ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 63.695026ms iteration = 11 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
77842024-12-14T03:39:56.411ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
77852024-12-14T03:39:56.411ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
77862024-12-14T03:39:56.411ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 64.520933ms iteration = 6 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
77872024-12-14T03:39:56.411ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
77882024-12-14T03:39:56.411ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
77892024-12-14T03:39:56.411ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
77902024-12-14T03:39:56.411ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
77912024-12-14T03:39:56.411ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 64.815439ms iteration = 6 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
77922024-12-14T03:39:56.411ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
77932024-12-14T03:39:56.412ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
77942024-12-14T03:39:56.412ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
77952024-12-14T03:39:56.412ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
77962024-12-14T03:39:56.413ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
77972024-12-14T03:39:56.413ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
77982024-12-14T03:39:56.413ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
77992024-12-14T03:39:56.413ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
78002024-12-14T03:39:56.415ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
78012024-12-14T03:39:56.415ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 68.545313ms iteration = 11 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
78022024-12-14T03:39:56.416ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78032024-12-14T03:39:56.416ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78042024-12-14T03:39:56.419ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
78052024-12-14T03:39:56.419ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
78062024-12-14T03:39:56.419ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
78072024-12-14T03:39:56.420ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
78082024-12-14T03:39:56.421ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
78092024-12-14T03:39:56.421ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
78102024-12-14T03:39:56.425ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
78112024-12-14T03:39:56.425ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
78122024-12-14T03:39:56.425ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
78132024-12-14T03:39:56.425ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
78142024-12-14T03:39:56.425ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
78152024-12-14T03:39:56.425ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
78162024-12-14T03:39:56.426ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 79.314038ms iteration = 11 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
78172024-12-14T03:39:56.426ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
78182024-12-14T03:39:56.426ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78192024-12-14T03:39:56.428ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78202024-12-14T03:39:56.429ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
78212024-12-14T03:39:56.429ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
78222024-12-14T03:39:56.429ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
78232024-12-14T03:39:56.433ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
78242024-12-14T03:39:56.433ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
78252024-12-14T03:39:56.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
78262024-12-14T03:39:56.438ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
78272024-12-14T03:39:56.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
78282024-12-14T03:39:56.440ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
78292024-12-14T03:39:56.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
78302024-12-14T03:39:56.441ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78312024-12-14T03:39:56.442ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
78322024-12-14T03:39:56.442ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = c7a5bbe9-1af5-4e36-80b5-da9e0053b676 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
78332024-12-14T03:39:56.442ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
78342024-12-14T03:39:56.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
78352024-12-14T03:39:56.444ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 8d70e61c-94ed-41ce-b36c-cb904f92c534, lookup_type: ById(8d70e61c-94ed-41ce-b36c-cb904f92c534) } result = Ok(())
78362024-12-14T03:39:56.444ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
78372024-12-14T03:39:56.444ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78382024-12-14T03:39:56.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
78392024-12-14T03:39:56.444ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
78402024-12-14T03:39:56.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
78412024-12-14T03:39:56.447ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
78422024-12-14T03:39:56.447ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
78432024-12-14T03:39:56.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
78442024-12-14T03:39:56.449ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 102.845559ms iteration = 11 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
78452024-12-14T03:39:56.449ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 102.806598ms iteration = 11 status = 0
78462024-12-14T03:39:56.449ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
78472024-12-14T03:39:56.450ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
78482024-12-14T03:39:56.450ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
78492024-12-14T03:39:56.450ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
78502024-12-14T03:39:56.451ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = c7a5bbe9-1af5-4e36-80b5-da9e0053b676 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
78512024-12-14T03:39:56.451ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
78522024-12-14T03:39:56.451ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-14 03:35:40.104814 UTC dns_group = internal generation = 1
78532024-12-14T03:39:56.451ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 104.643296ms iteration = 7 status = {"generation":1}
78542024-12-14T03:39:56.451ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78552024-12-14T03:39:56.452ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 105.655696ms iteration = 31 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
78562024-12-14T03:39:56.454ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
78572024-12-14T03:39:56.454ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 107.886021ms iteration = 13 status = {"physical_disks_added":0}
78582024-12-14T03:39:56.454ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
78592024-12-14T03:39:56.454ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
78602024-12-14T03:39:56.455ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
78612024-12-14T03:39:56.456ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
78622024-12-14T03:39:56.457ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
78632024-12-14T03:39:56.457ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
78642024-12-14T03:39:56.458ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78652024-12-14T03:39:56.460ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
78662024-12-14T03:39:56.460ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
78672024-12-14T03:39:56.461ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
78682024-12-14T03:39:56.462ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
78692024-12-14T03:39:56.462ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 51f6df17-b3b5-47fe-9a42-d8752f961c5e dns_zone_name = oxide.test found_so_far = 0 version = 2
78702024-12-14T03:39:56.462ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
78712024-12-14T03:39:56.463ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
78722024-12-14T03:39:56.464ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
78732024-12-14T03:39:56.464ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78742024-12-14T03:39:56.464ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
78752024-12-14T03:39:56.465ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
78762024-12-14T03:39:56.466ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
78772024-12-14T03:39:56.466ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
78782024-12-14T03:39:56.466ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
78792024-12-14T03:39:56.467ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78802024-12-14T03:39:56.467ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
78812024-12-14T03:39:56.467ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
78822024-12-14T03:39:56.467ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
78832024-12-14T03:39:56.468ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
78842024-12-14T03:39:56.468ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
78852024-12-14T03:39:56.469ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 51f6df17-b3b5-47fe-9a42-d8752f961c5e dns_zone_name = oxide.test found_so_far = 1 version = 2
78862024-12-14T03:39:56.469ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
78872024-12-14T03:39:56.469ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-14 03:35:40.905586 UTC dns_group = external generation = 2
78882024-12-14T03:39:56.469ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
78892024-12-14T03:39:56.469ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
78902024-12-14T03:39:56.469ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 122.520274ms iteration = 7 status = {"generation":2}
78912024-12-14T03:39:56.469ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
78922024-12-14T03:39:56.470ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
78932024-12-14T03:39:56.470ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
78942024-12-14T03:39:56.472ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
78952024-12-14T03:39:56.472ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
78962024-12-14T03:39:56.473ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
78972024-12-14T03:39:56.473ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
78982024-12-14T03:39:56.474ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78992024-12-14T03:39:56.477ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
79002024-12-14T03:39:56.477ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
79012024-12-14T03:39:56.477ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
79022024-12-14T03:39:56.479ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
79032024-12-14T03:39:56.479ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
79042024-12-14T03:39:56.479ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 132.051395ms iteration = 11 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
79052024-12-14T03:39:56.480ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
79062024-12-14T03:39:56.481ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
79072024-12-14T03:39:56.483ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
79082024-12-14T03:39:56.483ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
79092024-12-14T03:39:56.485ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
79102024-12-14T03:39:56.485ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
79112024-12-14T03:39:56.486ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
79122024-12-14T03:39:56.486ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
79132024-12-14T03:39:56.487ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
79142024-12-14T03:39:56.487ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
79152024-12-14T03:39:56.488ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79162024-12-14T03:39:56.489ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
79172024-12-14T03:39:56.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
79182024-12-14T03:39:56.492ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
79192024-12-14T03:39:56.492ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
79202024-12-14T03:39:56.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
79212024-12-14T03:39:56.493ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
79222024-12-14T03:39:56.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
79232024-12-14T03:39:56.495ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
79242024-12-14T03:39:56.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
79252024-12-14T03:39:56.496ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79262024-12-14T03:39:56.499ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
79272024-12-14T03:39:56.499ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
79282024-12-14T03:39:56.499ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
79292024-12-14T03:39:56.503ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-14T03:34:54.541856Z, time_modified: 2024-12-14T03:34:54.541856Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, db_silo: Silo { identity: SiloIdentity { id: 578bc52c-ac81-41a6-a56b-dfc79805368e, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-14T03:35:40.848931Z, time_modified: 2024-12-14T03:35:40.848931Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "4dfc5e49ed154568e7a05c630983c79e7ad097d55e90f834bee8ffda0c5a5c9e" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, db_silo: Silo { identity: SiloIdentity { id: 578bc52c-ac81-41a6-a56b-dfc79805368e, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-14T03:35:40.848931Z, time_modified: 2024-12-14T03:35:40.848931Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "4dfc5e49ed154568e7a05c630983c79e7ad097d55e90f834bee8ffda0c5a5c9e" }] }) }
79302024-12-14T03:39:56.503ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 156.447244ms iteration = 7 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"578bc52c-ac81-41a6-a56b-dfc79805368e","tls_certs":["4dfc5e49ed154568e7a05c630983c79e7ad097d55e90f834bee8ffda0c5a5c9e"]}},"default_endpoint":{"silo_id":"578bc52c-ac81-41a6-a56b-dfc79805368e","tls_certs":["4dfc5e49ed154568e7a05c630983c79e7ad097d55e90f834bee8ffda0c5a5c9e"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
79312024-12-14T03:39:56.506ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
79322024-12-14T03:39:56.506ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
79332024-12-14T03:39:56.515ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
79342024-12-14T03:39:56.538ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 zone_address = fd00:1122:3344:101::2
79352024-12-14T03:39:56.538ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
79362024-12-14T03:39:56.539ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a2acffca-6fa9-4684-93f1-f27648c05f69", "content-length": "26", "date": "Sat, 14 Dec 2024 03:39:56 GMT"} })
79372024-12-14T03:39:56.539ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
79382024-12-14T03:39:56.540ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200
79392024-12-14T03:39:56.560ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
79402024-12-14T03:39:56.560ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 213.797512ms iteration = 6 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
79412024-12-14T03:39:56.566ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
79422024-12-14T03:39:56.566ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
79432024-12-14T03:39:56.566ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "5bcc88a8-a2b0-4d46-b393-e82269807df3", "content-length": "26", "date": "Sat, 14 Dec 2024 03:39:56 GMT"} })
79442024-12-14T03:39:56.566ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
79452024-12-14T03:39:56.568ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
79462024-12-14T03:39:56.582ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
79472024-12-14T03:39:56.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
79482024-12-14T03:39:56.623ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
79492024-12-14T03:39:56.686ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
79502024-12-14T03:39:56.687ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "261d2fd4-2b11-4f95-9282-d4fc9a135961", "date": "Sat, 14 Dec 2024 03:39:56 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
79512024-12-14T03:39:56.687ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
79522024-12-14T03:39:56.688ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "f08a67d6-1794-4090-aeb5-f1b886b38de4", "date": "Sat, 14 Dec 2024 03:39:56 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
79532024-12-14T03:39:56.688ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
79542024-12-14T03:39:56.689ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
79552024-12-14T03:39:56.689ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 343.356488ms iteration = 8 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
79562024-12-14T03:39:56.701ZINFOnexus (BackgroundTasks): VPC route manager sled 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
79572024-12-14T03:39:56.701ZDEBGnexus (BackgroundTasks): client request SledAgent = 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
79582024-12-14T03:39:56.701ZDEBGnexus (BackgroundTasks): client response SledAgent = 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "b236e712-fdb6-497c-b40c-0248c0bbc1bb", "content-length": "372", "date": "Sat, 14 Dec 2024 03:39:56 GMT"} })
79592024-12-14T03:39:56.701ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
79602024-12-14T03:39:56.702ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
79612024-12-14T03:39:56.703ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
79622024-12-14T03:39:56.703ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79632024-12-14T03:39:56.703ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
79642024-12-14T03:39:56.705ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
79652024-12-14T03:39:56.705ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
79662024-12-14T03:39:56.705ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8ce4c38c-41ae-4161-b6e8-6409582a197b", "content-length": "26", "date": "Sat, 14 Dec 2024 03:39:56 GMT"} })
79672024-12-14T03:39:56.705ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
79682024-12-14T03:39:56.705ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
79692024-12-14T03:39:56.705ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
79702024-12-14T03:39:56.705ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
79712024-12-14T03:39:56.707ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79722024-12-14T03:39:56.707ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
79732024-12-14T03:39:56.707ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
79742024-12-14T03:39:56.707ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
79752024-12-14T03:39:56.708ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
79762024-12-14T03:39:56.708ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
79772024-12-14T03:39:56.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
79782024-12-14T03:39:56.710ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
79792024-12-14T03:39:56.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
79802024-12-14T03:39:56.712ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
79812024-12-14T03:39:56.712ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
79822024-12-14T03:39:56.714ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
79832024-12-14T03:39:56.714ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
79842024-12-14T03:39:56.716ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
79852024-12-14T03:39:56.716ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
79862024-12-14T03:39:56.718ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
79872024-12-14T03:39:56.718ZDEBGnexus (BackgroundTasks): client request SledAgent = 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
79882024-12-14T03:39:56.719ZDEBGnexus (BackgroundTasks): client response SledAgent = 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "829948cd-7b2c-4412-a51d-5e5e444cffc1", "date": "Sat, 14 Dec 2024 03:39:56 GMT"} })
79892024-12-14T03:39:56.719ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
79902024-12-14T03:39:56.719ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
79912024-12-14T03:39:56.734ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 387.602525ms iteration = 11 status = {}
79922024-12-14T03:39:56.833ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
79932024-12-14T03:39:56.833ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "7a82ad37-82f7-427b-9101-bbe79a75c24f", "content-length": "1", "date": "Sat, 14 Dec 2024 03:39:56 GMT"} })
79942024-12-14T03:39:56.834ZDEBGnexus (BackgroundTasks): client request SledAgent = 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
79952024-12-14T03:39:56.834ZDEBGnexus (BackgroundTasks): client response SledAgent = 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "8c5c5896-fe53-44a5-9e16-0b10242195c6", "content-length": "691", "date": "Sat, 14 Dec 2024 03:39:56 GMT"} })
79962024-12-14T03:39:56.834ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
79972024-12-14T03:39:56.834ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
79982024-12-14T03:39:56.834ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
79992024-12-14T03:39:56.835ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
80002024-12-14T03:39:56.835ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
80012024-12-14T03:39:56.835ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80022024-12-14T03:39:56.836ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 489.544587ms iteration = 11 status = {}
80032024-12-14T03:39:56.836ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
80042024-12-14T03:39:56.836ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
80052024-12-14T03:39:56.837ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 491.099408ms iteration = 11 status = null
80062024-12-14T03:39:56.839ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
80072024-12-14T03:39:56.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
80082024-12-14T03:39:56.839ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
80092024-12-14T03:39:56.839ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
80102024-12-14T03:39:56.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
80112024-12-14T03:39:56.841ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
80122024-12-14T03:39:56.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
80132024-12-14T03:39:56.842ZINFOnexus (BackgroundTasks): VPC route manager sled 8d70e61c-94ed-41ce-b36c-cb904f92c534 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
80142024-12-14T03:39:56.842ZDEBGnexus (BackgroundTasks): client request SledAgent = 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
80152024-12-14T03:39:56.842ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
80162024-12-14T03:39:56.842ZDEBGnexus (BackgroundTasks): client response SledAgent = 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "76fcc018-d9ad-46d6-a4fd-a6306f5fc44d", "date": "Sat, 14 Dec 2024 03:39:56 GMT"} })
80172024-12-14T03:39:56.842ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
80182024-12-14T03:39:56.843ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80192024-12-14T03:39:56.844ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 497.692881ms iteration = 12 status = {}
80202024-12-14T03:39:56.847ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
80212024-12-14T03:39:56.847ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
80222024-12-14T03:39:56.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
80232024-12-14T03:39:56.853ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {Name("external-dns"): [NetworkInterface { id: 0951ac68-a8db-47fb-ad0e-675cae6d693a, kind: Service { id: 28f528f1-3159-4fbc-9304-37b7e4a50ae8 }, name: Name("external-dns-28f528f1-3159-4fbc-9304-37b7e4a50ae8"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 140, 181])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cb55e4cb-e945-41d1-ba05-5e6f98df2e24, kind: Service { id: 7274e15f-a5f6-4975-bcdd-a2ef890c0230 }, name: Name("external-dns-7274e15f-a5f6-4975-bcdd-a2ef890c0230"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 190, 158])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("nexus"): [NetworkInterface { id: 4f1fe649-79cb-49da-9215-8ff632ac6466, kind: Service { id: e8d9646f-a541-4c11-b5b2-f953427ca2f3 }, name: Name("nexus-e8d9646f-a541-4c11-b5b2-f953427ca2f3"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 170, 226])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 513aa8b2-d165-4db3-997f-2262204f1075, kind: Service { id: dc6862c8-90dd-40bf-a461-5b36c4239936 }, name: Name("nexus-dc6862c8-90dd-40bf-a461-5b36c4239936"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 182, 203])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 669bb0eb-969e-4430-94e4-187a825d1f3d, kind: Service { id: 5f2fe413-3c4a-4994-b4a0-995c1da486b1 }, name: Name("nexus-5f2fe413-3c4a-4994-b4a0-995c1da486b1"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 143, 224])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })], Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })]} vpc_interfaces = {}
80242024-12-14T03:39:56.853ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
80252024-12-14T03:39:56.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
80262024-12-14T03:39:56.855ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80272024-12-14T03:39:56.857ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
80282024-12-14T03:39:56.857ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
80292024-12-14T03:39:56.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
80302024-12-14T03:39:56.858ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
80312024-12-14T03:39:56.858ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 0951ac68-a8db-47fb-ad0e-675cae6d693a, kind: Service { id: 28f528f1-3159-4fbc-9304-37b7e4a50ae8 }, name: Name("external-dns-28f528f1-3159-4fbc-9304-37b7e4a50ae8"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 140, 181])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cb55e4cb-e945-41d1-ba05-5e6f98df2e24, kind: Service { id: 7274e15f-a5f6-4975-bcdd-a2ef890c0230 }, name: Name("external-dns-7274e15f-a5f6-4975-bcdd-a2ef890c0230"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 190, 158])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 4f1fe649-79cb-49da-9215-8ff632ac6466, kind: Service { id: e8d9646f-a541-4c11-b5b2-f953427ca2f3 }, name: Name("nexus-e8d9646f-a541-4c11-b5b2-f953427ca2f3"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 170, 226])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 513aa8b2-d165-4db3-997f-2262204f1075, kind: Service { id: dc6862c8-90dd-40bf-a461-5b36c4239936 }, name: Name("nexus-dc6862c8-90dd-40bf-a461-5b36c4239936"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 182, 203])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 669bb0eb-969e-4430-94e4-187a825d1f3d, kind: Service { id: 5f2fe413-3c4a-4994-b4a0-995c1da486b1 }, name: Name("nexus-5f2fe413-3c4a-4994-b4a0-995c1da486b1"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 143, 224])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
80322024-12-14T03:39:56.858ZDEBGnexus (service-firewall-rule-progator): resolved 2 rules for sleds background_task = service_firewall_rule_propagation
80332024-12-14T03:39:56.874ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
80342024-12-14T03:39:56.907ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = [Sled { identity: SledIdentity { id: 8d70e61c-94ed-41ce-b36c-cb904f92c534, time_created: 2024-12-14T03:35:37.430597Z, time_modified: 2024-12-14T03:35:37.430597Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: a121ca05-bbee-41bf-b9db-9e03ff035200, is_scrimlet: true, serial_number: "buskin", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
80352024-12-14T03:39:56.907ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
80362024-12-14T03:39:56.907ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
80372024-12-14T03:39:56.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
80382024-12-14T03:39:56.909ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
80392024-12-14T03:39:56.909ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
80402024-12-14T03:39:56.911ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80412024-12-14T03:39:56.913ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Sled { parent: Fleet, key: 8d70e61c-94ed-41ce-b36c-cb904f92c534, lookup_type: ById(8d70e61c-94ed-41ce-b36c-cb904f92c534) } result = Ok(())
80422024-12-14T03:39:57.120ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
80432024-12-14T03:39:57.121ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "3c487157-a172-4ba8-b47b-a36ce8c2f673", "date": "Sat, 14 Dec 2024 03:39:57 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
80442024-12-14T03:39:57.121ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
80452024-12-14T03:39:57.122ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "644278dd-977a-413b-be21-eeab86281fec", "date": "Sat, 14 Dec 2024 03:39:57 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
80462024-12-14T03:39:57.122ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
80472024-12-14T03:39:57.124ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "46d77f96-b322-42b6-b46b-a7bc608ecf4e", "date": "Sat, 14 Dec 2024 03:39:57 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
80482024-12-14T03:39:57.124ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
80492024-12-14T03:39:57.125ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
80502024-12-14T03:39:57.125ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 778.594128ms iteration = 8 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
80512024-12-14T03:39:57.163ZDEBGnexus (service-firewall-rule-progator): client request SledAgent = 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = service_firewall_rule_propagation body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
80522024-12-14T03:39:57.164ZDEBGnexus (service-firewall-rule-progator): client response SledAgent = 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = service_firewall_rule_propagation result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "16ffb23c-e88e-412b-97bb-0a9d1b88f931", "date": "Sat, 14 Dec 2024 03:39:56 GMT"} })
80532024-12-14T03:39:57.166ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 1 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
80542024-12-14T03:39:57.166ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 819.340435ms
80552024-12-14T03:39:57.166ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 819.347665ms iteration = 2 status = {}
80562024-12-14T03:39:57.177ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
80572024-12-14T03:39:57.178ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
80582024-12-14T03:39:57.180ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 45ca990e-42e9-4264-be3e-0adfed2cd99b, rack_id: a121ca05-bbee-41bf-b9db-9e03ff035200, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(811a570a-bdaf-4a1b-8eba-0c0e4977f7bb) } rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 switch_location = Switch0
80592024-12-14T03:39:57.180ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
80602024-12-14T03:39:57.180ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
80612024-12-14T03:39:57.191ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
80622024-12-14T03:39:57.191ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "ec057b3d-f14c-4073-98ed-a1dc07679ebc", "content-length": "134", "date": "Sat, 14 Dec 2024 03:39:56 GMT"} })
80632024-12-14T03:39:57.191ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
80642024-12-14T03:39:57.191ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 811a570a-bdaf-4a1b-8eba-0c0e4977f7bb
80652024-12-14T03:39:57.191ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
80662024-12-14T03:39:57.191ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
80672024-12-14T03:39:57.191ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
80682024-12-14T03:39:57.191ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
80692024-12-14T03:39:57.191ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
80702024-12-14T03:39:57.191ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
80712024-12-14T03:39:57.192ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
80722024-12-14T03:39:57.192ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
80732024-12-14T03:39:57.192ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200
80742024-12-14T03:39:57.192ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
80752024-12-14T03:39:57.192ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
80762024-12-14T03:39:57.194ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
80772024-12-14T03:39:57.195ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "79e9706c-3dd4-4ec8-94d5-2849fc7b5a12", "content-length": "2", "date": "Sat, 14 Dec 2024 03:39:56 GMT"} })
80782024-12-14T03:39:57.195ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
80792024-12-14T03:39:57.195ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "e72c0044-b5cc-47a7-826a-e76e06435b0c", "content-length": "52", "date": "Sat, 14 Dec 2024 03:39:57 GMT"} })
80802024-12-14T03:39:57.195ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 switch_location = Switch0
80812024-12-14T03:39:57.195ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
80822024-12-14T03:39:57.340ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "2f48a52b-f6f1-4894-9f00-d22c9c2133d6", "date": "Sat, 14 Dec 2024 03:39:56 GMT"} })
80832024-12-14T03:39:57.341ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 switch = Switch0
80842024-12-14T03:39:57.341ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
80852024-12-14T03:39:57.341ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "cc2d5824-29f2-442d-a575-06c425239b62", "content-length": "682", "date": "Sat, 14 Dec 2024 03:39:56 GMT"} })
80862024-12-14T03:39:57.341ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
80872024-12-14T03:39:57.341ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
80882024-12-14T03:39:57.345ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
80892024-12-14T03:39:57.346ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
80902024-12-14T03:39:57.349ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
80912024-12-14T03:39:57.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
80922024-12-14T03:39:57.351ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
80932024-12-14T03:39:57.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
80942024-12-14T03:39:57.359ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 1.012398643s iteration = 11 status = {}
80952024-12-14T03:40:05.612ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1070 local_addr = [fd00:1122:3344:101::b]:56585 method = GET remote_addr = [fd00:1122:3344:101::d]:58979 req_id = 16e5e6a5-4ce1-4968-b7b2-04598eea3227 response_code = 200 uri = /5f2fe413-3c4a-4994-b4a0-995c1da486b1
80962024-12-14T03:40:06.346ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 32 reason = Timeout
80972024-12-14T03:40:06.346ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
80982024-12-14T03:40:06.346ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 32 reason = Timeout
80992024-12-14T03:40:06.346ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
81002024-12-14T03:40:06.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
81012024-12-14T03:40:06.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
81022024-12-14T03:40:06.349ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81032024-12-14T03:40:06.349ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
81042024-12-14T03:40:06.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
81052024-12-14T03:40:06.351ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.742295ms iteration = 32 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
81062024-12-14T03:40:06.351ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
81072024-12-14T03:40:06.351ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
81082024-12-14T03:40:06.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
81092024-12-14T03:40:06.353ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
81102024-12-14T03:40:06.353ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
81112024-12-14T03:40:06.355ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81122024-12-14T03:40:06.358ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1, lookup_type: ById(eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1) } result = Ok(())
81132024-12-14T03:40:06.358ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
81142024-12-14T03:40:06.358ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
81152024-12-14T03:40:06.369ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1 original_time_created = 2024-12-14 03:34:51.368980 UTC target_id = eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1 time_created = 2024-12-14 03:34:51.368980 UTC
81162024-12-14T03:40:06.369ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.129804ms iteration = 32 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1","time_created":"2024-12-14T03:34:51.368980Z"}
81172024-12-14T03:40:10.601ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:56805 req_id = fa63a94c-40ea-4dd4-abc1-e7e36e4ce9aa roles = RoleSet { roles: {} } uri = /metrics/collectors/a321e00a-3126-4ea4-b26d-c0e3eea69166/producers?sort_by=id_ascending
81182024-12-14T03:40:10.602ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:56805 req_id = fa63a94c-40ea-4dd4-abc1-e7e36e4ce9aa resource = Database result = Ok(()) uri = /metrics/collectors/a321e00a-3126-4ea4-b26d-c0e3eea69166/producers?sort_by=id_ascending
81192024-12-14T03:40:10.604ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2925 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:56805 req_id = fa63a94c-40ea-4dd4-abc1-e7e36e4ce9aa response_code = 200 uri = /metrics/collectors/a321e00a-3126-4ea4-b26d-c0e3eea69166/producers?sort_by=id_ascending
81202024-12-14T03:40:10.605ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:56805 req_id = 64b55c5c-2171-410d-9035-0c59e9c0b23f roles = RoleSet { roles: {} } uri = /metrics/collectors/a321e00a-3126-4ea4-b26d-c0e3eea69166/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlOGQ5NjQ2Zi1hNTQxLTRjMTEtYjViMi1mOTUzNDI3Y2EyZjMifX0%3D
81212024-12-14T03:40:10.605ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:56805 req_id = 64b55c5c-2171-410d-9035-0c59e9c0b23f resource = Database result = Ok(()) uri = /metrics/collectors/a321e00a-3126-4ea4-b26d-c0e3eea69166/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlOGQ5NjQ2Zi1hNTQxLTRjMTEtYjViMi1mOTUzNDI3Y2EyZjMifX0%3D
81222024-12-14T03:40:10.607ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2576 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:56805 req_id = 64b55c5c-2171-410d-9035-0c59e9c0b23f response_code = 200 uri = /metrics/collectors/a321e00a-3126-4ea4-b26d-c0e3eea69166/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlOGQ5NjQ2Zi1hNTQxLTRjMTEtYjViMi1mOTUzNDI3Y2EyZjMifX0%3D
81232024-12-14T03:40:15.612ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1110 local_addr = [fd00:1122:3344:101::b]:56585 method = GET remote_addr = [fd00:1122:3344:101::d]:58979 req_id = 9d0efbfe-494e-4cef-abe3-fc8e4322416e response_code = 200 uri = /5f2fe413-3c4a-4994-b4a0-995c1da486b1
81242024-12-14T03:40:16.347ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 33 reason = Timeout
81252024-12-14T03:40:16.347ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
81262024-12-14T03:40:16.347ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 33 reason = Timeout
81272024-12-14T03:40:16.347ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
81282024-12-14T03:40:16.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
81292024-12-14T03:40:16.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
81302024-12-14T03:40:16.348ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
81312024-12-14T03:40:16.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
81322024-12-14T03:40:16.349ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81332024-12-14T03:40:16.350ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.892898ms iteration = 33 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
81342024-12-14T03:40:16.352ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
81352024-12-14T03:40:16.352ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
81362024-12-14T03:40:16.352ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
81372024-12-14T03:40:16.354ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
81382024-12-14T03:40:16.354ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
81392024-12-14T03:40:16.356ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81402024-12-14T03:40:16.358ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1, lookup_type: ById(eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1) } result = Ok(())
81412024-12-14T03:40:16.358ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
81422024-12-14T03:40:16.358ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
81432024-12-14T03:40:16.366ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1 original_time_created = 2024-12-14 03:34:51.368980 UTC target_id = eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1 time_created = 2024-12-14 03:34:51.368980 UTC
81442024-12-14T03:40:16.366ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.905069ms iteration = 33 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1","time_created":"2024-12-14T03:34:51.368980Z"}
81452024-12-14T03:40:25.602ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:56805 req_id = 7ada49d6-75ed-4c96-989b-391ed3238d69 roles = RoleSet { roles: {} } uri = /metrics/collectors/a321e00a-3126-4ea4-b26d-c0e3eea69166/producers?sort_by=id_ascending
81462024-12-14T03:40:25.602ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:56805 req_id = 7ada49d6-75ed-4c96-989b-391ed3238d69 resource = Database result = Ok(()) uri = /metrics/collectors/a321e00a-3126-4ea4-b26d-c0e3eea69166/producers?sort_by=id_ascending
81472024-12-14T03:40:25.604ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2242 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:56805 req_id = 7ada49d6-75ed-4c96-989b-391ed3238d69 response_code = 200 uri = /metrics/collectors/a321e00a-3126-4ea4-b26d-c0e3eea69166/producers?sort_by=id_ascending
81482024-12-14T03:40:25.604ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:56805 req_id = 25ff3e3d-ec82-471c-8051-7bda29b79fe7 roles = RoleSet { roles: {} } uri = /metrics/collectors/a321e00a-3126-4ea4-b26d-c0e3eea69166/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlOGQ5NjQ2Zi1hNTQxLTRjMTEtYjViMi1mOTUzNDI3Y2EyZjMifX0%3D
81492024-12-14T03:40:25.605ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:56805 req_id = 25ff3e3d-ec82-471c-8051-7bda29b79fe7 resource = Database result = Ok(()) uri = /metrics/collectors/a321e00a-3126-4ea4-b26d-c0e3eea69166/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlOGQ5NjQ2Zi1hNTQxLTRjMTEtYjViMi1mOTUzNDI3Y2EyZjMifX0%3D
81502024-12-14T03:40:25.607ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2281 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:56805 req_id = 25ff3e3d-ec82-471c-8051-7bda29b79fe7 response_code = 200 uri = /metrics/collectors/a321e00a-3126-4ea4-b26d-c0e3eea69166/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlOGQ5NjQ2Zi1hNTQxLTRjMTEtYjViMi1mOTUzNDI3Y2EyZjMifX0%3D
81512024-12-14T03:40:25.613ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 994 local_addr = [fd00:1122:3344:101::b]:56585 method = GET remote_addr = [fd00:1122:3344:101::d]:58979 req_id = 0c6d336b-5666-4d74-8ce8-108c82363449 response_code = 200 uri = /5f2fe413-3c4a-4994-b4a0-995c1da486b1
81522024-12-14T03:40:26.347ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 13 reason = Timeout
81532024-12-14T03:40:26.347ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
81542024-12-14T03:40:26.347ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
81552024-12-14T03:40:26.347ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 12 reason = Timeout
81562024-12-14T03:40:26.347ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 12 reason = Timeout
81572024-12-14T03:40:26.347ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
81582024-12-14T03:40:26.347ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 12 reason = Timeout
81592024-12-14T03:40:26.347ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
81602024-12-14T03:40:26.347ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
81612024-12-14T03:40:26.347ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 12 reason = Timeout
81622024-12-14T03:40:26.347ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 14 reason = Timeout
81632024-12-14T03:40:26.347ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
81642024-12-14T03:40:26.347ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
81652024-12-14T03:40:26.347ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 12 reason = Timeout
81662024-12-14T03:40:26.347ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 12 reason = Timeout
81672024-12-14T03:40:26.347ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
81682024-12-14T03:40:26.347ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 12 reason = Timeout
81692024-12-14T03:40:26.347ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
81702024-12-14T03:40:26.347ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
81712024-12-14T03:40:26.347ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 12 reason = Timeout
81722024-12-14T03:40:26.347ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 34 reason = Timeout
81732024-12-14T03:40:26.347ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
81742024-12-14T03:40:26.347ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
81752024-12-14T03:40:26.347ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 12 reason = Timeout
81762024-12-14T03:40:26.347ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
81772024-12-14T03:40:26.347ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 12 reason = Timeout
81782024-12-14T03:40:26.347ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
81792024-12-14T03:40:26.347ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 34 reason = Timeout
81802024-12-14T03:40:26.347ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
81812024-12-14T03:40:26.347ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 12 reason = Timeout
81822024-12-14T03:40:26.347ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
81832024-12-14T03:40:26.347ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 12 reason = Timeout
81842024-12-14T03:40:26.347ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
81852024-12-14T03:40:26.347ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 12 reason = Timeout
81862024-12-14T03:40:26.347ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
81872024-12-14T03:40:26.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
81882024-12-14T03:40:26.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
81892024-12-14T03:40:26.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
81902024-12-14T03:40:26.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
81912024-12-14T03:40:26.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
81922024-12-14T03:40:26.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
81932024-12-14T03:40:26.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
81942024-12-14T03:40:26.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
81952024-12-14T03:40:26.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
81962024-12-14T03:40:26.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
81972024-12-14T03:40:26.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
81982024-12-14T03:40:26.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
81992024-12-14T03:40:26.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
82002024-12-14T03:40:26.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
82012024-12-14T03:40:26.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
82022024-12-14T03:40:26.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
82032024-12-14T03:40:26.349ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82042024-12-14T03:40:26.350ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82052024-12-14T03:40:26.351ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82062024-12-14T03:40:26.351ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.109722ms iteration = 12 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
82072024-12-14T03:40:26.351ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8d70e61c-94ed-41ce-b36c-cb904f92c534.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8d70e61c-94ed-41ce-b36c-cb904f92c534.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1432, tv_nsec: 669614082 } })
82082024-12-14T03:40:26.351ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
82092024-12-14T03:40:26.351ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
82102024-12-14T03:40:26.351ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
82112024-12-14T03:40:26.351ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
82122024-12-14T03:40:26.351ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
82132024-12-14T03:40:26.351ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
82142024-12-14T03:40:26.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
82152024-12-14T03:40:26.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
82162024-12-14T03:40:26.353ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
82172024-12-14T03:40:26.353ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
82182024-12-14T03:40:26.353ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
82192024-12-14T03:40:26.353ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
82202024-12-14T03:40:26.353ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8d70e61c-94ed-41ce-b36c-cb904f92c534.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8d70e61c-94ed-41ce-b36c-cb904f92c534.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1432, tv_nsec: 672083692 } })
82212024-12-14T03:40:26.353ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
82222024-12-14T03:40:26.354ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
82232024-12-14T03:40:26.354ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
82242024-12-14T03:40:26.354ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
82252024-12-14T03:40:26.354ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
82262024-12-14T03:40:26.356ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82272024-12-14T03:40:26.356ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
82282024-12-14T03:40:26.356ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 9.349978ms iteration = 12 status = {"errors":[],"records_set_to_done":[]}
82292024-12-14T03:40:26.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
82302024-12-14T03:40:26.357ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 9.619153ms iteration = 12 status = {"errors":[],"garbage_collect_requested":[]}
82312024-12-14T03:40:26.357ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
82322024-12-14T03:40:26.358ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
82332024-12-14T03:40:26.358ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
82342024-12-14T03:40:26.358ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
82352024-12-14T03:40:26.358ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
82362024-12-14T03:40:26.359ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82372024-12-14T03:40:26.360ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82382024-12-14T03:40:26.361ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 13.863278ms iteration = 34 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
82392024-12-14T03:40:26.362ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
82402024-12-14T03:40:26.362ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
82412024-12-14T03:40:26.362ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
82422024-12-14T03:40:26.362ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
82432024-12-14T03:40:26.363ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
82442024-12-14T03:40:26.363ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
82452024-12-14T03:40:26.363ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
82462024-12-14T03:40:26.363ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
82472024-12-14T03:40:26.363ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
82482024-12-14T03:40:26.363ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
82492024-12-14T03:40:26.365ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
82502024-12-14T03:40:26.365ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
82512024-12-14T03:40:26.365ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82522024-12-14T03:40:26.366ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8d70e61c-94ed-41ce-b36c-cb904f92c534.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8d70e61c-94ed-41ce-b36c-cb904f92c534.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1432, tv_nsec: 684651693 } })
82532024-12-14T03:40:26.366ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200
82542024-12-14T03:40:26.367ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
82552024-12-14T03:40:26.367ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
82562024-12-14T03:40:26.367ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
82572024-12-14T03:40:26.371ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
82582024-12-14T03:40:26.371ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 23.694815ms iteration = 12 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
82592024-12-14T03:40:26.383ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82602024-12-14T03:40:26.384ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
82612024-12-14T03:40:26.384ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
82622024-12-14T03:40:26.387ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
82632024-12-14T03:40:26.387ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82642024-12-14T03:40:26.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82652024-12-14T03:40:26.387ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
82662024-12-14T03:40:26.388ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
82672024-12-14T03:40:26.389ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
82682024-12-14T03:40:26.389ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
82692024-12-14T03:40:26.389ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
82702024-12-14T03:40:26.389ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
82712024-12-14T03:40:26.389ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
82722024-12-14T03:40:26.390ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
82732024-12-14T03:40:26.390ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82742024-12-14T03:40:26.390ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82752024-12-14T03:40:26.396ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
82762024-12-14T03:40:26.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
82772024-12-14T03:40:26.401ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 54.171685ms iteration = 12 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
82782024-12-14T03:40:26.402ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 54.777658ms iteration = 12 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
82792024-12-14T03:40:26.442ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
82802024-12-14T03:40:26.442ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
82812024-12-14T03:40:26.443ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c1579d17-67aa-44af-b96d-4f166798291c", "content-length": "26", "date": "Sat, 14 Dec 2024 03:40:26 GMT"} })
82822024-12-14T03:40:26.443ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
82832024-12-14T03:40:26.444ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
82842024-12-14T03:40:26.453ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
82852024-12-14T03:40:26.453ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
82862024-12-14T03:40:26.454ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6a1978a2-4402-482e-9580-c7b0c9b5b5cd", "content-length": "26", "date": "Sat, 14 Dec 2024 03:40:26 GMT"} })
82872024-12-14T03:40:26.454ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
82882024-12-14T03:40:26.455ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
82892024-12-14T03:40:26.462ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 115.324721ms iteration = 14 status = {"physical_disks_added":0}
82902024-12-14T03:40:26.469ZINFOnexus (BackgroundTasks): VPC route manager sled 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
82912024-12-14T03:40:26.469ZDEBGnexus (BackgroundTasks): client request SledAgent = 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
82922024-12-14T03:40:26.469ZDEBGnexus (BackgroundTasks): client response SledAgent = 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "6caa17a6-30a1-4264-a41c-85caf0a9d7bc", "content-length": "372", "date": "Sat, 14 Dec 2024 03:40:26 GMT"} })
82932024-12-14T03:40:26.469ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
82942024-12-14T03:40:26.469ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
82952024-12-14T03:40:26.469ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 zone_address = fd00:1122:3344:101::2
82962024-12-14T03:40:26.469ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
82972024-12-14T03:40:26.470ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f64cde4f-4b90-4b3c-9ce7-3f4f373595ef", "content-length": "26", "date": "Sat, 14 Dec 2024 03:40:26 GMT"} })
82982024-12-14T03:40:26.470ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
82992024-12-14T03:40:26.471ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83002024-12-14T03:40:26.471ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200
83012024-12-14T03:40:26.472ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83022024-12-14T03:40:26.474ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 8d70e61c-94ed-41ce-b36c-cb904f92c534, lookup_type: ById(8d70e61c-94ed-41ce-b36c-cb904f92c534) } result = Ok(())
83032024-12-14T03:40:26.474ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
83042024-12-14T03:40:26.474ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
83052024-12-14T03:40:26.476ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1, lookup_type: ById(eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1) } result = Ok(())
83062024-12-14T03:40:26.476ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
83072024-12-14T03:40:26.476ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
83082024-12-14T03:40:26.478ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 131.208788ms iteration = 12 status = 0
83092024-12-14T03:40:26.489ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1 original_time_created = 2024-12-14 03:34:51.368980 UTC target_id = eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1 time_created = 2024-12-14 03:34:51.368980 UTC
83102024-12-14T03:40:26.489ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 141.675489ms iteration = 34 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1","time_created":"2024-12-14T03:34:51.368980Z"}
83112024-12-14T03:40:26.496ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 149.505055ms iteration = 12 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
83122024-12-14T03:40:26.499ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
83132024-12-14T03:40:26.499ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
83142024-12-14T03:40:26.499ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 152.651128ms iteration = 12 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
83152024-12-14T03:40:26.513ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
83162024-12-14T03:40:26.513ZDEBGnexus (BackgroundTasks): client request SledAgent = 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
83172024-12-14T03:40:26.514ZDEBGnexus (BackgroundTasks): client response SledAgent = 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "f1e96801-2d24-4d45-ad03-aed574ac4aaa", "date": "Sat, 14 Dec 2024 03:40:26 GMT"} })
83182024-12-14T03:40:26.514ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
83192024-12-14T03:40:26.514ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
83202024-12-14T03:40:26.516ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 169.195179ms iteration = 12 status = {}
83212024-12-14T03:40:26.516ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
83222024-12-14T03:40:26.517ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
83232024-12-14T03:40:26.520ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
83242024-12-14T03:40:26.521ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
83252024-12-14T03:40:26.524ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
83262024-12-14T03:40:26.524ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "07d8f407-d37c-4cc4-a7a4-7980451d903f", "content-length": "1", "date": "Sat, 14 Dec 2024 03:40:25 GMT"} })
83272024-12-14T03:40:26.524ZINFOnexus (BackgroundTasks): VPC route manager sled 8d70e61c-94ed-41ce-b36c-cb904f92c534 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
83282024-12-14T03:40:26.524ZDEBGnexus (BackgroundTasks): client request SledAgent = 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
83292024-12-14T03:40:26.525ZDEBGnexus (BackgroundTasks): client response SledAgent = 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "fa91380e-f0fc-48de-934c-b7ba693e3cc1", "date": "Sat, 14 Dec 2024 03:40:26 GMT"} })
83302024-12-14T03:40:26.526ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
83312024-12-14T03:40:26.526ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
83322024-12-14T03:40:26.526ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 179.734451ms iteration = 13 status = {}
83332024-12-14T03:40:26.529ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 181.67679ms iteration = 12 status = null
83342024-12-14T03:40:26.565ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
83352024-12-14T03:40:26.565ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
83362024-12-14T03:40:26.566ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83372024-12-14T03:40:26.568ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
83382024-12-14T03:40:26.568ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
83392024-12-14T03:40:26.568ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
83402024-12-14T03:40:26.570ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83412024-12-14T03:40:26.571ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
83422024-12-14T03:40:26.571ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
83432024-12-14T03:40:26.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
83442024-12-14T03:40:26.597ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
83452024-12-14T03:40:26.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
83462024-12-14T03:40:26.599ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 45ca990e-42e9-4264-be3e-0adfed2cd99b, rack_id: a121ca05-bbee-41bf-b9db-9e03ff035200, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(811a570a-bdaf-4a1b-8eba-0c0e4977f7bb) } rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 switch_location = Switch0
83472024-12-14T03:40:26.599ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
83482024-12-14T03:40:26.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
83492024-12-14T03:40:26.609ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
83502024-12-14T03:40:26.609ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "bd19c9f8-7c41-4032-bc96-d585c6bf02d8", "content-length": "134", "date": "Sat, 14 Dec 2024 03:40:25 GMT"} })
83512024-12-14T03:40:26.609ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
83522024-12-14T03:40:26.609ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 811a570a-bdaf-4a1b-8eba-0c0e4977f7bb
83532024-12-14T03:40:26.609ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
83542024-12-14T03:40:26.609ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
83552024-12-14T03:40:26.609ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
83562024-12-14T03:40:26.609ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
83572024-12-14T03:40:26.609ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
83582024-12-14T03:40:26.609ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
83592024-12-14T03:40:26.609ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
83602024-12-14T03:40:26.609ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
83612024-12-14T03:40:26.610ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200
83622024-12-14T03:40:26.610ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
83632024-12-14T03:40:26.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
83642024-12-14T03:40:26.612ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
83652024-12-14T03:40:26.612ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "83e9b559-7451-434b-bebc-816fd554011f", "content-length": "2", "date": "Sat, 14 Dec 2024 03:40:26 GMT"} })
83662024-12-14T03:40:26.612ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
83672024-12-14T03:40:26.612ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "014dcd35-5b8f-4b2c-b326-87377650e502", "content-length": "52", "date": "Sat, 14 Dec 2024 03:40:26 GMT"} })
83682024-12-14T03:40:26.612ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 switch_location = Switch0
83692024-12-14T03:40:26.612ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
83702024-12-14T03:40:26.664ZDEBGnexus (BackgroundTasks): client request SledAgent = 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
83712024-12-14T03:40:26.705ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "550cfdd4-030a-416b-9f5d-6a8cfb8b6d74", "date": "Sat, 14 Dec 2024 03:40:26 GMT"} })
83722024-12-14T03:40:26.705ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 switch = Switch0
83732024-12-14T03:40:26.705ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
83742024-12-14T03:40:26.706ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "4d51930e-08c7-4837-8a6f-3d1c1619d1da", "content-length": "682", "date": "Sat, 14 Dec 2024 03:40:26 GMT"} })
83752024-12-14T03:40:26.706ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
83762024-12-14T03:40:26.706ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
83772024-12-14T03:40:26.706ZDEBGnexus (BackgroundTasks): client response SledAgent = 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "eeb652d9-b8fe-4001-bb9b-e88cb4383eb4", "content-length": "691", "date": "Sat, 14 Dec 2024 03:40:26 GMT"} })
83782024-12-14T03:40:26.706ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
83792024-12-14T03:40:26.706ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
83802024-12-14T03:40:26.706ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
83812024-12-14T03:40:26.708ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 360.644396ms iteration = 12 status = {}
83822024-12-14T03:40:26.709ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
83832024-12-14T03:40:26.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
83842024-12-14T03:40:26.713ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
83852024-12-14T03:40:26.714ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
83862024-12-14T03:40:26.716ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
83872024-12-14T03:40:26.716ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
83882024-12-14T03:40:26.724ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 376.586594ms iteration = 12 status = {}
83892024-12-14T03:40:27.157ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:54379
83902024-12-14T03:40:27.158ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:54379 req_id = f69b1140-3660-4d91-93d2-4a7a66fb3d66 roles = RoleSet { roles: {} } uri = /metrics/producers
83912024-12-14T03:40:27.158ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:54379 req_id = f69b1140-3660-4d91-93d2-4a7a66fb3d66 resource = Database result = Ok(()) uri = /metrics/producers
83922024-12-14T03:40:27.199ZINFOnexus: assigned collector to new producer collector_id = a321e00a-3126-4ea4-b26d-c0e3eea69166 file = nexus/src/app/oximeter.rs:76 producer_id = db02be0a-738a-45e5-a854-a5c5be80bed4
83932024-12-14T03:40:27.199ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 41236 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:54379 req_id = f69b1140-3660-4d91-93d2-4a7a66fb3d66 response_code = 201 uri = /metrics/producers
83942024-12-14T03:40:35.612ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1001 local_addr = [fd00:1122:3344:101::b]:56585 method = GET remote_addr = [fd00:1122:3344:101::d]:58979 req_id = 20d5ce92-43a0-49e3-aca6-1c13f48a776a response_code = 200 uri = /5f2fe413-3c4a-4994-b4a0-995c1da486b1
83952024-12-14T03:40:36.346ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 35 reason = Timeout
83962024-12-14T03:40:36.346ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 35 reason = Timeout
83972024-12-14T03:40:36.347ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
83982024-12-14T03:40:36.347ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
83992024-12-14T03:40:36.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
84002024-12-14T03:40:36.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
84012024-12-14T03:40:36.349ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84022024-12-14T03:40:36.351ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
84032024-12-14T03:40:36.351ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
84042024-12-14T03:40:36.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
84052024-12-14T03:40:36.353ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
84062024-12-14T03:40:36.353ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
84072024-12-14T03:40:36.355ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84082024-12-14T03:40:36.358ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1, lookup_type: ById(eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1) } result = Ok(())
84092024-12-14T03:40:36.358ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
84102024-12-14T03:40:36.358ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
84112024-12-14T03:40:36.369ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1 original_time_created = 2024-12-14 03:34:51.368980 UTC target_id = eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1 time_created = 2024-12-14 03:34:51.368980 UTC
84122024-12-14T03:40:36.369ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.597373ms iteration = 35 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1","time_created":"2024-12-14T03:34:51.368980Z"}
84132024-12-14T03:40:36.376ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
84142024-12-14T03:40:36.376ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
84152024-12-14T03:40:36.404ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 57.89251ms iteration = 35 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
84162024-12-14T03:40:38.714ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:60795
84172024-12-14T03:40:38.714ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:60795 req_id = 65b34ca4-e78b-43bb-b18f-4d35af7f48d1 roles = RoleSet { roles: {} } uri = /metrics/producers
84182024-12-14T03:40:38.715ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:60795 req_id = 65b34ca4-e78b-43bb-b18f-4d35af7f48d1 resource = Database result = Ok(()) uri = /metrics/producers
84192024-12-14T03:40:38.755ZINFOnexus: assigned collector to new producer collector_id = a321e00a-3126-4ea4-b26d-c0e3eea69166 file = nexus/src/app/oximeter.rs:76 producer_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534
84202024-12-14T03:40:38.755ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 40297 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:60795 req_id = 65b34ca4-e78b-43bb-b18f-4d35af7f48d1 response_code = 201 uri = /metrics/producers
84212024-12-14T03:40:41.627ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
84222024-12-14T03:40:41.627ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::b]:12221
84232024-12-14T03:40:41.657ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
84242024-12-14T03:40:41.657ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::b]:45259
84252024-12-14T03:40:41.658ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:45259 req_id = 2eef6ed4-174d-44c5-9e00-93a6d7e1bfb8 roles = RoleSet { roles: {} } uri = /metrics/producers
84262024-12-14T03:40:41.658ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:45259 req_id = 2eef6ed4-174d-44c5-9e00-93a6d7e1bfb8 resource = Database result = Ok(()) uri = /metrics/producers
84272024-12-14T03:40:41.690ZINFOnexus: assigned collector to new producer collector_id = a321e00a-3126-4ea4-b26d-c0e3eea69166 file = nexus/src/app/oximeter.rs:76 producer_id = 5f2fe413-3c4a-4994-b4a0-995c1da486b1
84282024-12-14T03:40:41.690ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 32755 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:45259 req_id = 2eef6ed4-174d-44c5-9e00-93a6d7e1bfb8 response_code = 201 uri = /metrics/producers
84292024-12-14T03:40:41.690ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "2eef6ed4-174d-44c5-9e00-93a6d7e1bfb8", "content-length": "41", "date": "Sat, 14 Dec 2024 03:40:41 GMT"} })
84302024-12-14T03:40:41.691ZDEBGnexus (producer-registration-task): registered with nexus successfully
84312024-12-14T03:40:41.691ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
84322024-12-14T03:40:45.612ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1141 local_addr = [fd00:1122:3344:101::b]:56585 method = GET remote_addr = [fd00:1122:3344:101::d]:58979 req_id = 677005e7-a172-4ed7-a665-b03e74db5393 response_code = 200 uri = /5f2fe413-3c4a-4994-b4a0-995c1da486b1
84332024-12-14T03:40:46.347ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 36 reason = Timeout
84342024-12-14T03:40:46.347ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
84352024-12-14T03:40:46.347ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 36 reason = Timeout
84362024-12-14T03:40:46.347ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
84372024-12-14T03:40:46.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
84382024-12-14T03:40:46.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
84392024-12-14T03:40:46.349ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84402024-12-14T03:40:46.349ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
84412024-12-14T03:40:46.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
84422024-12-14T03:40:46.351ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.47179ms iteration = 36 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
84432024-12-14T03:40:46.352ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
84442024-12-14T03:40:46.352ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
84452024-12-14T03:40:46.352ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
84462024-12-14T03:40:46.354ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
84472024-12-14T03:40:46.354ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
84482024-12-14T03:40:46.355ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84492024-12-14T03:40:46.358ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1, lookup_type: ById(eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1) } result = Ok(())
84502024-12-14T03:40:46.358ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
84512024-12-14T03:40:46.358ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
84522024-12-14T03:40:46.368ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1 original_time_created = 2024-12-14 03:34:51.368980 UTC target_id = eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1 time_created = 2024-12-14 03:34:51.368980 UTC
84532024-12-14T03:40:46.368ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.791016ms iteration = 36 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1","time_created":"2024-12-14T03:34:51.368980Z"}
84542024-12-14T03:40:52.033ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:61819
84552024-12-14T03:40:52.033ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:61819 req_id = 827ca0ec-db05-441c-83d9-bfa267642145 roles = RoleSet { roles: {} } uri = /metrics/producers
84562024-12-14T03:40:52.034ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:61819 req_id = 827ca0ec-db05-441c-83d9-bfa267642145 resource = Database result = Ok(()) uri = /metrics/producers
84572024-12-14T03:40:52.043ZINFOnexus: assigned collector to new producer collector_id = a321e00a-3126-4ea4-b26d-c0e3eea69166 file = nexus/src/app/oximeter.rs:76 producer_id = 232a98a5-5cb7-4d84-a629-b03087fbd5b7
84582024-12-14T03:40:52.043ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9534 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:61819 req_id = 827ca0ec-db05-441c-83d9-bfa267642145 response_code = 201 uri = /metrics/producers
84592024-12-14T03:40:55.613ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1161 local_addr = [fd00:1122:3344:101::b]:56585 method = GET remote_addr = [fd00:1122:3344:101::d]:58979 req_id = ea957eb2-4e31-4acf-a895-1a886c94f1bf response_code = 200 uri = /5f2fe413-3c4a-4994-b4a0-995c1da486b1
84602024-12-14T03:40:56.347ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 14 reason = Timeout
84612024-12-14T03:40:56.347ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 13 reason = Timeout
84622024-12-14T03:40:56.347ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
84632024-12-14T03:40:56.347ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
84642024-12-14T03:40:56.347ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 7 reason = Timeout
84652024-12-14T03:40:56.347ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
84662024-12-14T03:40:56.347ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 13 reason = Timeout
84672024-12-14T03:40:56.347ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 13 reason = Timeout
84682024-12-14T03:40:56.347ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
84692024-12-14T03:40:56.347ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
84702024-12-14T03:40:56.347ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
84712024-12-14T03:40:56.347ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 8 reason = Timeout
84722024-12-14T03:40:56.347ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
84732024-12-14T03:40:56.347ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1
84742024-12-14T03:40:56.347ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 13 reason = Timeout
84752024-12-14T03:40:56.347ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 14.06\u{b5}s iteration = 8 status = {"enabled":false,"target_id":"eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1"}
84762024-12-14T03:40:56.347ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 7 reason = Timeout
84772024-12-14T03:40:56.347ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
84782024-12-14T03:40:56.347ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 8 reason = Timeout
84792024-12-14T03:40:56.347ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
84802024-12-14T03:40:56.347ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
84812024-12-14T03:40:56.347ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 9 reason = Timeout
84822024-12-14T03:40:56.347ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 4 reason = Timeout
84832024-12-14T03:40:56.347ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 37 reason = Timeout
84842024-12-14T03:40:56.347ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 13 reason = Timeout
84852024-12-14T03:40:56.347ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
84862024-12-14T03:40:56.347ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
84872024-12-14T03:40:56.347ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 8 reason = Timeout
84882024-12-14T03:40:56.347ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
84892024-12-14T03:40:56.347ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
84902024-12-14T03:40:56.347ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
84912024-12-14T03:40:56.347ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 7 reason = Timeout
84922024-12-14T03:40:56.347ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
84932024-12-14T03:40:56.347ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 9 reason = Timeout
84942024-12-14T03:40:56.347ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 8 reason = Timeout
84952024-12-14T03:40:56.347ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 13 reason = Timeout
84962024-12-14T03:40:56.347ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
84972024-12-14T03:40:56.347ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 13 reason = Timeout
84982024-12-14T03:40:56.347ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
84992024-12-14T03:40:56.347ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 8 reason = Timeout
85002024-12-14T03:40:56.347ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
85012024-12-14T03:40:56.347ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
85022024-12-14T03:40:56.347ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 37 reason = Timeout
85032024-12-14T03:40:56.347ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
85042024-12-14T03:40:56.348ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 15 reason = Timeout
85052024-12-14T03:40:56.348ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
85062024-12-14T03:40:56.348ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 8 reason = Timeout
85072024-12-14T03:40:56.348ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 13 reason = Timeout
85082024-12-14T03:40:56.348ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
85092024-12-14T03:40:56.348ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 13 reason = Timeout
85102024-12-14T03:40:56.348ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
85112024-12-14T03:40:56.348ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 7 reason = Timeout
85122024-12-14T03:40:56.348ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 7 reason = Timeout
85132024-12-14T03:40:56.348ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 13 reason = Timeout
85142024-12-14T03:40:56.348ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
85152024-12-14T03:40:56.348ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-14 03:30:56.348007840 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
85162024-12-14T03:40:56.348ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
85172024-12-14T03:40:56.348ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
85182024-12-14T03:40:56.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
85192024-12-14T03:40:56.348ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 13 reason = Timeout
85202024-12-14T03:40:56.348ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 13 reason = Timeout
85212024-12-14T03:40:56.348ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 13 reason = Timeout
85222024-12-14T03:40:56.348ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
85232024-12-14T03:40:56.348ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
85242024-12-14T03:40:56.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
85252024-12-14T03:40:56.348ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
85262024-12-14T03:40:56.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
85272024-12-14T03:40:56.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
85282024-12-14T03:40:56.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
85292024-12-14T03:40:56.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
85302024-12-14T03:40:56.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
85312024-12-14T03:40:56.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
85322024-12-14T03:40:56.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
85332024-12-14T03:40:56.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
85342024-12-14T03:40:56.348ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("28f528f1-3159-4fbc-9304-37b7e4a50ae8.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7274e15f-a5f6-4975-bcdd-a2ef890c0230.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("7274e15f-a5f6-4975-bcdd-a2ef890c0230.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1462, tv_nsec: 666454068 } })
85352024-12-14T03:40:56.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
85362024-12-14T03:40:56.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
85372024-12-14T03:40:56.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
85382024-12-14T03:40:56.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
85392024-12-14T03:40:56.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
85402024-12-14T03:40:56.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
85412024-12-14T03:40:56.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
85422024-12-14T03:40:56.348ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
85432024-12-14T03:40:56.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
85442024-12-14T03:40:56.348ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("3db8556d-0ae0-4824-8953-f38d8eef7409.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7b672843-049d-4d9c-b0a2-21d7b6323621.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("db39fe07-65c4-451a-a2bd-78fcdfc10040.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("db39fe07-65c4-451a-a2bd-78fcdfc10040.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1462, tv_nsec: 666678622 } })
85452024-12-14T03:40:56.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
85462024-12-14T03:40:56.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
85472024-12-14T03:40:56.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
85482024-12-14T03:40:56.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
85492024-12-14T03:40:56.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
85502024-12-14T03:40:56.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
85512024-12-14T03:40:56.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
85522024-12-14T03:40:56.348ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
85532024-12-14T03:40:56.348ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.121713ms iteration = 8 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
85542024-12-14T03:40:56.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
85552024-12-14T03:40:56.348ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
85562024-12-14T03:40:56.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
85572024-12-14T03:40:56.349ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
85582024-12-14T03:40:56.349ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
85592024-12-14T03:40:56.349ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.315386ms iteration = 8 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
85602024-12-14T03:40:56.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
85612024-12-14T03:40:56.349ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
85622024-12-14T03:40:56.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
85632024-12-14T03:40:56.350ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85642024-12-14T03:40:56.351ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8d70e61c-94ed-41ce-b36c-cb904f92c534.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8d70e61c-94ed-41ce-b36c-cb904f92c534.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1462, tv_nsec: 669359476 } })
85652024-12-14T03:40:56.351ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.885207ms iteration = 13 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
85662024-12-14T03:40:56.351ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
85672024-12-14T03:40:56.351ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
85682024-12-14T03:40:56.351ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
85692024-12-14T03:40:56.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
85702024-12-14T03:40:56.352ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
85712024-12-14T03:40:56.352ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
85722024-12-14T03:40:56.352ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 4.591722ms iteration = 7 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
85732024-12-14T03:40:56.353ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
85742024-12-14T03:40:56.353ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
85752024-12-14T03:40:56.353ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85762024-12-14T03:40:56.354ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
85772024-12-14T03:40:56.354ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
85782024-12-14T03:40:56.355ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85792024-12-14T03:40:56.355ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8d70e61c-94ed-41ce-b36c-cb904f92c534.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8d70e61c-94ed-41ce-b36c-cb904f92c534.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1462, tv_nsec: 673534060 } })
85802024-12-14T03:40:56.355ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
85812024-12-14T03:40:56.355ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
85822024-12-14T03:40:56.355ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
85832024-12-14T03:40:56.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
85842024-12-14T03:40:56.357ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
85852024-12-14T03:40:56.357ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
85862024-12-14T03:40:56.358ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
85872024-12-14T03:40:56.358ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85882024-12-14T03:40:56.362ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
85892024-12-14T03:40:56.362ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
85902024-12-14T03:40:56.362ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
85912024-12-14T03:40:56.364ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 16.829887ms iteration = 7 status = {"errors":[],"found_port_ok":[]}
85922024-12-14T03:40:56.365ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
85932024-12-14T03:40:56.365ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
85942024-12-14T03:40:56.365ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
85952024-12-14T03:40:56.366ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
85962024-12-14T03:40:56.366ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 18.232585ms iteration = 13 status = {"errors":[],"records_set_to_done":[]}
85972024-12-14T03:40:56.367ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-14 03:30:56.348007840 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
85982024-12-14T03:40:56.367ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 19.46817ms iteration = 7 status = {"expiration":"2024-12-14T03:30:56.348007840Z","pruned":[]}
85992024-12-14T03:40:56.368ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86002024-12-14T03:40:56.368ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86012024-12-14T03:40:56.371ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
86022024-12-14T03:40:56.371ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
86032024-12-14T03:40:56.371ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
86042024-12-14T03:40:56.372ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
86052024-12-14T03:40:56.372ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
86062024-12-14T03:40:56.372ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
86072024-12-14T03:40:56.372ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86082024-12-14T03:40:56.375ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
86092024-12-14T03:40:56.375ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
86102024-12-14T03:40:56.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
86112024-12-14T03:40:56.380ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
86122024-12-14T03:40:56.381ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
86132024-12-14T03:40:56.381ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86142024-12-14T03:40:56.381ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
86152024-12-14T03:40:56.381ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
86162024-12-14T03:40:56.381ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86172024-12-14T03:40:56.385ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86182024-12-14T03:40:56.387ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
86192024-12-14T03:40:56.387ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
86202024-12-14T03:40:56.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
86212024-12-14T03:40:56.389ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86222024-12-14T03:40:56.392ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
86232024-12-14T03:40:56.395ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86242024-12-14T03:40:56.395ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
86252024-12-14T03:40:56.395ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
86262024-12-14T03:40:56.395ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
86272024-12-14T03:40:56.395ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
86282024-12-14T03:40:56.398ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
86292024-12-14T03:40:56.398ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
86302024-12-14T03:40:56.398ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86312024-12-14T03:40:56.398ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
86322024-12-14T03:40:56.399ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
86332024-12-14T03:40:56.399ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
86342024-12-14T03:40:56.399ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 51.88796ms iteration = 13 status = {"errors":[],"garbage_collect_requested":[]}
86352024-12-14T03:40:56.401ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
86362024-12-14T03:40:56.401ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
86372024-12-14T03:40:56.401ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
86382024-12-14T03:40:56.403ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86392024-12-14T03:40:56.404ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
86402024-12-14T03:40:56.405ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
86412024-12-14T03:40:56.405ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86422024-12-14T03:40:56.407ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
86432024-12-14T03:40:56.407ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
86442024-12-14T03:40:56.407ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
86452024-12-14T03:40:56.407ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
86462024-12-14T03:40:56.408ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86472024-12-14T03:40:56.411ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
86482024-12-14T03:40:56.411ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
86492024-12-14T03:40:56.411ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
86502024-12-14T03:40:56.411ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
86512024-12-14T03:40:56.411ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
86522024-12-14T03:40:56.411ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
86532024-12-14T03:40:56.411ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
86542024-12-14T03:40:56.414ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
86552024-12-14T03:40:56.414ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86562024-12-14T03:40:56.416ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86572024-12-14T03:40:56.417ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86582024-12-14T03:40:56.417ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
86592024-12-14T03:40:56.417ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1, lookup_type: ById(eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1) } result = Ok(())
86602024-12-14T03:40:56.417ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86612024-12-14T03:40:56.417ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 70.330719ms iteration = 13 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
86622024-12-14T03:40:56.418ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
86632024-12-14T03:40:56.418ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86642024-12-14T03:40:56.419ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
86652024-12-14T03:40:56.419ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
86662024-12-14T03:40:56.419ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
86672024-12-14T03:40:56.420ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
86682024-12-14T03:40:56.420ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
86692024-12-14T03:40:56.420ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
86702024-12-14T03:40:56.422ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86712024-12-14T03:40:56.423ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8d70e61c-94ed-41ce-b36c-cb904f92c534.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8d70e61c-94ed-41ce-b36c-cb904f92c534.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1462, tv_nsec: 741409730 } })
86722024-12-14T03:40:56.423ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 75.947932ms iteration = 4 status = {"nsuccess":5}
86732024-12-14T03:40:56.423ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200
86742024-12-14T03:40:56.424ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
86752024-12-14T03:40:56.424ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
86762024-12-14T03:40:56.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
86772024-12-14T03:40:56.428ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 80.287278ms iteration = 37 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
86782024-12-14T03:40:56.431ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
86792024-12-14T03:40:56.432ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
86802024-12-14T03:40:56.433ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1 original_time_created = 2024-12-14 03:34:51.368980 UTC target_id = eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1 time_created = 2024-12-14 03:34:51.368980 UTC
86812024-12-14T03:40:56.433ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 85.556803ms iteration = 37 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1","time_created":"2024-12-14T03:34:51.368980Z"}
86822024-12-14T03:40:56.434ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
86832024-12-14T03:40:56.434ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
86842024-12-14T03:40:56.435ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
86852024-12-14T03:40:56.435ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86862024-12-14T03:40:56.436ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
86872024-12-14T03:40:56.436ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86882024-12-14T03:40:56.437ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
86892024-12-14T03:40:56.437ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
86902024-12-14T03:40:56.437ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
86912024-12-14T03:40:56.437ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
86922024-12-14T03:40:56.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
86932024-12-14T03:40:56.439ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 8d70e61c-94ed-41ce-b36c-cb904f92c534, lookup_type: ById(8d70e61c-94ed-41ce-b36c-cb904f92c534) } result = Ok(())
86942024-12-14T03:40:56.439ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
86952024-12-14T03:40:56.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
86962024-12-14T03:40:56.440ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
86972024-12-14T03:40:56.440ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
86982024-12-14T03:40:56.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
86992024-12-14T03:40:56.443ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87002024-12-14T03:40:56.444ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 96.549484ms iteration = 13 status = 0
87012024-12-14T03:40:56.446ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
87022024-12-14T03:40:56.446ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
87032024-12-14T03:40:56.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
87042024-12-14T03:40:56.446ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
87052024-12-14T03:40:56.446ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 98.817479ms iteration = 13 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
87062024-12-14T03:40:56.447ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
87072024-12-14T03:40:56.447ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
87082024-12-14T03:40:56.447ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 100.34607ms iteration = 7 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
87092024-12-14T03:40:56.449ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 102.046454ms iteration = 13 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
87102024-12-14T03:40:56.450ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
87112024-12-14T03:40:56.450ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
87122024-12-14T03:40:56.450ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
87132024-12-14T03:40:56.451ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
87142024-12-14T03:40:56.452ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
87152024-12-14T03:40:56.452ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
87162024-12-14T03:40:56.460ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87172024-12-14T03:40:56.465ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
87182024-12-14T03:40:56.465ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
87192024-12-14T03:40:56.465ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
87202024-12-14T03:40:56.467ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
87212024-12-14T03:40:56.480ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
87222024-12-14T03:40:56.484ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
87232024-12-14T03:40:56.484ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
87242024-12-14T03:40:56.484ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = c7a5bbe9-1af5-4e36-80b5-da9e0053b676 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
87252024-12-14T03:40:56.484ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
87262024-12-14T03:40:56.484ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
87272024-12-14T03:40:56.485ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
87282024-12-14T03:40:56.487ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87292024-12-14T03:40:56.490ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
87302024-12-14T03:40:56.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
87312024-12-14T03:40:56.491ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
87322024-12-14T03:40:56.491ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
87332024-12-14T03:40:56.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
87342024-12-14T03:40:56.492ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 144.188918ms iteration = 13 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
87352024-12-14T03:40:56.492ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87362024-12-14T03:40:56.492ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
87372024-12-14T03:40:56.492ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
87382024-12-14T03:40:56.492ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 145.062056ms iteration = 13 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
87392024-12-14T03:40:56.494ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
87402024-12-14T03:40:56.494ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
87412024-12-14T03:40:56.494ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
87422024-12-14T03:40:56.498ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = c7a5bbe9-1af5-4e36-80b5-da9e0053b676 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
87432024-12-14T03:40:56.498ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
87442024-12-14T03:40:56.498ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-14 03:35:40.104814 UTC dns_group = internal generation = 1
87452024-12-14T03:40:56.498ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 150.494085ms iteration = 8 status = {"generation":1}
87462024-12-14T03:40:56.503ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
87472024-12-14T03:40:56.503ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
87482024-12-14T03:40:56.503ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e203975d-527c-43cb-95b0-b5a7ff635622", "content-length": "26", "date": "Sat, 14 Dec 2024 03:40:56 GMT"} })
87492024-12-14T03:40:56.503ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
87502024-12-14T03:40:56.505ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
87512024-12-14T03:40:56.505ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
87522024-12-14T03:40:56.505ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 51f6df17-b3b5-47fe-9a42-d8752f961c5e dns_zone_name = oxide.test found_so_far = 0 version = 2
87532024-12-14T03:40:56.505ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
87542024-12-14T03:40:56.506ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
87552024-12-14T03:40:56.507ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87562024-12-14T03:40:56.510ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
87572024-12-14T03:40:56.510ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
87582024-12-14T03:40:56.510ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
87592024-12-14T03:40:56.512ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 51f6df17-b3b5-47fe-9a42-d8752f961c5e dns_zone_name = oxide.test found_so_far = 1 version = 2
87602024-12-14T03:40:56.512ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
87612024-12-14T03:40:56.512ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-14 03:35:40.905586 UTC dns_group = external generation = 2
87622024-12-14T03:40:56.512ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 164.839213ms iteration = 8 status = {"generation":2}
87632024-12-14T03:40:56.529ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 181.406994ms iteration = 15 status = {"physical_disks_added":0}
87642024-12-14T03:40:56.541ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-14T03:34:54.541856Z, time_modified: 2024-12-14T03:34:54.541856Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, db_silo: Silo { identity: SiloIdentity { id: 578bc52c-ac81-41a6-a56b-dfc79805368e, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-14T03:35:40.848931Z, time_modified: 2024-12-14T03:35:40.848931Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "4dfc5e49ed154568e7a05c630983c79e7ad097d55e90f834bee8ffda0c5a5c9e" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, db_silo: Silo { identity: SiloIdentity { id: 578bc52c-ac81-41a6-a56b-dfc79805368e, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-14T03:35:40.848931Z, time_modified: 2024-12-14T03:35:40.848931Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "4dfc5e49ed154568e7a05c630983c79e7ad097d55e90f834bee8ffda0c5a5c9e" }] }) }
87652024-12-14T03:40:56.541ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 193.916745ms iteration = 8 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"578bc52c-ac81-41a6-a56b-dfc79805368e","tls_certs":["4dfc5e49ed154568e7a05c630983c79e7ad097d55e90f834bee8ffda0c5a5c9e"]}},"default_endpoint":{"silo_id":"578bc52c-ac81-41a6-a56b-dfc79805368e","tls_certs":["4dfc5e49ed154568e7a05c630983c79e7ad097d55e90f834bee8ffda0c5a5c9e"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
87662024-12-14T03:40:56.542ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
87672024-12-14T03:40:56.542ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 194.708821ms iteration = 7 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
87682024-12-14T03:40:56.564ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
87692024-12-14T03:40:56.564ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
87702024-12-14T03:40:56.564ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2c7f8874-0dea-4eb4-9352-6ef06c5bb650", "content-length": "26", "date": "Sat, 14 Dec 2024 03:40:56 GMT"} })
87712024-12-14T03:40:56.564ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
87722024-12-14T03:40:56.566ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
87732024-12-14T03:40:56.584ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
87742024-12-14T03:40:56.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
87752024-12-14T03:40:56.586ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87762024-12-14T03:40:56.588ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
87772024-12-14T03:40:56.588ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
87782024-12-14T03:40:56.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
87792024-12-14T03:40:56.589ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87802024-12-14T03:40:56.591ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
87812024-12-14T03:40:56.591ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
87822024-12-14T03:40:56.591ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
87832024-12-14T03:40:56.674ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 zone_address = fd00:1122:3344:101::2
87842024-12-14T03:40:56.674ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
87852024-12-14T03:40:56.675ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "802716b8-7895-4f4b-a42d-306cc2fe560c", "content-length": "26", "date": "Sat, 14 Dec 2024 03:40:56 GMT"} })
87862024-12-14T03:40:56.675ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
87872024-12-14T03:40:56.676ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200
87882024-12-14T03:40:56.678ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 330.40891ms iteration = 13 status = {}
87892024-12-14T03:40:56.689ZINFOnexus (BackgroundTasks): VPC route manager sled 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
87902024-12-14T03:40:56.689ZDEBGnexus (BackgroundTasks): client request SledAgent = 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
87912024-12-14T03:40:56.689ZDEBGnexus (BackgroundTasks): client response SledAgent = 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "101abaf4-1b47-4588-83e5-58c5ce0447fc", "content-length": "372", "date": "Sat, 14 Dec 2024 03:40:56 GMT"} })
87922024-12-14T03:40:56.689ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
87932024-12-14T03:40:56.690ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
87942024-12-14T03:40:56.703ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
87952024-12-14T03:40:56.704ZDEBGnexus (BackgroundTasks): client request SledAgent = 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
87962024-12-14T03:40:56.704ZDEBGnexus (BackgroundTasks): client response SledAgent = 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "28823f93-1826-4f65-8cbb-790761a4c03f", "date": "Sat, 14 Dec 2024 03:40:56 GMT"} })
87972024-12-14T03:40:56.704ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
87982024-12-14T03:40:56.704ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
87992024-12-14T03:40:56.706ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
88002024-12-14T03:40:56.707ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
88012024-12-14T03:40:56.711ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
88022024-12-14T03:40:56.711ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "42dc845b-2a03-4071-92d0-a8236d1dfe1f", "date": "Sat, 14 Dec 2024 03:40:56 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
88032024-12-14T03:40:56.711ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
88042024-12-14T03:40:56.713ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "b1034d9d-3771-4a34-a04b-8768e4e8bf54", "date": "Sat, 14 Dec 2024 03:40:56 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
88052024-12-14T03:40:56.713ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
88062024-12-14T03:40:56.715ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
88072024-12-14T03:40:56.715ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 367.895991ms iteration = 9 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
88082024-12-14T03:40:56.718ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
88092024-12-14T03:40:56.794ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
88102024-12-14T03:40:56.794ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "0aebbd33-bd8d-4d4c-9910-290633f07473", "content-length": "1", "date": "Sat, 14 Dec 2024 03:40:55 GMT"} })
88112024-12-14T03:40:56.796ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
88122024-12-14T03:40:56.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
88132024-12-14T03:40:56.873ZDEBGnexus (BackgroundTasks): client request SledAgent = 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
88142024-12-14T03:40:56.873ZDEBGnexus (BackgroundTasks): client response SledAgent = 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "017220bd-7cf0-4444-875a-85db5be7ad51", "content-length": "691", "date": "Sat, 14 Dec 2024 03:40:56 GMT"} })
88152024-12-14T03:40:56.873ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
88162024-12-14T03:40:56.873ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
88172024-12-14T03:40:56.873ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
88182024-12-14T03:40:56.874ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 526.743403ms iteration = 13 status = {}
88192024-12-14T03:40:56.875ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 527.816565ms iteration = 13 status = null
88202024-12-14T03:40:56.875ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
88212024-12-14T03:40:56.876ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
88222024-12-14T03:40:56.879ZINFOnexus (BackgroundTasks): VPC route manager sled 8d70e61c-94ed-41ce-b36c-cb904f92c534 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
88232024-12-14T03:40:56.879ZDEBGnexus (BackgroundTasks): client request SledAgent = 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
88242024-12-14T03:40:56.879ZDEBGnexus (BackgroundTasks): client response SledAgent = 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "b2b34ed2-4706-4261-8aea-efbb7a85598e", "date": "Sat, 14 Dec 2024 03:40:56 GMT"} })
88252024-12-14T03:40:56.881ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 533.703523ms iteration = 14 status = {}
88262024-12-14T03:40:56.893ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
88272024-12-14T03:40:56.893ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "08d5728c-3061-487f-ab36-ec0f72acf0d8", "date": "Sat, 14 Dec 2024 03:40:56 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
88282024-12-14T03:40:56.893ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
88292024-12-14T03:40:56.896ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "b2761957-0ed6-49b8-b498-364715da120f", "date": "Sat, 14 Dec 2024 03:40:56 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
88302024-12-14T03:40:56.896ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
88312024-12-14T03:40:56.898ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "d27000c4-2e89-40c5-8902-15951f1530c5", "date": "Sat, 14 Dec 2024 03:40:56 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
88322024-12-14T03:40:56.898ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
88332024-12-14T03:40:56.900ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
88342024-12-14T03:40:56.900ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 552.358367ms iteration = 9 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
88352024-12-14T03:40:56.929ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
88362024-12-14T03:40:56.929ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
88372024-12-14T03:40:56.931ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 45ca990e-42e9-4264-be3e-0adfed2cd99b, rack_id: a121ca05-bbee-41bf-b9db-9e03ff035200, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(811a570a-bdaf-4a1b-8eba-0c0e4977f7bb) } rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 switch_location = Switch0
88382024-12-14T03:40:56.931ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
88392024-12-14T03:40:56.931ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
88402024-12-14T03:40:56.940ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
88412024-12-14T03:40:56.940ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "21f37a7e-7b01-4edb-ac78-4b737dacaa93", "content-length": "134", "date": "Sat, 14 Dec 2024 03:40:56 GMT"} })
88422024-12-14T03:40:56.940ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
88432024-12-14T03:40:56.940ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 811a570a-bdaf-4a1b-8eba-0c0e4977f7bb
88442024-12-14T03:40:56.940ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
88452024-12-14T03:40:56.940ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
88462024-12-14T03:40:56.940ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
88472024-12-14T03:40:56.940ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
88482024-12-14T03:40:56.940ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
88492024-12-14T03:40:56.940ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
88502024-12-14T03:40:56.940ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
88512024-12-14T03:40:56.940ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
88522024-12-14T03:40:56.940ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200
88532024-12-14T03:40:56.940ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
88542024-12-14T03:40:56.941ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
88552024-12-14T03:40:56.943ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
88562024-12-14T03:40:56.943ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "1d7e0f38-6736-45a9-9a94-b0a420c63be5", "content-length": "2", "date": "Sat, 14 Dec 2024 03:40:56 GMT"} })
88572024-12-14T03:40:56.943ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
88582024-12-14T03:40:56.943ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "089244bd-0c63-48dd-a2cb-fd7dd462d6d0", "content-length": "52", "date": "Sat, 14 Dec 2024 03:40:56 GMT"} })
88592024-12-14T03:40:56.943ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 switch_location = Switch0
88602024-12-14T03:40:56.943ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
88612024-12-14T03:40:57.039ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "814d1dad-9a1c-4fbe-a60b-5d3430e8b897", "date": "Sat, 14 Dec 2024 03:40:56 GMT"} })
88622024-12-14T03:40:57.039ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 switch = Switch0
88632024-12-14T03:40:57.039ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
88642024-12-14T03:40:57.039ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "ae0f9c5c-ab96-4753-b2f2-510c22edf81b", "content-length": "682", "date": "Sat, 14 Dec 2024 03:40:56 GMT"} })
88652024-12-14T03:40:57.039ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
88662024-12-14T03:40:57.039ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
88672024-12-14T03:40:57.043ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
88682024-12-14T03:40:57.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
88692024-12-14T03:40:57.046ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
88702024-12-14T03:40:57.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
88712024-12-14T03:40:57.049ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
88722024-12-14T03:40:57.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
88732024-12-14T03:40:57.056ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 708.848981ms iteration = 13 status = {}
88742024-12-14T03:41:05.613ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1201 local_addr = [fd00:1122:3344:101::b]:56585 method = GET remote_addr = [fd00:1122:3344:101::d]:58979 req_id = e750137c-49dc-4d3f-8bfe-6a144d5a6ada response_code = 200 uri = /5f2fe413-3c4a-4994-b4a0-995c1da486b1
88752024-12-14T03:41:06.347ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 38 reason = Timeout
88762024-12-14T03:41:06.347ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
88772024-12-14T03:41:06.347ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 38 reason = Timeout
88782024-12-14T03:41:06.347ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
88792024-12-14T03:41:06.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
88802024-12-14T03:41:06.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
88812024-12-14T03:41:06.350ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
88822024-12-14T03:41:06.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
88832024-12-14T03:41:06.350ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88842024-12-14T03:41:06.351ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.409188ms iteration = 38 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
88852024-12-14T03:41:06.353ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
88862024-12-14T03:41:06.353ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
88872024-12-14T03:41:06.353ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
88882024-12-14T03:41:06.358ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
88892024-12-14T03:41:06.358ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
88902024-12-14T03:41:06.360ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88912024-12-14T03:41:06.362ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1, lookup_type: ById(eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1) } result = Ok(())
88922024-12-14T03:41:06.362ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
88932024-12-14T03:41:06.362ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
88942024-12-14T03:41:06.375ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1 original_time_created = 2024-12-14 03:34:51.368980 UTC target_id = eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1 time_created = 2024-12-14 03:34:51.368980 UTC
88952024-12-14T03:41:06.375ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 27.792857ms iteration = 38 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1","time_created":"2024-12-14T03:34:51.368980Z"}
88962024-12-14T03:41:14.834ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:52898
88972024-12-14T03:41:14.834ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:52898 req_id = 692d6f4c-4707-4365-b5ab-a65b868257fa roles = RoleSet { roles: {} } uri = /metrics/producers
88982024-12-14T03:41:14.835ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:52898 req_id = 692d6f4c-4707-4365-b5ab-a65b868257fa resource = Database result = Ok(()) uri = /metrics/producers
88992024-12-14T03:41:14.849ZINFOnexus: assigned collector to new producer collector_id = a321e00a-3126-4ea4-b26d-c0e3eea69166 file = nexus/src/app/oximeter.rs:76 producer_id = b4254c81-0366-4d7b-a36b-86b73748c2f7
89002024-12-14T03:41:14.849ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 14805 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:52898 req_id = 692d6f4c-4707-4365-b5ab-a65b868257fa response_code = 201 uri = /metrics/producers
89012024-12-14T03:41:15.612ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1007 local_addr = [fd00:1122:3344:101::b]:56585 method = GET remote_addr = [fd00:1122:3344:101::d]:58979 req_id = dd6eccde-a2cf-4a45-bf02-e6fd26e51c7f response_code = 200 uri = /5f2fe413-3c4a-4994-b4a0-995c1da486b1
89022024-12-14T03:41:16.347ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 39 reason = Timeout
89032024-12-14T03:41:16.347ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
89042024-12-14T03:41:16.347ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 39 reason = Timeout
89052024-12-14T03:41:16.347ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
89062024-12-14T03:41:16.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
89072024-12-14T03:41:16.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
89082024-12-14T03:41:16.350ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89092024-12-14T03:41:16.351ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
89102024-12-14T03:41:16.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
89112024-12-14T03:41:16.352ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
89122024-12-14T03:41:16.352ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
89132024-12-14T03:41:16.352ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
89142024-12-14T03:41:16.352ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 5.51724ms iteration = 39 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
89152024-12-14T03:41:16.354ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
89162024-12-14T03:41:16.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
89172024-12-14T03:41:16.356ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89182024-12-14T03:41:16.358ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1, lookup_type: ById(eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1) } result = Ok(())
89192024-12-14T03:41:16.358ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
89202024-12-14T03:41:16.358ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
89212024-12-14T03:41:16.369ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1 original_time_created = 2024-12-14 03:34:51.368980 UTC target_id = eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1 time_created = 2024-12-14 03:34:51.368980 UTC
89222024-12-14T03:41:16.369ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.273827ms iteration = 39 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1","time_created":"2024-12-14T03:34:51.368980Z"}
89232024-12-14T03:41:25.613ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1051 local_addr = [fd00:1122:3344:101::b]:56585 method = GET remote_addr = [fd00:1122:3344:101::d]:58979 req_id = f1ea7d5a-b237-452b-b479-dcb6308225b3 response_code = 200 uri = /5f2fe413-3c4a-4994-b4a0-995c1da486b1
89242024-12-14T03:41:26.347ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 15 reason = Timeout
89252024-12-14T03:41:26.347ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
89262024-12-14T03:41:26.347ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 14 reason = Timeout
89272024-12-14T03:41:26.347ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
89282024-12-14T03:41:26.347ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 14 reason = Timeout
89292024-12-14T03:41:26.347ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
89302024-12-14T03:41:26.347ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 40 reason = Timeout
89312024-12-14T03:41:26.347ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 14 reason = Timeout
89322024-12-14T03:41:26.347ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
89332024-12-14T03:41:26.347ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
89342024-12-14T03:41:26.347ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
89352024-12-14T03:41:26.347ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 14 reason = Timeout
89362024-12-14T03:41:26.347ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 14 reason = Timeout
89372024-12-14T03:41:26.347ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
89382024-12-14T03:41:26.347ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
89392024-12-14T03:41:26.347ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 40 reason = Timeout
89402024-12-14T03:41:26.347ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
89412024-12-14T03:41:26.347ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 14 reason = Timeout
89422024-12-14T03:41:26.347ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
89432024-12-14T03:41:26.347ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 16 reason = Timeout
89442024-12-14T03:41:26.347ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 14 reason = Timeout
89452024-12-14T03:41:26.347ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
89462024-12-14T03:41:26.347ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
89472024-12-14T03:41:26.347ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 14 reason = Timeout
89482024-12-14T03:41:26.347ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 14 reason = Timeout
89492024-12-14T03:41:26.347ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
89502024-12-14T03:41:26.347ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
89512024-12-14T03:41:26.347ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 14 reason = Timeout
89522024-12-14T03:41:26.347ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
89532024-12-14T03:41:26.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
89542024-12-14T03:41:26.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
89552024-12-14T03:41:26.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
89562024-12-14T03:41:26.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
89572024-12-14T03:41:26.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
89582024-12-14T03:41:26.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
89592024-12-14T03:41:26.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
89602024-12-14T03:41:26.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
89612024-12-14T03:41:26.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
89622024-12-14T03:41:26.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
89632024-12-14T03:41:26.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
89642024-12-14T03:41:26.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
89652024-12-14T03:41:26.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
89662024-12-14T03:41:26.348ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 14 reason = Timeout
89672024-12-14T03:41:26.348ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 14 reason = Timeout
89682024-12-14T03:41:26.348ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
89692024-12-14T03:41:26.348ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
89702024-12-14T03:41:26.348ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 14 reason = Timeout
89712024-12-14T03:41:26.348ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
89722024-12-14T03:41:26.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
89732024-12-14T03:41:26.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
89742024-12-14T03:41:26.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
89752024-12-14T03:41:26.349ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89762024-12-14T03:41:26.351ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8d70e61c-94ed-41ce-b36c-cb904f92c534.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8d70e61c-94ed-41ce-b36c-cb904f92c534.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1492, tv_nsec: 668839273 } })
89772024-12-14T03:41:26.351ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
89782024-12-14T03:41:26.351ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
89792024-12-14T03:41:26.351ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
89802024-12-14T03:41:26.351ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
89812024-12-14T03:41:26.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
89822024-12-14T03:41:26.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
89832024-12-14T03:41:26.351ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.541111ms iteration = 14 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
89842024-12-14T03:41:26.352ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89852024-12-14T03:41:26.353ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89862024-12-14T03:41:26.354ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89872024-12-14T03:41:26.354ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8d70e61c-94ed-41ce-b36c-cb904f92c534.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8d70e61c-94ed-41ce-b36c-cb904f92c534.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1492, tv_nsec: 672037868 } })
89882024-12-14T03:41:26.354ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
89892024-12-14T03:41:26.355ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
89902024-12-14T03:41:26.355ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
89912024-12-14T03:41:26.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
89922024-12-14T03:41:26.356ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
89932024-12-14T03:41:26.356ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
89942024-12-14T03:41:26.356ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89952024-12-14T03:41:26.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
89962024-12-14T03:41:26.356ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
89972024-12-14T03:41:26.356ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
89982024-12-14T03:41:26.357ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
89992024-12-14T03:41:26.358ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90002024-12-14T03:41:26.358ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 10.232745ms iteration = 14 status = {"errors":[],"garbage_collect_requested":[]}
90012024-12-14T03:41:26.358ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
90022024-12-14T03:41:26.358ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
90032024-12-14T03:41:26.359ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
90042024-12-14T03:41:26.360ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
90052024-12-14T03:41:26.360ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
90062024-12-14T03:41:26.360ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
90072024-12-14T03:41:26.362ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90082024-12-14T03:41:26.363ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
90092024-12-14T03:41:26.363ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
90102024-12-14T03:41:26.364ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
90112024-12-14T03:41:26.364ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
90122024-12-14T03:41:26.364ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
90132024-12-14T03:41:26.365ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
90142024-12-14T03:41:26.365ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
90152024-12-14T03:41:26.365ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8d70e61c-94ed-41ce-b36c-cb904f92c534.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8d70e61c-94ed-41ce-b36c-cb904f92c534.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1492, tv_nsec: 683474397 } })
90162024-12-14T03:41:26.366ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200
90172024-12-14T03:41:26.366ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
90182024-12-14T03:41:26.366ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
90192024-12-14T03:41:26.370ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90202024-12-14T03:41:26.372ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
90212024-12-14T03:41:26.372ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
90222024-12-14T03:41:26.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
90232024-12-14T03:41:26.383ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
90242024-12-14T03:41:26.384ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
90252024-12-14T03:41:26.392ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 45.123564ms iteration = 40 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
90262024-12-14T03:41:26.392ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
90272024-12-14T03:41:26.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
90282024-12-14T03:41:26.394ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
90292024-12-14T03:41:26.394ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
90302024-12-14T03:41:26.394ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
90312024-12-14T03:41:26.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
90322024-12-14T03:41:26.395ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 47.202265ms iteration = 14 status = {"errors":[],"records_set_to_done":[]}
90332024-12-14T03:41:26.396ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
90342024-12-14T03:41:26.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
90352024-12-14T03:41:26.396ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
90362024-12-14T03:41:26.397ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
90372024-12-14T03:41:26.398ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 51.260577ms iteration = 14 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
90382024-12-14T03:41:26.399ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90392024-12-14T03:41:26.401ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 8d70e61c-94ed-41ce-b36c-cb904f92c534, lookup_type: ById(8d70e61c-94ed-41ce-b36c-cb904f92c534) } result = Ok(())
90402024-12-14T03:41:26.401ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
90412024-12-14T03:41:26.401ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
90422024-12-14T03:41:26.401ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90432024-12-14T03:41:26.402ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
90442024-12-14T03:41:26.403ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
90452024-12-14T03:41:26.404ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 56.677875ms iteration = 14 status = 0
90462024-12-14T03:41:26.406ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1, lookup_type: ById(eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1) } result = Ok(())
90472024-12-14T03:41:26.406ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
90482024-12-14T03:41:26.406ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
90492024-12-14T03:41:26.407ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
90502024-12-14T03:41:26.407ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
90512024-12-14T03:41:26.410ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
90522024-12-14T03:41:26.410ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 63.559203ms iteration = 14 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
90532024-12-14T03:41:26.422ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1 original_time_created = 2024-12-14 03:34:51.368980 UTC target_id = eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1 time_created = 2024-12-14 03:34:51.368980 UTC
90542024-12-14T03:41:26.422ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 74.836919ms iteration = 40 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1","time_created":"2024-12-14T03:34:51.368980Z"}
90552024-12-14T03:41:26.425ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 78.453491ms iteration = 14 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
90562024-12-14T03:41:26.430ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
90572024-12-14T03:41:26.430ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
90582024-12-14T03:41:26.430ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
90592024-12-14T03:41:26.430ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
90602024-12-14T03:41:26.430ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
90612024-12-14T03:41:26.430ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
90622024-12-14T03:41:26.430ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1b1a3053-4ee0-40d5-9d1b-ac4885c9c319", "content-length": "26", "date": "Sat, 14 Dec 2024 03:41:26 GMT"} })
90632024-12-14T03:41:26.430ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
90642024-12-14T03:41:26.432ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
90652024-12-14T03:41:26.434ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
90662024-12-14T03:41:26.434ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
90672024-12-14T03:41:26.436ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 88.233037ms iteration = 14 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
90682024-12-14T03:41:26.438ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 zone_address = fd00:1122:3344:101::2
90692024-12-14T03:41:26.438ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
90702024-12-14T03:41:26.439ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1e2fea8e-86ac-4403-acf1-2bf896e21e9c", "content-length": "26", "date": "Sat, 14 Dec 2024 03:41:26 GMT"} })
90712024-12-14T03:41:26.439ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
90722024-12-14T03:41:26.441ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200
90732024-12-14T03:41:26.441ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
90742024-12-14T03:41:26.441ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
90752024-12-14T03:41:26.442ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "412db27c-51d4-434f-acb1-2b986483b318", "content-length": "26", "date": "Sat, 14 Dec 2024 03:41:26 GMT"} })
90762024-12-14T03:41:26.442ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
90772024-12-14T03:41:26.443ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
90782024-12-14T03:41:26.447ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
90792024-12-14T03:41:26.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
90802024-12-14T03:41:26.449ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90812024-12-14T03:41:26.452ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
90822024-12-14T03:41:26.452ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
90832024-12-14T03:41:26.452ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
90842024-12-14T03:41:26.453ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90852024-12-14T03:41:26.455ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
90862024-12-14T03:41:26.455ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
90872024-12-14T03:41:26.455ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
90882024-12-14T03:41:26.461ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
90892024-12-14T03:41:26.461ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
90902024-12-14T03:41:26.461ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 114.752728ms iteration = 14 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
90912024-12-14T03:41:26.470ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 123.31915ms iteration = 16 status = {"physical_disks_added":0}
90922024-12-14T03:41:26.523ZINFOnexus (BackgroundTasks): VPC route manager sled 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
90932024-12-14T03:41:26.523ZDEBGnexus (BackgroundTasks): client request SledAgent = 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
90942024-12-14T03:41:26.524ZDEBGnexus (BackgroundTasks): client response SledAgent = 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "e3a18bfd-444a-43c9-9fb0-1b7998667612", "content-length": "372", "date": "Sat, 14 Dec 2024 03:41:26 GMT"} })
90952024-12-14T03:41:26.524ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
90962024-12-14T03:41:26.524ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
90972024-12-14T03:41:26.525ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
90982024-12-14T03:41:26.525ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "703a198f-2679-444b-b455-c0f96e3634cb", "content-length": "1", "date": "Sat, 14 Dec 2024 03:41:26 GMT"} })
90992024-12-14T03:41:26.526ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
91002024-12-14T03:41:26.526ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
91012024-12-14T03:41:26.528ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 181.603888ms iteration = 14 status = null
91022024-12-14T03:41:26.537ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 190.044716ms iteration = 14 status = {}
91032024-12-14T03:41:26.542ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
91042024-12-14T03:41:26.542ZDEBGnexus (BackgroundTasks): client request SledAgent = 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
91052024-12-14T03:41:26.542ZDEBGnexus (BackgroundTasks): client response SledAgent = 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "c6e18e15-65d4-4fe0-87c0-d32418a213c5", "date": "Sat, 14 Dec 2024 03:41:26 GMT"} })
91062024-12-14T03:41:26.542ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
91072024-12-14T03:41:26.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
91082024-12-14T03:41:26.546ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
91092024-12-14T03:41:26.547ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
91102024-12-14T03:41:26.550ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
91112024-12-14T03:41:26.550ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
91122024-12-14T03:41:26.579ZDEBGnexus (BackgroundTasks): client request SledAgent = 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
91132024-12-14T03:41:26.579ZDEBGnexus (BackgroundTasks): client response SledAgent = 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "70e44127-2071-4f74-b920-7829fbeb9f4f", "content-length": "691", "date": "Sat, 14 Dec 2024 03:41:26 GMT"} })
91142024-12-14T03:41:26.580ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
91152024-12-14T03:41:26.580ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
91162024-12-14T03:41:26.580ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
91172024-12-14T03:41:26.581ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 233.720812ms iteration = 14 status = {}
91182024-12-14T03:41:26.582ZINFOnexus (BackgroundTasks): VPC route manager sled 8d70e61c-94ed-41ce-b36c-cb904f92c534 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
91192024-12-14T03:41:26.582ZDEBGnexus (BackgroundTasks): client request SledAgent = 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
91202024-12-14T03:41:26.583ZDEBGnexus (BackgroundTasks): client response SledAgent = 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "906ea63c-d540-4487-953e-0e80128888b1", "date": "Sat, 14 Dec 2024 03:41:26 GMT"} })
91212024-12-14T03:41:26.584ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 237.372735ms iteration = 15 status = {}
91222024-12-14T03:41:26.618ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
91232024-12-14T03:41:26.618ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
91242024-12-14T03:41:26.620ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 45ca990e-42e9-4264-be3e-0adfed2cd99b, rack_id: a121ca05-bbee-41bf-b9db-9e03ff035200, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(811a570a-bdaf-4a1b-8eba-0c0e4977f7bb) } rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 switch_location = Switch0
91252024-12-14T03:41:26.620ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
91262024-12-14T03:41:26.620ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
91272024-12-14T03:41:26.627ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
91282024-12-14T03:41:26.627ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "0e892a93-2562-421a-8c45-4c6040743dd7", "content-length": "134", "date": "Sat, 14 Dec 2024 03:41:26 GMT"} })
91292024-12-14T03:41:26.627ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
91302024-12-14T03:41:26.627ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 811a570a-bdaf-4a1b-8eba-0c0e4977f7bb
91312024-12-14T03:41:26.627ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
91322024-12-14T03:41:26.627ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
91332024-12-14T03:41:26.627ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
91342024-12-14T03:41:26.627ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
91352024-12-14T03:41:26.627ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
91362024-12-14T03:41:26.627ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
91372024-12-14T03:41:26.628ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
91382024-12-14T03:41:26.628ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
91392024-12-14T03:41:26.628ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200
91402024-12-14T03:41:26.628ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
91412024-12-14T03:41:26.628ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
91422024-12-14T03:41:26.630ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
91432024-12-14T03:41:26.630ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "8f556b89-88e5-4343-8976-230cf7c65100", "content-length": "2", "date": "Sat, 14 Dec 2024 03:41:26 GMT"} })
91442024-12-14T03:41:26.630ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
91452024-12-14T03:41:26.630ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "7554d2f5-ee85-4ff7-8c7a-604ced884236", "content-length": "52", "date": "Sat, 14 Dec 2024 03:41:26 GMT"} })
91462024-12-14T03:41:26.630ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 switch_location = Switch0
91472024-12-14T03:41:26.630ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
91482024-12-14T03:41:26.727ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "57633c37-f3d7-4935-8f16-938e2a848141", "date": "Sat, 14 Dec 2024 03:41:26 GMT"} })
91492024-12-14T03:41:26.727ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 switch = Switch0
91502024-12-14T03:41:26.727ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
91512024-12-14T03:41:26.727ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "7ed1fd32-e1f4-485d-82d9-8b236274699d", "content-length": "682", "date": "Sat, 14 Dec 2024 03:41:26 GMT"} })
91522024-12-14T03:41:26.727ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
91532024-12-14T03:41:26.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
91542024-12-14T03:41:26.731ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
91552024-12-14T03:41:26.731ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
91562024-12-14T03:41:26.734ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
91572024-12-14T03:41:26.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
91582024-12-14T03:41:26.736ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
91592024-12-14T03:41:26.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
91602024-12-14T03:41:26.743ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 396.302309ms iteration = 14 status = {}
91612024-12-14T03:41:35.613ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1035 local_addr = [fd00:1122:3344:101::b]:56585 method = GET remote_addr = [fd00:1122:3344:101::d]:58979 req_id = 8c3fc7d6-085c-45fa-b1a2-2c8907268b4a response_code = 200 uri = /5f2fe413-3c4a-4994-b4a0-995c1da486b1
91622024-12-14T03:41:36.347ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 41 reason = Timeout
91632024-12-14T03:41:36.347ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
91642024-12-14T03:41:36.347ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 41 reason = Timeout
91652024-12-14T03:41:36.347ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91662024-12-14T03:41:36.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
91672024-12-14T03:41:36.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91682024-12-14T03:41:36.350ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
91692024-12-14T03:41:36.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
91702024-12-14T03:41:36.350ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91712024-12-14T03:41:36.352ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.995101ms iteration = 41 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
91722024-12-14T03:41:36.353ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
91732024-12-14T03:41:36.353ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91742024-12-14T03:41:36.353ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91752024-12-14T03:41:36.355ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91762024-12-14T03:41:36.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91772024-12-14T03:41:36.356ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91782024-12-14T03:41:36.359ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1, lookup_type: ById(eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1) } result = Ok(())
91792024-12-14T03:41:36.359ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91802024-12-14T03:41:36.359ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91812024-12-14T03:41:36.368ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1 original_time_created = 2024-12-14 03:34:51.368980 UTC target_id = eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1 time_created = 2024-12-14 03:34:51.368980 UTC
91822024-12-14T03:41:36.368ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.218205ms iteration = 41 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1","time_created":"2024-12-14T03:34:51.368980Z"}
91832024-12-14T03:41:45.613ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1099 local_addr = [fd00:1122:3344:101::b]:56585 method = GET remote_addr = [fd00:1122:3344:101::d]:58979 req_id = 34c268ec-b4f4-4bf2-b6ef-72943f81c8ca response_code = 200 uri = /5f2fe413-3c4a-4994-b4a0-995c1da486b1
91842024-12-14T03:41:46.347ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 42 reason = Timeout
91852024-12-14T03:41:46.347ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91862024-12-14T03:41:46.347ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 42 reason = Timeout
91872024-12-14T03:41:46.347ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
91882024-12-14T03:41:46.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91892024-12-14T03:41:46.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
91902024-12-14T03:41:46.350ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91912024-12-14T03:41:46.351ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
91922024-12-14T03:41:46.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
91932024-12-14T03:41:46.352ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 5.431449ms iteration = 42 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
91942024-12-14T03:41:46.353ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
91952024-12-14T03:41:46.353ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91962024-12-14T03:41:46.353ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91972024-12-14T03:41:46.355ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91982024-12-14T03:41:46.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91992024-12-14T03:41:46.357ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92002024-12-14T03:41:46.359ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1, lookup_type: ById(eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1) } result = Ok(())
92012024-12-14T03:41:46.359ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
92022024-12-14T03:41:46.359ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
92032024-12-14T03:41:46.371ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1 original_time_created = 2024-12-14 03:34:51.368980 UTC target_id = eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1 time_created = 2024-12-14 03:34:51.368980 UTC
92042024-12-14T03:41:46.371ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.684735ms iteration = 42 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1","time_created":"2024-12-14T03:34:51.368980Z"}
92052024-12-14T03:41:51.301ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:42824
92062024-12-14T03:41:51.301ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:42824 req_id = ea923953-e6de-40eb-824b-317771e35246 roles = RoleSet { roles: {} } uri = /metrics/producers
92072024-12-14T03:41:51.301ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:42824 req_id = ea923953-e6de-40eb-824b-317771e35246 resource = Database result = Ok(()) uri = /metrics/producers
92082024-12-14T03:41:51.308ZINFOnexus: assigned collector to new producer collector_id = a321e00a-3126-4ea4-b26d-c0e3eea69166 file = nexus/src/app/oximeter.rs:76 producer_id = c4ff451e-ab57-4adc-b747-11f26d0ffcfa
92092024-12-14T03:41:51.308ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6947 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:42824 req_id = ea923953-e6de-40eb-824b-317771e35246 response_code = 201 uri = /metrics/producers
92102024-12-14T03:41:55.602ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:56805 req_id = 520e4741-948a-4070-912f-71ee538230a7 roles = RoleSet { roles: {} } uri = /metrics/collectors/a321e00a-3126-4ea4-b26d-c0e3eea69166/producers?sort_by=id_ascending
92112024-12-14T03:41:55.602ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:56805 req_id = 520e4741-948a-4070-912f-71ee538230a7 resource = Database result = Ok(()) uri = /metrics/collectors/a321e00a-3126-4ea4-b26d-c0e3eea69166/producers?sort_by=id_ascending
92122024-12-14T03:41:55.605ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3184 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:56805 req_id = 520e4741-948a-4070-912f-71ee538230a7 response_code = 200 uri = /metrics/collectors/a321e00a-3126-4ea4-b26d-c0e3eea69166/producers?sort_by=id_ascending
92132024-12-14T03:41:55.605ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:56805 req_id = d0a26ad1-ad2f-47cf-ac96-588eb4151ef8 roles = RoleSet { roles: {} } uri = /metrics/collectors/a321e00a-3126-4ea4-b26d-c0e3eea69166/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlOGQ5NjQ2Zi1hNTQxLTRjMTEtYjViMi1mOTUzNDI3Y2EyZjMifX0%3D
92142024-12-14T03:41:55.606ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:56805 req_id = d0a26ad1-ad2f-47cf-ac96-588eb4151ef8 resource = Database result = Ok(()) uri = /metrics/collectors/a321e00a-3126-4ea4-b26d-c0e3eea69166/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlOGQ5NjQ2Zi1hNTQxLTRjMTEtYjViMi1mOTUzNDI3Y2EyZjMifX0%3D
92152024-12-14T03:41:55.608ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2355 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:56805 req_id = d0a26ad1-ad2f-47cf-ac96-588eb4151ef8 response_code = 200 uri = /metrics/collectors/a321e00a-3126-4ea4-b26d-c0e3eea69166/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlOGQ5NjQ2Zi1hNTQxLTRjMTEtYjViMi1mOTUzNDI3Y2EyZjMifX0%3D
92162024-12-14T03:41:55.613ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1125 local_addr = [fd00:1122:3344:101::b]:56585 method = GET remote_addr = [fd00:1122:3344:101::d]:58979 req_id = 1602ab60-f66b-4152-86cc-4f9dcea50a14 response_code = 200 uri = /5f2fe413-3c4a-4994-b4a0-995c1da486b1
92172024-12-14T03:41:56.347ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 16 reason = Timeout
92182024-12-14T03:41:56.347ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
92192024-12-14T03:41:56.347ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 15 reason = Timeout
92202024-12-14T03:41:56.347ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
92212024-12-14T03:41:56.347ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 15 reason = Timeout
92222024-12-14T03:41:56.347ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
92232024-12-14T03:41:56.347ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 10 reason = Timeout
92242024-12-14T03:41:56.347ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
92252024-12-14T03:41:56.347ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 9 reason = Timeout
92262024-12-14T03:41:56.347ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 43 reason = Timeout
92272024-12-14T03:41:56.347ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
92282024-12-14T03:41:56.347ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 15 reason = Timeout
92292024-12-14T03:41:56.347ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
92302024-12-14T03:41:56.347ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 15 reason = Timeout
92312024-12-14T03:41:56.347ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
92322024-12-14T03:41:56.347ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 9 reason = Timeout
92332024-12-14T03:41:56.347ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
92342024-12-14T03:41:56.347ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
92352024-12-14T03:41:56.347ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 15 reason = Timeout
92362024-12-14T03:41:56.347ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 8 reason = Timeout
92372024-12-14T03:41:56.347ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-14 03:31:56.347782192 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
92382024-12-14T03:41:56.347ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
92392024-12-14T03:41:56.347ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
92402024-12-14T03:41:56.347ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 8 reason = Timeout
92412024-12-14T03:41:56.347ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 8 reason = Timeout
92422024-12-14T03:41:56.347ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
92432024-12-14T03:41:56.347ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
92442024-12-14T03:41:56.348ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 9 reason = Timeout
92452024-12-14T03:41:56.348ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1
92462024-12-14T03:41:56.348ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 8 reason = Timeout
92472024-12-14T03:41:56.348ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 24.131\u{b5}s iteration = 9 status = {"enabled":false,"target_id":"eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1"}
92482024-12-14T03:41:56.348ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
92492024-12-14T03:41:56.348ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 8 reason = Timeout
92502024-12-14T03:41:56.348ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
92512024-12-14T03:41:56.348ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 17 reason = Timeout
92522024-12-14T03:41:56.348ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
92532024-12-14T03:41:56.348ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 9 reason = Timeout
92542024-12-14T03:41:56.348ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
92552024-12-14T03:41:56.348ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 15 reason = Timeout
92562024-12-14T03:41:56.348ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
92572024-12-14T03:41:56.348ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 15 reason = Timeout
92582024-12-14T03:41:56.348ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
92592024-12-14T03:41:56.348ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 9 reason = Timeout
92602024-12-14T03:41:56.348ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
92612024-12-14T03:41:56.348ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
92622024-12-14T03:41:56.348ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 9 reason = Timeout
92632024-12-14T03:41:56.348ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
92642024-12-14T03:41:56.348ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 15 reason = Timeout
92652024-12-14T03:41:56.348ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
92662024-12-14T03:41:56.348ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 10 reason = Timeout
92672024-12-14T03:41:56.348ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 15 reason = Timeout
92682024-12-14T03:41:56.348ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
92692024-12-14T03:41:56.348ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 43 reason = Timeout
92702024-12-14T03:41:56.348ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 15 reason = Timeout
92712024-12-14T03:41:56.348ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
92722024-12-14T03:41:56.348ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
92732024-12-14T03:41:56.348ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 15 reason = Timeout
92742024-12-14T03:41:56.348ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
92752024-12-14T03:41:56.348ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 15 reason = Timeout
92762024-12-14T03:41:56.348ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 15 reason = Timeout
92772024-12-14T03:41:56.348ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
92782024-12-14T03:41:56.348ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
92792024-12-14T03:41:56.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
92802024-12-14T03:41:56.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
92812024-12-14T03:41:56.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
92822024-12-14T03:41:56.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
92832024-12-14T03:41:56.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
92842024-12-14T03:41:56.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
92852024-12-14T03:41:56.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
92862024-12-14T03:41:56.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
92872024-12-14T03:41:56.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
92882024-12-14T03:41:56.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
92892024-12-14T03:41:56.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
92902024-12-14T03:41:56.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
92912024-12-14T03:41:56.348ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("28f528f1-3159-4fbc-9304-37b7e4a50ae8.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7274e15f-a5f6-4975-bcdd-a2ef890c0230.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("7274e15f-a5f6-4975-bcdd-a2ef890c0230.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1522, tv_nsec: 666350602 } })
92922024-12-14T03:41:56.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
92932024-12-14T03:41:56.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
92942024-12-14T03:41:56.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
92952024-12-14T03:41:56.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
92962024-12-14T03:41:56.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
92972024-12-14T03:41:56.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
92982024-12-14T03:41:56.348ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("3db8556d-0ae0-4824-8953-f38d8eef7409.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7b672843-049d-4d9c-b0a2-21d7b6323621.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("db39fe07-65c4-451a-a2bd-78fcdfc10040.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("db39fe07-65c4-451a-a2bd-78fcdfc10040.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1522, tv_nsec: 666387463 } })
92992024-12-14T03:41:56.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
93002024-12-14T03:41:56.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
93012024-12-14T03:41:56.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
93022024-12-14T03:41:56.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
93032024-12-14T03:41:56.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
93042024-12-14T03:41:56.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
93052024-12-14T03:41:56.349ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
93062024-12-14T03:41:56.349ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.733134ms iteration = 9 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
93072024-12-14T03:41:56.349ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
93082024-12-14T03:41:56.349ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.492209ms iteration = 9 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
93092024-12-14T03:41:56.350ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93102024-12-14T03:41:56.350ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
93112024-12-14T03:41:56.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
93122024-12-14T03:41:56.351ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93132024-12-14T03:41:56.351ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.948749ms iteration = 15 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
93142024-12-14T03:41:56.352ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
93152024-12-14T03:41:56.352ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
93162024-12-14T03:41:56.352ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
93172024-12-14T03:41:56.352ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8d70e61c-94ed-41ce-b36c-cb904f92c534.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8d70e61c-94ed-41ce-b36c-cb904f92c534.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1522, tv_nsec: 670345512 } })
93182024-12-14T03:41:56.352ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
93192024-12-14T03:41:56.352ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
93202024-12-14T03:41:56.352ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
93212024-12-14T03:41:56.353ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
93222024-12-14T03:41:56.353ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
93232024-12-14T03:41:56.353ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
93242024-12-14T03:41:56.353ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
93252024-12-14T03:41:56.353ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
93262024-12-14T03:41:56.353ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
93272024-12-14T03:41:56.353ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
93282024-12-14T03:41:56.354ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8d70e61c-94ed-41ce-b36c-cb904f92c534.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8d70e61c-94ed-41ce-b36c-cb904f92c534.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1522, tv_nsec: 671976035 } })
93292024-12-14T03:41:56.354ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
93302024-12-14T03:41:56.355ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 8.01251ms iteration = 8 status = {"errors":[],"found_port_ok":[]}
93312024-12-14T03:41:56.356ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-14 03:31:56.347782192 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
93322024-12-14T03:41:56.356ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 8.239795ms iteration = 8 status = {"expiration":"2024-12-14T03:31:56.347782192Z","pruned":[]}
93332024-12-14T03:41:56.356ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93342024-12-14T03:41:56.356ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
93352024-12-14T03:41:56.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
93362024-12-14T03:41:56.356ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93372024-12-14T03:41:56.357ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93382024-12-14T03:41:56.358ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
93392024-12-14T03:41:56.358ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
93402024-12-14T03:41:56.358ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
93412024-12-14T03:41:56.359ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
93422024-12-14T03:41:56.359ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
93432024-12-14T03:41:56.359ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
93442024-12-14T03:41:56.359ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
93452024-12-14T03:41:56.359ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
93462024-12-14T03:41:56.359ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
93472024-12-14T03:41:56.361ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93482024-12-14T03:41:56.361ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93492024-12-14T03:41:56.364ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 16.353557ms iteration = 15 status = {"errors":[],"garbage_collect_requested":[]}
93502024-12-14T03:41:56.365ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
93512024-12-14T03:41:56.365ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
93522024-12-14T03:41:56.365ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
93532024-12-14T03:41:56.365ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
93542024-12-14T03:41:56.365ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
93552024-12-14T03:41:56.366ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
93562024-12-14T03:41:56.367ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93572024-12-14T03:41:56.371ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
93582024-12-14T03:41:56.371ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
93592024-12-14T03:41:56.371ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
93602024-12-14T03:41:56.372ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
93612024-12-14T03:41:56.372ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
93622024-12-14T03:41:56.375ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8d70e61c-94ed-41ce-b36c-cb904f92c534.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8d70e61c-94ed-41ce-b36c-cb904f92c534.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1522, tv_nsec: 692584328 } })
93632024-12-14T03:41:56.375ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200
93642024-12-14T03:41:56.377ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
93652024-12-14T03:41:56.377ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
93662024-12-14T03:41:56.377ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
93672024-12-14T03:41:56.377ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
93682024-12-14T03:41:56.377ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
93692024-12-14T03:41:56.377ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
93702024-12-14T03:41:56.378ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
93712024-12-14T03:41:56.378ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
93722024-12-14T03:41:56.395ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
93732024-12-14T03:41:56.395ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
93742024-12-14T03:41:56.395ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 47.544742ms iteration = 8 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
93752024-12-14T03:41:56.397ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93762024-12-14T03:41:56.398ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 49.9289ms iteration = 15 status = {"errors":[],"records_set_to_done":[]}
93772024-12-14T03:41:56.400ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
93782024-12-14T03:41:56.400ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
93792024-12-14T03:41:56.400ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
93802024-12-14T03:41:56.401ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
93812024-12-14T03:41:56.401ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
93822024-12-14T03:41:56.402ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93832024-12-14T03:41:56.404ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
93842024-12-14T03:41:56.404ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
93852024-12-14T03:41:56.405ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
93862024-12-14T03:41:56.405ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
93872024-12-14T03:41:56.405ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
93882024-12-14T03:41:56.405ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
93892024-12-14T03:41:56.406ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
93902024-12-14T03:41:56.406ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1, lookup_type: ById(eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1) } result = Ok(())
93912024-12-14T03:41:56.406ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
93922024-12-14T03:41:56.406ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
93932024-12-14T03:41:56.406ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
93942024-12-14T03:41:56.409ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
93952024-12-14T03:41:56.409ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
93962024-12-14T03:41:56.410ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93972024-12-14T03:41:56.411ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93982024-12-14T03:41:56.412ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
93992024-12-14T03:41:56.412ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 64.110104ms iteration = 15 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
94002024-12-14T03:41:56.414ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94012024-12-14T03:41:56.415ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94022024-12-14T03:41:56.415ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
94032024-12-14T03:41:56.415ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
94042024-12-14T03:41:56.415ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 8d70e61c-94ed-41ce-b36c-cb904f92c534, lookup_type: ById(8d70e61c-94ed-41ce-b36c-cb904f92c534) } result = Ok(())
94052024-12-14T03:41:56.415ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
94062024-12-14T03:41:56.415ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
94072024-12-14T03:41:56.416ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
94082024-12-14T03:41:56.417ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
94092024-12-14T03:41:56.417ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
94102024-12-14T03:41:56.417ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 69.338239ms iteration = 8 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
94112024-12-14T03:41:56.417ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
94122024-12-14T03:41:56.417ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
94132024-12-14T03:41:56.417ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
94142024-12-14T03:41:56.419ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
94152024-12-14T03:41:56.423ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 75.840729ms iteration = 15 status = 0
94162024-12-14T03:41:56.424ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
94172024-12-14T03:41:56.424ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
94182024-12-14T03:41:56.424ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
94192024-12-14T03:41:56.424ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
94202024-12-14T03:41:56.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
94212024-12-14T03:41:56.426ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 78.357329ms iteration = 43 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
94222024-12-14T03:41:56.426ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1 original_time_created = 2024-12-14 03:34:51.368980 UTC target_id = eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1 time_created = 2024-12-14 03:34:51.368980 UTC
94232024-12-14T03:41:56.426ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 78.074594ms iteration = 43 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1","time_created":"2024-12-14T03:34:51.368980Z"}
94242024-12-14T03:41:56.426ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94252024-12-14T03:41:56.428ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94262024-12-14T03:41:56.429ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
94272024-12-14T03:41:56.429ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
94282024-12-14T03:41:56.429ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
94292024-12-14T03:41:56.432ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
94302024-12-14T03:41:56.432ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
94312024-12-14T03:41:56.432ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
94322024-12-14T03:41:56.432ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 51f6df17-b3b5-47fe-9a42-d8752f961c5e dns_zone_name = oxide.test found_so_far = 0 version = 2
94332024-12-14T03:41:56.432ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
94342024-12-14T03:41:56.432ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
94352024-12-14T03:41:56.432ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
94362024-12-14T03:41:56.444ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
94372024-12-14T03:41:56.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
94382024-12-14T03:41:56.446ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
94392024-12-14T03:41:56.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
94402024-12-14T03:41:56.450ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 102.623346ms iteration = 15 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
94412024-12-14T03:41:56.453ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
94422024-12-14T03:41:56.453ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
94432024-12-14T03:41:56.453ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 105.762039ms iteration = 15 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
94442024-12-14T03:41:56.454ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
94452024-12-14T03:41:56.454ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
94462024-12-14T03:41:56.454ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
94472024-12-14T03:41:56.454ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
94482024-12-14T03:41:56.454ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
94492024-12-14T03:41:56.454ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
94502024-12-14T03:41:56.455ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
94512024-12-14T03:41:56.456ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 108.043334ms iteration = 15 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
94522024-12-14T03:41:56.476ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
94532024-12-14T03:41:56.480ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
94542024-12-14T03:41:56.480ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
94552024-12-14T03:41:56.482ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
94562024-12-14T03:41:56.523ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
94572024-12-14T03:41:56.523ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
94582024-12-14T03:41:56.523ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2017c89f-5581-4a98-a3aa-4ac80345c183", "content-length": "26", "date": "Sat, 14 Dec 2024 03:41:56 GMT"} })
94592024-12-14T03:41:56.523ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
94602024-12-14T03:41:56.524ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
94612024-12-14T03:41:56.524ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
94622024-12-14T03:41:56.524ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6662b051-1ea1-42fe-b0db-6b2b1516962d", "content-length": "26", "date": "Sat, 14 Dec 2024 03:41:56 GMT"} })
94632024-12-14T03:41:56.524ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
94642024-12-14T03:41:56.526ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
94652024-12-14T03:41:56.526ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
94662024-12-14T03:41:56.557ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 zone_address = fd00:1122:3344:101::2
94672024-12-14T03:41:56.557ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
94682024-12-14T03:41:56.557ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "956d39b5-b9d7-464d-b05b-44e783146d01", "content-length": "26", "date": "Sat, 14 Dec 2024 03:41:56 GMT"} })
94692024-12-14T03:41:56.557ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
94702024-12-14T03:41:56.559ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200
94712024-12-14T03:41:56.591ZINFOnexus (BackgroundTasks): VPC route manager sled 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
94722024-12-14T03:41:56.591ZDEBGnexus (BackgroundTasks): client request SledAgent = 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
94732024-12-14T03:41:56.592ZDEBGnexus (BackgroundTasks): client response SledAgent = 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "c5d93d15-4db8-4d3b-8915-cf17474b0d62", "content-length": "372", "date": "Sat, 14 Dec 2024 03:41:56 GMT"} })
94742024-12-14T03:41:56.592ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
94752024-12-14T03:41:56.592ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
94762024-12-14T03:41:56.593ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94772024-12-14T03:41:56.594ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94782024-12-14T03:41:56.596ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
94792024-12-14T03:41:56.596ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
94802024-12-14T03:41:56.596ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
94812024-12-14T03:41:56.596ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
94822024-12-14T03:41:56.596ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
94832024-12-14T03:41:56.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
94842024-12-14T03:41:56.598ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94852024-12-14T03:41:56.598ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94862024-12-14T03:41:56.600ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 51f6df17-b3b5-47fe-9a42-d8752f961c5e dns_zone_name = oxide.test found_so_far = 1 version = 2
94872024-12-14T03:41:56.600ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
94882024-12-14T03:41:56.600ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-14 03:35:40.905586 UTC dns_group = external generation = 2
94892024-12-14T03:41:56.600ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 252.593651ms iteration = 9 status = {"generation":2}
94902024-12-14T03:41:56.600ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
94912024-12-14T03:41:56.601ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
94922024-12-14T03:41:56.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
94932024-12-14T03:41:56.602ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94942024-12-14T03:41:56.603ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
94952024-12-14T03:41:56.604ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
94962024-12-14T03:41:56.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
94972024-12-14T03:41:56.604ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
94982024-12-14T03:41:56.604ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
94992024-12-14T03:41:56.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
95002024-12-14T03:41:56.611ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
95012024-12-14T03:41:56.611ZDEBGnexus (BackgroundTasks): client request SledAgent = 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
95022024-12-14T03:41:56.611ZDEBGnexus (BackgroundTasks): client response SledAgent = 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "39f42270-288d-4d3a-baef-6b8e891ddd7b", "date": "Sat, 14 Dec 2024 03:41:56 GMT"} })
95032024-12-14T03:41:56.611ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
95042024-12-14T03:41:56.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
95052024-12-14T03:41:56.614ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
95062024-12-14T03:41:56.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
95072024-12-14T03:41:56.619ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
95082024-12-14T03:41:56.622ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
95092024-12-14T03:41:56.624ZINFOnexus (BackgroundTasks): VPC route manager sled 8d70e61c-94ed-41ce-b36c-cb904f92c534 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
95102024-12-14T03:41:56.624ZDEBGnexus (BackgroundTasks): client request SledAgent = 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
95112024-12-14T03:41:56.625ZDEBGnexus (BackgroundTasks): client response SledAgent = 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "dd763daf-8548-4c7e-86df-676dfece31d8", "date": "Sat, 14 Dec 2024 03:41:56 GMT"} })
95122024-12-14T03:41:56.626ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 279.163633ms iteration = 16 status = {}
95132024-12-14T03:41:56.630ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
95142024-12-14T03:41:56.631ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 284.00878ms iteration = 17 status = {"physical_disks_added":0}
95152024-12-14T03:41:56.633ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 285.245055ms iteration = 15 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
95162024-12-14T03:41:56.637ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
95172024-12-14T03:41:56.637ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = c7a5bbe9-1af5-4e36-80b5-da9e0053b676 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
95182024-12-14T03:41:56.637ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
95192024-12-14T03:41:56.637ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
95202024-12-14T03:41:56.639ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95212024-12-14T03:41:56.640ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-14T03:34:54.541856Z, time_modified: 2024-12-14T03:34:54.541856Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, db_silo: Silo { identity: SiloIdentity { id: 578bc52c-ac81-41a6-a56b-dfc79805368e, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-14T03:35:40.848931Z, time_modified: 2024-12-14T03:35:40.848931Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "4dfc5e49ed154568e7a05c630983c79e7ad097d55e90f834bee8ffda0c5a5c9e" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, db_silo: Silo { identity: SiloIdentity { id: 578bc52c-ac81-41a6-a56b-dfc79805368e, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-14T03:35:40.848931Z, time_modified: 2024-12-14T03:35:40.848931Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "4dfc5e49ed154568e7a05c630983c79e7ad097d55e90f834bee8ffda0c5a5c9e" }] }) }
95222024-12-14T03:41:56.640ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 292.081452ms iteration = 9 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"578bc52c-ac81-41a6-a56b-dfc79805368e","tls_certs":["4dfc5e49ed154568e7a05c630983c79e7ad097d55e90f834bee8ffda0c5a5c9e"]}},"default_endpoint":{"silo_id":"578bc52c-ac81-41a6-a56b-dfc79805368e","tls_certs":["4dfc5e49ed154568e7a05c630983c79e7ad097d55e90f834bee8ffda0c5a5c9e"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
95232024-12-14T03:41:56.642ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
95242024-12-14T03:41:56.642ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
95252024-12-14T03:41:56.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
95262024-12-14T03:41:56.644ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = c7a5bbe9-1af5-4e36-80b5-da9e0053b676 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
95272024-12-14T03:41:56.644ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
95282024-12-14T03:41:56.644ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-14 03:35:40.104814 UTC dns_group = internal generation = 1
95292024-12-14T03:41:56.644ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 296.687234ms iteration = 9 status = {"generation":1}
95302024-12-14T03:41:56.659ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
95312024-12-14T03:41:56.659ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 311.258486ms iteration = 8 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
95322024-12-14T03:41:56.716ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
95332024-12-14T03:41:56.717ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "275080d4-ff90-432a-b09c-460918a719f1", "date": "Sat, 14 Dec 2024 03:41:56 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
95342024-12-14T03:41:56.717ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
95352024-12-14T03:41:56.718ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "da28bc0e-6292-4db1-83f6-c66087b3a28f", "date": "Sat, 14 Dec 2024 03:41:56 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
95362024-12-14T03:41:56.718ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
95372024-12-14T03:41:56.721ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
95382024-12-14T03:41:56.721ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 373.31153ms iteration = 10 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
95392024-12-14T03:41:56.778ZDEBGnexus (BackgroundTasks): client request SledAgent = 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
95402024-12-14T03:41:56.778ZDEBGnexus (BackgroundTasks): client response SledAgent = 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "27dbc00d-a0c6-4a05-bba6-bff673565be2", "content-length": "691", "date": "Sat, 14 Dec 2024 03:41:56 GMT"} })
95412024-12-14T03:41:56.778ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
95422024-12-14T03:41:56.778ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
95432024-12-14T03:41:56.778ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
95442024-12-14T03:41:56.778ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
95452024-12-14T03:41:56.779ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "7e7368ca-6f56-4bf8-8f4c-777bbb1a1698", "date": "Sat, 14 Dec 2024 03:41:56 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
95462024-12-14T03:41:56.779ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
95472024-12-14T03:41:56.781ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 433.182389ms iteration = 15 status = {}
95482024-12-14T03:41:56.781ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "f9d0cbdd-351b-4651-8537-67d0ac3181f0", "date": "Sat, 14 Dec 2024 03:41:56 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
95492024-12-14T03:41:56.781ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
95502024-12-14T03:41:56.783ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "e6b2fd56-89c3-4d52-a015-e71af93e79d3", "date": "Sat, 14 Dec 2024 03:41:56 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
95512024-12-14T03:41:56.783ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
95522024-12-14T03:41:56.785ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
95532024-12-14T03:41:56.785ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 437.899083ms iteration = 10 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
95542024-12-14T03:41:56.817ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
95552024-12-14T03:41:56.818ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "16a06aa7-7d3b-4269-8816-c2f5ac305fb8", "content-length": "1", "date": "Sat, 14 Dec 2024 03:41:55 GMT"} })
95562024-12-14T03:41:56.819ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 471.310983ms iteration = 15 status = {}
95572024-12-14T03:41:56.819ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
95582024-12-14T03:41:56.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
95592024-12-14T03:41:56.821ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 473.836833ms iteration = 15 status = null
95602024-12-14T03:41:56.867ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
95612024-12-14T03:41:56.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
95622024-12-14T03:41:56.869ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 45ca990e-42e9-4264-be3e-0adfed2cd99b, rack_id: a121ca05-bbee-41bf-b9db-9e03ff035200, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(811a570a-bdaf-4a1b-8eba-0c0e4977f7bb) } rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 switch_location = Switch0
95632024-12-14T03:41:56.869ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
95642024-12-14T03:41:56.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
95652024-12-14T03:41:56.878ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
95662024-12-14T03:41:56.878ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "e91f5da4-0b30-4e76-afe2-7a4140e43b43", "content-length": "134", "date": "Sat, 14 Dec 2024 03:41:56 GMT"} })
95672024-12-14T03:41:56.878ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
95682024-12-14T03:41:56.878ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 811a570a-bdaf-4a1b-8eba-0c0e4977f7bb
95692024-12-14T03:41:56.878ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
95702024-12-14T03:41:56.878ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
95712024-12-14T03:41:56.879ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
95722024-12-14T03:41:56.879ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
95732024-12-14T03:41:56.879ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
95742024-12-14T03:41:56.879ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
95752024-12-14T03:41:56.879ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
95762024-12-14T03:41:56.879ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
95772024-12-14T03:41:56.879ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200
95782024-12-14T03:41:56.879ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
95792024-12-14T03:41:56.879ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
95802024-12-14T03:41:56.881ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
95812024-12-14T03:41:56.881ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "ea9d6a3b-0b54-4753-b1d1-ca29c70fb083", "content-length": "2", "date": "Sat, 14 Dec 2024 03:41:56 GMT"} })
95822024-12-14T03:41:56.881ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
95832024-12-14T03:41:56.881ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "9f12e7e2-67f4-436f-a6e1-afc517dfa4fd", "content-length": "52", "date": "Sat, 14 Dec 2024 03:41:56 GMT"} })
95842024-12-14T03:41:56.881ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 switch_location = Switch0
95852024-12-14T03:41:56.881ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
95862024-12-14T03:41:56.974ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "c8b30e10-d056-4dc7-81ef-f2951855459e", "date": "Sat, 14 Dec 2024 03:41:56 GMT"} })
95872024-12-14T03:41:56.974ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 switch = Switch0
95882024-12-14T03:41:56.974ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
95892024-12-14T03:41:56.974ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "d62119db-8dfb-41ee-87aa-6a0767105e43", "content-length": "682", "date": "Sat, 14 Dec 2024 03:41:56 GMT"} })
95902024-12-14T03:41:56.974ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
95912024-12-14T03:41:56.975ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
95922024-12-14T03:41:56.978ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
95932024-12-14T03:41:56.979ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
95942024-12-14T03:41:56.982ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
95952024-12-14T03:41:56.982ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
95962024-12-14T03:41:56.984ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
95972024-12-14T03:41:56.984ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
95982024-12-14T03:41:56.992ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 644.571694ms iteration = 15 status = {}
95992024-12-14T03:42:05.613ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1037 local_addr = [fd00:1122:3344:101::b]:56585 method = GET remote_addr = [fd00:1122:3344:101::d]:58979 req_id = e4940bb6-abda-46a5-8078-e6b496a41299 response_code = 200 uri = /5f2fe413-3c4a-4994-b4a0-995c1da486b1
96002024-12-14T03:42:06.347ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 44 reason = Timeout
96012024-12-14T03:42:06.347ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 44 reason = Timeout
96022024-12-14T03:42:06.347ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
96032024-12-14T03:42:06.347ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
96042024-12-14T03:42:06.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
96052024-12-14T03:42:06.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
96062024-12-14T03:42:06.349ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96072024-12-14T03:42:06.350ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
96082024-12-14T03:42:06.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
96092024-12-14T03:42:06.352ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
96102024-12-14T03:42:06.352ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
96112024-12-14T03:42:06.352ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
96122024-12-14T03:42:06.354ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
96132024-12-14T03:42:06.354ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
96142024-12-14T03:42:06.356ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96152024-12-14T03:42:06.359ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1, lookup_type: ById(eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1) } result = Ok(())
96162024-12-14T03:42:06.359ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
96172024-12-14T03:42:06.359ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
96182024-12-14T03:42:06.369ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1 original_time_created = 2024-12-14 03:34:51.368980 UTC target_id = eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1 time_created = 2024-12-14 03:34:51.368980 UTC
96192024-12-14T03:42:06.369ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.621943ms iteration = 44 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1","time_created":"2024-12-14T03:34:51.368980Z"}
96202024-12-14T03:42:06.377ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 29.720105ms iteration = 44 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
96212024-12-14T03:42:15.613ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1014 local_addr = [fd00:1122:3344:101::b]:56585 method = GET remote_addr = [fd00:1122:3344:101::d]:58979 req_id = c18fcf2c-017c-4307-8de4-3fb29129d73f response_code = 200 uri = /5f2fe413-3c4a-4994-b4a0-995c1da486b1
96222024-12-14T03:42:16.347ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 45 reason = Timeout
96232024-12-14T03:42:16.347ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
96242024-12-14T03:42:16.347ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 45 reason = Timeout
96252024-12-14T03:42:16.347ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
96262024-12-14T03:42:16.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
96272024-12-14T03:42:16.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
96282024-12-14T03:42:16.349ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
96292024-12-14T03:42:16.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
96302024-12-14T03:42:16.350ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96312024-12-14T03:42:16.352ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
96322024-12-14T03:42:16.352ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
96332024-12-14T03:42:16.352ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
96342024-12-14T03:42:16.355ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
96352024-12-14T03:42:16.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
96362024-12-14T03:42:16.356ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96372024-12-14T03:42:16.359ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1, lookup_type: ById(eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1) } result = Ok(())
96382024-12-14T03:42:16.359ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
96392024-12-14T03:42:16.359ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
96402024-12-14T03:42:16.367ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1 original_time_created = 2024-12-14 03:34:51.368980 UTC target_id = eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1 time_created = 2024-12-14 03:34:51.368980 UTC
96412024-12-14T03:42:16.367ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.007531ms iteration = 45 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1","time_created":"2024-12-14T03:34:51.368980Z"}
96422024-12-14T03:42:16.378ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.017092ms iteration = 45 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
96432024-12-14T03:42:25.602ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:56805 req_id = 04d4fbb0-00ab-4800-a20d-7e56b5e37876 roles = RoleSet { roles: {} } uri = /metrics/collectors/a321e00a-3126-4ea4-b26d-c0e3eea69166/producers?sort_by=id_ascending
96442024-12-14T03:42:25.602ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:56805 req_id = 04d4fbb0-00ab-4800-a20d-7e56b5e37876 resource = Database result = Ok(()) uri = /metrics/collectors/a321e00a-3126-4ea4-b26d-c0e3eea69166/producers?sort_by=id_ascending
96452024-12-14T03:42:25.605ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2985 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:56805 req_id = 04d4fbb0-00ab-4800-a20d-7e56b5e37876 response_code = 200 uri = /metrics/collectors/a321e00a-3126-4ea4-b26d-c0e3eea69166/producers?sort_by=id_ascending
96462024-12-14T03:42:25.605ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:56805 req_id = ef00ea3d-a036-497e-b68c-b461cde1fa60 roles = RoleSet { roles: {} } uri = /metrics/collectors/a321e00a-3126-4ea4-b26d-c0e3eea69166/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlOGQ5NjQ2Zi1hNTQxLTRjMTEtYjViMi1mOTUzNDI3Y2EyZjMifX0%3D
96472024-12-14T03:42:25.606ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:56805 req_id = ef00ea3d-a036-497e-b68c-b461cde1fa60 resource = Database result = Ok(()) uri = /metrics/collectors/a321e00a-3126-4ea4-b26d-c0e3eea69166/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlOGQ5NjQ2Zi1hNTQxLTRjMTEtYjViMi1mOTUzNDI3Y2EyZjMifX0%3D
96482024-12-14T03:42:25.608ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2600 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:56805 req_id = ef00ea3d-a036-497e-b68c-b461cde1fa60 response_code = 200 uri = /metrics/collectors/a321e00a-3126-4ea4-b26d-c0e3eea69166/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlOGQ5NjQ2Zi1hNTQxLTRjMTEtYjViMi1mOTUzNDI3Y2EyZjMifX0%3D
96492024-12-14T03:42:25.613ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1012 local_addr = [fd00:1122:3344:101::b]:56585 method = GET remote_addr = [fd00:1122:3344:101::d]:58979 req_id = 654a1048-f710-4b95-9c84-b1095bb098a3 response_code = 200 uri = /5f2fe413-3c4a-4994-b4a0-995c1da486b1
96502024-12-14T03:42:26.010ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:54752
96512024-12-14T03:42:26.011ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:54752 req_id = 348b34bc-14e5-4641-8b49-9aadd58b0a57 roles = RoleSet { roles: {} } uri = /metrics/producers
96522024-12-14T03:42:26.011ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:54752 req_id = 348b34bc-14e5-4641-8b49-9aadd58b0a57 resource = Database result = Ok(()) uri = /metrics/producers
96532024-12-14T03:42:26.052ZINFOnexus: assigned collector to new producer collector_id = a321e00a-3126-4ea4-b26d-c0e3eea69166 file = nexus/src/app/oximeter.rs:76 producer_id = d278f717-338f-4586-9211-4636baa82004
96542024-12-14T03:42:26.052ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 41368 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:54752 req_id = 348b34bc-14e5-4641-8b49-9aadd58b0a57 response_code = 201 uri = /metrics/producers
96552024-12-14T03:42:26.348ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 16 reason = Timeout
96562024-12-14T03:42:26.348ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 16 reason = Timeout
96572024-12-14T03:42:26.348ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
96582024-12-14T03:42:26.348ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
96592024-12-14T03:42:26.348ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 16 reason = Timeout
96602024-12-14T03:42:26.348ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 16 reason = Timeout
96612024-12-14T03:42:26.348ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 16 reason = Timeout
96622024-12-14T03:42:26.348ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
96632024-12-14T03:42:26.348ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 16 reason = Timeout
96642024-12-14T03:42:26.348ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
96652024-12-14T03:42:26.348ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 16 reason = Timeout
96662024-12-14T03:42:26.348ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
96672024-12-14T03:42:26.348ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
96682024-12-14T03:42:26.348ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 17 reason = Timeout
96692024-12-14T03:42:26.348ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
96702024-12-14T03:42:26.348ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 18 reason = Timeout
96712024-12-14T03:42:26.348ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 16 reason = Timeout
96722024-12-14T03:42:26.348ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
96732024-12-14T03:42:26.348ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
96742024-12-14T03:42:26.348ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
96752024-12-14T03:42:26.348ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 46 reason = Timeout
96762024-12-14T03:42:26.348ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 16 reason = Timeout
96772024-12-14T03:42:26.348ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
96782024-12-14T03:42:26.348ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
96792024-12-14T03:42:26.348ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
96802024-12-14T03:42:26.348ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 16 reason = Timeout
96812024-12-14T03:42:26.348ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
96822024-12-14T03:42:26.348ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 46 reason = Timeout
96832024-12-14T03:42:26.348ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
96842024-12-14T03:42:26.348ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 16 reason = Timeout
96852024-12-14T03:42:26.348ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
96862024-12-14T03:42:26.348ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 16 reason = Timeout
96872024-12-14T03:42:26.348ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
96882024-12-14T03:42:26.348ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 16 reason = Timeout
96892024-12-14T03:42:26.348ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
96902024-12-14T03:42:26.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
96912024-12-14T03:42:26.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
96922024-12-14T03:42:26.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
96932024-12-14T03:42:26.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
96942024-12-14T03:42:26.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
96952024-12-14T03:42:26.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
96962024-12-14T03:42:26.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
96972024-12-14T03:42:26.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
96982024-12-14T03:42:26.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
96992024-12-14T03:42:26.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
97002024-12-14T03:42:26.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
97012024-12-14T03:42:26.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
97022024-12-14T03:42:26.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
97032024-12-14T03:42:26.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
97042024-12-14T03:42:26.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
97052024-12-14T03:42:26.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
97062024-12-14T03:42:26.351ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8d70e61c-94ed-41ce-b36c-cb904f92c534.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8d70e61c-94ed-41ce-b36c-cb904f92c534.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1552, tv_nsec: 668774708 } })
97072024-12-14T03:42:26.351ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.253165ms iteration = 16 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
97082024-12-14T03:42:26.351ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
97092024-12-14T03:42:26.351ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97102024-12-14T03:42:26.352ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8d70e61c-94ed-41ce-b36c-cb904f92c534.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8d70e61c-94ed-41ce-b36c-cb904f92c534.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1552, tv_nsec: 669782579 } })
97112024-12-14T03:42:26.352ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97122024-12-14T03:42:26.352ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
97132024-12-14T03:42:26.355ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
97142024-12-14T03:42:26.355ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
97152024-12-14T03:42:26.355ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
97162024-12-14T03:42:26.355ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
97172024-12-14T03:42:26.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
97182024-12-14T03:42:26.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
97192024-12-14T03:42:26.357ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97202024-12-14T03:42:26.358ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97212024-12-14T03:42:26.359ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
97222024-12-14T03:42:26.359ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
97232024-12-14T03:42:26.360ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
97242024-12-14T03:42:26.360ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
97252024-12-14T03:42:26.360ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
97262024-12-14T03:42:26.361ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
97272024-12-14T03:42:26.361ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
97282024-12-14T03:42:26.361ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
97292024-12-14T03:42:26.362ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97302024-12-14T03:42:26.363ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
97312024-12-14T03:42:26.364ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
97322024-12-14T03:42:26.364ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
97332024-12-14T03:42:26.364ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
97342024-12-14T03:42:26.364ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
97352024-12-14T03:42:26.364ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8d70e61c-94ed-41ce-b36c-cb904f92c534.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8d70e61c-94ed-41ce-b36c-cb904f92c534.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1552, tv_nsec: 681814629 } })
97362024-12-14T03:42:26.364ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200
97372024-12-14T03:42:26.367ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
97382024-12-14T03:42:26.367ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
97392024-12-14T03:42:26.371ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
97402024-12-14T03:42:26.371ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 22.748066ms iteration = 16 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
97412024-12-14T03:42:26.382ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
97422024-12-14T03:42:26.382ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
97432024-12-14T03:42:26.387ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
97442024-12-14T03:42:26.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
97452024-12-14T03:42:26.388ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
97462024-12-14T03:42:26.388ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
97472024-12-14T03:42:26.391ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
97482024-12-14T03:42:26.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
97492024-12-14T03:42:26.393ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
97502024-12-14T03:42:26.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
97512024-12-14T03:42:26.394ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97522024-12-14T03:42:26.397ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 8d70e61c-94ed-41ce-b36c-cb904f92c534, lookup_type: ById(8d70e61c-94ed-41ce-b36c-cb904f92c534) } result = Ok(())
97532024-12-14T03:42:26.397ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
97542024-12-14T03:42:26.397ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
97552024-12-14T03:42:26.398ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 50.132594ms iteration = 16 status = {"errors":[],"records_set_to_done":[]}
97562024-12-14T03:42:26.399ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
97572024-12-14T03:42:26.399ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
97582024-12-14T03:42:26.399ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
97592024-12-14T03:42:26.399ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
97602024-12-14T03:42:26.399ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 51.074023ms iteration = 16 status = 0
97612024-12-14T03:42:26.400ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 52.294448ms iteration = 46 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
97622024-12-14T03:42:26.401ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 52.453781ms iteration = 16 status = {"errors":[],"garbage_collect_requested":[]}
97632024-12-14T03:42:26.410ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
97642024-12-14T03:42:26.410ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
97652024-12-14T03:42:26.411ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97662024-12-14T03:42:26.411ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97672024-12-14T03:42:26.411ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d72e0220-948a-40ea-bcad-ce1aabe99913", "content-length": "26", "date": "Sat, 14 Dec 2024 03:42:26 GMT"} })
97682024-12-14T03:42:26.411ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
97692024-12-14T03:42:26.412ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
97702024-12-14T03:42:26.413ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
97712024-12-14T03:42:26.413ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
97722024-12-14T03:42:26.413ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
97732024-12-14T03:42:26.414ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
97742024-12-14T03:42:26.414ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
97752024-12-14T03:42:26.414ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
97762024-12-14T03:42:26.416ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
97772024-12-14T03:42:26.417ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
97782024-12-14T03:42:26.417ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97792024-12-14T03:42:26.419ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
97802024-12-14T03:42:26.419ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
97812024-12-14T03:42:26.419ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
97822024-12-14T03:42:26.422ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 73.626005ms iteration = 16 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
97832024-12-14T03:42:26.424ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
97842024-12-14T03:42:26.424ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
97852024-12-14T03:42:26.424ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "242f5fd3-dd82-4905-b0d7-135fe55ceaa8", "content-length": "26", "date": "Sat, 14 Dec 2024 03:42:26 GMT"} })
97862024-12-14T03:42:26.424ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
97872024-12-14T03:42:26.425ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
97882024-12-14T03:42:26.425ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
97892024-12-14T03:42:26.426ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
97902024-12-14T03:42:26.427ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 78.382459ms iteration = 16 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
97912024-12-14T03:42:26.429ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 81.121525ms iteration = 16 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
97922024-12-14T03:42:26.432ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 zone_address = fd00:1122:3344:101::2
97932024-12-14T03:42:26.432ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
97942024-12-14T03:42:26.432ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "417fc28f-f2f3-46f8-8234-827aa178a5b8", "content-length": "26", "date": "Sat, 14 Dec 2024 03:42:26 GMT"} })
97952024-12-14T03:42:26.432ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
97962024-12-14T03:42:26.432ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
97972024-12-14T03:42:26.432ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
97982024-12-14T03:42:26.432ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
97992024-12-14T03:42:26.432ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
98002024-12-14T03:42:26.434ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200
98012024-12-14T03:42:26.446ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98022024-12-14T03:42:26.449ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1, lookup_type: ById(eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1) } result = Ok(())
98032024-12-14T03:42:26.449ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
98042024-12-14T03:42:26.450ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
98052024-12-14T03:42:26.460ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1 original_time_created = 2024-12-14 03:34:51.368980 UTC target_id = eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1 time_created = 2024-12-14 03:34:51.368980 UTC
98062024-12-14T03:42:26.460ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 111.859281ms iteration = 46 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1","time_created":"2024-12-14T03:34:51.368980Z"}
98072024-12-14T03:42:26.461ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
98082024-12-14T03:42:26.461ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
98092024-12-14T03:42:26.467ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
98102024-12-14T03:42:26.467ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
98112024-12-14T03:42:26.467ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 119.282109ms iteration = 16 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
98122024-12-14T03:42:26.498ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 149.838871ms iteration = 16 status = {}
98132024-12-14T03:42:26.508ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 159.512675ms iteration = 18 status = {"physical_disks_added":0}
98142024-12-14T03:42:26.519ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
98152024-12-14T03:42:26.519ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "0ca5714b-b240-4d80-b205-f082a19f5f12", "content-length": "1", "date": "Sat, 14 Dec 2024 03:42:26 GMT"} })
98162024-12-14T03:42:26.521ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
98172024-12-14T03:42:26.521ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
98182024-12-14T03:42:26.522ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 174.094107ms iteration = 16 status = null
98192024-12-14T03:42:26.548ZINFOnexus (BackgroundTasks): VPC route manager sled 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
98202024-12-14T03:42:26.548ZDEBGnexus (BackgroundTasks): client request SledAgent = 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
98212024-12-14T03:42:26.548ZDEBGnexus (BackgroundTasks): client response SledAgent = 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "2eff4aad-7129-4405-be93-9c67062ca0ae", "content-length": "372", "date": "Sat, 14 Dec 2024 03:42:26 GMT"} })
98222024-12-14T03:42:26.548ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
98232024-12-14T03:42:26.548ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
98242024-12-14T03:42:26.550ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
98252024-12-14T03:42:26.550ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
98262024-12-14T03:42:26.552ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98272024-12-14T03:42:26.553ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
98282024-12-14T03:42:26.553ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
98292024-12-14T03:42:26.554ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
98302024-12-14T03:42:26.555ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98312024-12-14T03:42:26.556ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
98322024-12-14T03:42:26.556ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
98332024-12-14T03:42:26.556ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
98342024-12-14T03:42:26.595ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
98352024-12-14T03:42:26.595ZDEBGnexus (BackgroundTasks): client request SledAgent = 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
98362024-12-14T03:42:26.595ZDEBGnexus (BackgroundTasks): client response SledAgent = 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "6ad49a3b-d9f2-4c95-a159-fabf10e8b0a1", "date": "Sat, 14 Dec 2024 03:42:26 GMT"} })
98372024-12-14T03:42:26.595ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
98382024-12-14T03:42:26.596ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
98392024-12-14T03:42:26.598ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
98402024-12-14T03:42:26.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
98412024-12-14T03:42:26.600ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
98422024-12-14T03:42:26.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
98432024-12-14T03:42:26.602ZDEBGnexus (BackgroundTasks): client request SledAgent = 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
98442024-12-14T03:42:26.602ZDEBGnexus (BackgroundTasks): client response SledAgent = 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "8cc821f5-761d-4b50-a7fe-95b2c30676f0", "content-length": "691", "date": "Sat, 14 Dec 2024 03:42:26 GMT"} })
98452024-12-14T03:42:26.602ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
98462024-12-14T03:42:26.602ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
98472024-12-14T03:42:26.602ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
98482024-12-14T03:42:26.603ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 255.452098ms iteration = 16 status = {}
98492024-12-14T03:42:26.604ZINFOnexus (BackgroundTasks): VPC route manager sled 8d70e61c-94ed-41ce-b36c-cb904f92c534 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
98502024-12-14T03:42:26.604ZDEBGnexus (BackgroundTasks): client request SledAgent = 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
98512024-12-14T03:42:26.605ZDEBGnexus (BackgroundTasks): client response SledAgent = 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "81c47faa-3169-4389-8120-e8400698e580", "date": "Sat, 14 Dec 2024 03:42:26 GMT"} })
98522024-12-14T03:42:26.606ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
98532024-12-14T03:42:26.606ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 258.293075ms iteration = 17 status = {}
98542024-12-14T03:42:26.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
98552024-12-14T03:42:26.609ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 45ca990e-42e9-4264-be3e-0adfed2cd99b, rack_id: a121ca05-bbee-41bf-b9db-9e03ff035200, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(811a570a-bdaf-4a1b-8eba-0c0e4977f7bb) } rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 switch_location = Switch0
98562024-12-14T03:42:26.609ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
98572024-12-14T03:42:26.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
98582024-12-14T03:42:26.618ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
98592024-12-14T03:42:26.618ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "416218a2-43b4-4c3a-bf5e-f2c33fb5feaa", "content-length": "134", "date": "Sat, 14 Dec 2024 03:42:26 GMT"} })
98602024-12-14T03:42:26.618ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
98612024-12-14T03:42:26.618ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 811a570a-bdaf-4a1b-8eba-0c0e4977f7bb
98622024-12-14T03:42:26.619ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
98632024-12-14T03:42:26.619ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
98642024-12-14T03:42:26.619ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
98652024-12-14T03:42:26.619ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
98662024-12-14T03:42:26.619ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
98672024-12-14T03:42:26.619ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
98682024-12-14T03:42:26.619ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
98692024-12-14T03:42:26.619ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
98702024-12-14T03:42:26.619ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200
98712024-12-14T03:42:26.619ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
98722024-12-14T03:42:26.619ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
98732024-12-14T03:42:26.621ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
98742024-12-14T03:42:26.621ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "61d8b80b-eaf3-4556-a082-8b6f82c1fa1b", "content-length": "2", "date": "Sat, 14 Dec 2024 03:42:26 GMT"} })
98752024-12-14T03:42:26.621ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
98762024-12-14T03:42:26.622ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "323f5508-c99a-4af7-876b-a8a4a360f33e", "content-length": "52", "date": "Sat, 14 Dec 2024 03:42:26 GMT"} })
98772024-12-14T03:42:26.622ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 switch_location = Switch0
98782024-12-14T03:42:26.622ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
98792024-12-14T03:42:26.716ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "48c09966-575a-47ab-8b7c-6fc73d3f6a14", "date": "Sat, 14 Dec 2024 03:42:26 GMT"} })
98802024-12-14T03:42:26.716ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 switch = Switch0
98812024-12-14T03:42:26.716ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
98822024-12-14T03:42:26.716ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "2bc82cd3-0695-47ef-ab23-80228a277dc8", "content-length": "682", "date": "Sat, 14 Dec 2024 03:42:26 GMT"} })
98832024-12-14T03:42:26.716ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
98842024-12-14T03:42:26.717ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
98852024-12-14T03:42:26.720ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
98862024-12-14T03:42:26.720ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
98872024-12-14T03:42:26.723ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
98882024-12-14T03:42:26.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
98892024-12-14T03:42:26.726ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
98902024-12-14T03:42:26.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
98912024-12-14T03:42:26.733ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 384.773578ms iteration = 16 status = {}
98922024-12-14T03:42:35.613ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1027 local_addr = [fd00:1122:3344:101::b]:56585 method = GET remote_addr = [fd00:1122:3344:101::d]:58979 req_id = b03ab8fe-3332-4f97-9cd4-f6e2f65713d8 response_code = 200 uri = /5f2fe413-3c4a-4994-b4a0-995c1da486b1
98932024-12-14T03:42:36.348ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 47 reason = Timeout
98942024-12-14T03:42:36.348ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
98952024-12-14T03:42:36.348ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 47 reason = Timeout
98962024-12-14T03:42:36.348ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
98972024-12-14T03:42:36.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
98982024-12-14T03:42:36.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
98992024-12-14T03:42:36.350ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99002024-12-14T03:42:36.352ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
99012024-12-14T03:42:36.352ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
99022024-12-14T03:42:36.353ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
99032024-12-14T03:42:36.355ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
99042024-12-14T03:42:36.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
99052024-12-14T03:42:36.356ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99062024-12-14T03:42:36.359ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1, lookup_type: ById(eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1) } result = Ok(())
99072024-12-14T03:42:36.359ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
99082024-12-14T03:42:36.359ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
99092024-12-14T03:42:36.371ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1 original_time_created = 2024-12-14 03:34:51.368980 UTC target_id = eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1 time_created = 2024-12-14 03:34:51.368980 UTC
99102024-12-14T03:42:36.371ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.367758ms iteration = 47 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1","time_created":"2024-12-14T03:34:51.368980Z"}
99112024-12-14T03:42:36.378ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
99122024-12-14T03:42:36.378ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
99132024-12-14T03:42:36.411ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 63.233347ms iteration = 47 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
99142024-12-14T03:42:45.613ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1203 local_addr = [fd00:1122:3344:101::b]:56585 method = GET remote_addr = [fd00:1122:3344:101::d]:58979 req_id = f7530ae0-1869-4e4d-949e-759e4217b0d4 response_code = 200 uri = /5f2fe413-3c4a-4994-b4a0-995c1da486b1
99152024-12-14T03:42:46.348ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 48 reason = Timeout
99162024-12-14T03:42:46.348ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
99172024-12-14T03:42:46.348ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 48 reason = Timeout
99182024-12-14T03:42:46.348ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
99192024-12-14T03:42:46.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
99202024-12-14T03:42:46.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
99212024-12-14T03:42:46.350ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
99222024-12-14T03:42:46.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
99232024-12-14T03:42:46.350ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99242024-12-14T03:42:46.352ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.911289ms iteration = 48 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
99252024-12-14T03:42:46.353ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
99262024-12-14T03:42:46.353ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
99272024-12-14T03:42:46.353ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
99282024-12-14T03:42:46.355ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
99292024-12-14T03:42:46.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
99302024-12-14T03:42:46.356ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99312024-12-14T03:42:46.359ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1, lookup_type: ById(eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1) } result = Ok(())
99322024-12-14T03:42:46.359ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
99332024-12-14T03:42:46.359ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
99342024-12-14T03:42:46.370ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1 original_time_created = 2024-12-14 03:34:51.368980 UTC target_id = eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1 time_created = 2024-12-14 03:34:51.368980 UTC
99352024-12-14T03:42:46.370ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.307277ms iteration = 48 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1","time_created":"2024-12-14T03:34:51.368980Z"}
99362024-12-14T03:42:55.613ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1094 local_addr = [fd00:1122:3344:101::b]:56585 method = GET remote_addr = [fd00:1122:3344:101::d]:58979 req_id = 65aef140-3df5-4000-819f-47bb42c9f6b5 response_code = 200 uri = /5f2fe413-3c4a-4994-b4a0-995c1da486b1
99372024-12-14T03:42:56.348ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 19 reason = Timeout
99382024-12-14T03:42:56.348ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
99392024-12-14T03:42:56.348ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 10 reason = Timeout
99402024-12-14T03:42:56.348ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
99412024-12-14T03:42:56.348ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 17 reason = Timeout
99422024-12-14T03:42:56.348ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
99432024-12-14T03:42:56.348ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
99442024-12-14T03:42:56.348ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 9 reason = Timeout
99452024-12-14T03:42:56.348ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
99462024-12-14T03:42:56.348ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 49 reason = Timeout
99472024-12-14T03:42:56.348ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
99482024-12-14T03:42:56.348ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 9 reason = Timeout
99492024-12-14T03:42:56.348ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
99502024-12-14T03:42:56.348ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 9 reason = Timeout
99512024-12-14T03:42:56.348ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
99522024-12-14T03:42:56.348ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
99532024-12-14T03:42:56.348ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 17 reason = Timeout
99542024-12-14T03:42:56.348ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
99552024-12-14T03:42:56.348ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 49 reason = Timeout
99562024-12-14T03:42:56.348ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
99572024-12-14T03:42:56.348ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 11 reason = Timeout
99582024-12-14T03:42:56.348ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 17 reason = Timeout
99592024-12-14T03:42:56.348ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
99602024-12-14T03:42:56.348ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 9 reason = Timeout
99612024-12-14T03:42:56.348ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-14 03:32:56.348359039 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
99622024-12-14T03:42:56.348ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
99632024-12-14T03:42:56.348ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 17 reason = Timeout
99642024-12-14T03:42:56.348ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 10 reason = Timeout
99652024-12-14T03:42:56.348ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 17 reason = Timeout
99662024-12-14T03:42:56.348ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 17 reason = Timeout
99672024-12-14T03:42:56.348ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
99682024-12-14T03:42:56.348ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 9 reason = Timeout
99692024-12-14T03:42:56.348ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
99702024-12-14T03:42:56.348ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
99712024-12-14T03:42:56.348ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 10 reason = Timeout
99722024-12-14T03:42:56.348ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1
99732024-12-14T03:42:56.348ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 20.97\u{b5}s iteration = 10 status = {"enabled":false,"target_id":"eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1"}
99742024-12-14T03:42:56.348ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 17 reason = Timeout
99752024-12-14T03:42:56.348ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
99762024-12-14T03:42:56.348ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 10 reason = Timeout
99772024-12-14T03:42:56.348ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 10 reason = Timeout
99782024-12-14T03:42:56.348ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 18 reason = Timeout
99792024-12-14T03:42:56.348ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
99802024-12-14T03:42:56.348ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
99812024-12-14T03:42:56.348ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 17 reason = Timeout
99822024-12-14T03:42:56.348ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
99832024-12-14T03:42:56.348ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
99842024-12-14T03:42:56.348ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
99852024-12-14T03:42:56.348ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 17 reason = Timeout
99862024-12-14T03:42:56.348ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
99872024-12-14T03:42:56.348ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
99882024-12-14T03:42:56.348ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 11 reason = Timeout
99892024-12-14T03:42:56.348ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 17 reason = Timeout
99902024-12-14T03:42:56.348ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
99912024-12-14T03:42:56.348ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 10 reason = Timeout
99922024-12-14T03:42:56.348ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
99932024-12-14T03:42:56.348ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 17 reason = Timeout
99942024-12-14T03:42:56.348ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
99952024-12-14T03:42:56.348ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 17 reason = Timeout
99962024-12-14T03:42:56.348ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
99972024-12-14T03:42:56.349ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 17 reason = Timeout
99982024-12-14T03:42:56.349ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
99992024-12-14T03:42:56.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
100002024-12-14T03:42:56.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
100012024-12-14T03:42:56.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
100022024-12-14T03:42:56.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
100032024-12-14T03:42:56.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
100042024-12-14T03:42:56.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
100052024-12-14T03:42:56.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
100062024-12-14T03:42:56.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
100072024-12-14T03:42:56.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
100082024-12-14T03:42:56.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100092024-12-14T03:42:56.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
100102024-12-14T03:42:56.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
100112024-12-14T03:42:56.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
100122024-12-14T03:42:56.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
100132024-12-14T03:42:56.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
100142024-12-14T03:42:56.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
100152024-12-14T03:42:56.349ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("3db8556d-0ae0-4824-8953-f38d8eef7409.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7b672843-049d-4d9c-b0a2-21d7b6323621.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("db39fe07-65c4-451a-a2bd-78fcdfc10040.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("db39fe07-65c4-451a-a2bd-78fcdfc10040.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1582, tv_nsec: 666235024 } })
100162024-12-14T03:42:56.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
100172024-12-14T03:42:56.349ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("28f528f1-3159-4fbc-9304-37b7e4a50ae8.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7274e15f-a5f6-4975-bcdd-a2ef890c0230.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("7274e15f-a5f6-4975-bcdd-a2ef890c0230.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1582, tv_nsec: 666262945 } })
100182024-12-14T03:42:56.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
100192024-12-14T03:42:56.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
100202024-12-14T03:42:56.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
100212024-12-14T03:42:56.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
100222024-12-14T03:42:56.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
100232024-12-14T03:42:56.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
100242024-12-14T03:42:56.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
100252024-12-14T03:42:56.349ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
100262024-12-14T03:42:56.349ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.386638ms iteration = 10 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
100272024-12-14T03:42:56.349ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
100282024-12-14T03:42:56.349ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.307266ms iteration = 10 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
100292024-12-14T03:42:56.350ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100302024-12-14T03:42:56.350ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
100312024-12-14T03:42:56.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
100322024-12-14T03:42:56.351ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
100332024-12-14T03:42:56.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
100342024-12-14T03:42:56.352ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 4.376237ms iteration = 9 status = {"errors":[],"found_port_ok":[]}
100352024-12-14T03:42:56.352ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.279946ms iteration = 17 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
100362024-12-14T03:42:56.352ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
100372024-12-14T03:42:56.352ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
100382024-12-14T03:42:56.352ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
100392024-12-14T03:42:56.356ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100402024-12-14T03:42:56.356ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8d70e61c-94ed-41ce-b36c-cb904f92c534.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8d70e61c-94ed-41ce-b36c-cb904f92c534.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1582, tv_nsec: 673453289 } })
100412024-12-14T03:42:56.356ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
100422024-12-14T03:42:56.357ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-14 03:32:56.348359039 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
100432024-12-14T03:42:56.357ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 8.661363ms iteration = 9 status = {"expiration":"2024-12-14T03:32:56.348359039Z","pruned":[]}
100442024-12-14T03:42:56.359ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
100452024-12-14T03:42:56.359ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100462024-12-14T03:42:56.360ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100472024-12-14T03:42:56.362ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
100482024-12-14T03:42:56.362ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
100492024-12-14T03:42:56.362ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
100502024-12-14T03:42:56.363ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
100512024-12-14T03:42:56.365ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8d70e61c-94ed-41ce-b36c-cb904f92c534.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8d70e61c-94ed-41ce-b36c-cb904f92c534.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1582, tv_nsec: 682252505 } })
100522024-12-14T03:42:56.365ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
100532024-12-14T03:42:56.366ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100542024-12-14T03:42:56.366ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
100552024-12-14T03:42:56.366ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
100562024-12-14T03:42:56.368ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
100572024-12-14T03:42:56.372ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100582024-12-14T03:42:56.372ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100592024-12-14T03:42:56.379ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100602024-12-14T03:42:56.382ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
100612024-12-14T03:42:56.391ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100622024-12-14T03:42:56.391ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100632024-12-14T03:42:56.394ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
100642024-12-14T03:42:56.394ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
100652024-12-14T03:42:56.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
100662024-12-14T03:42:56.394ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100672024-12-14T03:42:56.395ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
100682024-12-14T03:42:56.395ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
100692024-12-14T03:42:56.396ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100702024-12-14T03:42:56.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
100712024-12-14T03:42:56.398ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
100722024-12-14T03:42:56.398ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
100732024-12-14T03:42:56.399ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
100742024-12-14T03:42:56.399ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
100752024-12-14T03:42:56.399ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
100762024-12-14T03:42:56.399ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
100772024-12-14T03:42:56.402ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
100782024-12-14T03:42:56.402ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
100792024-12-14T03:42:56.407ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
100802024-12-14T03:42:56.407ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
100812024-12-14T03:42:56.407ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 59.023803ms iteration = 9 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
100822024-12-14T03:42:56.408ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100832024-12-14T03:42:56.408ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100842024-12-14T03:42:56.411ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8d70e61c-94ed-41ce-b36c-cb904f92c534.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8d70e61c-94ed-41ce-b36c-cb904f92c534.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1582, tv_nsec: 728134995 } })
100852024-12-14T03:42:56.411ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
100862024-12-14T03:42:56.411ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
100872024-12-14T03:42:56.411ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100882024-12-14T03:42:56.411ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
100892024-12-14T03:42:56.411ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200
100902024-12-14T03:42:56.412ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
100912024-12-14T03:42:56.412ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1, lookup_type: ById(eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1) } result = Ok(())
100922024-12-14T03:42:56.412ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100932024-12-14T03:42:56.412ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100942024-12-14T03:42:56.412ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
100952024-12-14T03:42:56.413ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100962024-12-14T03:42:56.413ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
100972024-12-14T03:42:56.413ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
100982024-12-14T03:42:56.414ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
100992024-12-14T03:42:56.414ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
101002024-12-14T03:42:56.414ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 65.655236ms iteration = 17 status = {"errors":[],"records_set_to_done":[]}
101012024-12-14T03:42:56.414ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
101022024-12-14T03:42:56.415ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
101032024-12-14T03:42:56.415ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
101042024-12-14T03:42:56.415ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
101052024-12-14T03:42:56.415ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 67.069104ms iteration = 17 status = {"errors":[],"garbage_collect_requested":[]}
101062024-12-14T03:42:56.417ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 69.091214ms iteration = 17 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
101072024-12-14T03:42:56.417ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101082024-12-14T03:42:56.418ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
101092024-12-14T03:42:56.418ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
101102024-12-14T03:42:56.418ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 69.734707ms iteration = 17 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
101112024-12-14T03:42:56.418ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 70.536333ms iteration = 49 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
101122024-12-14T03:42:56.420ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
101132024-12-14T03:42:56.420ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
101142024-12-14T03:42:56.420ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
101152024-12-14T03:42:56.421ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101162024-12-14T03:42:56.423ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
101172024-12-14T03:42:56.423ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
101182024-12-14T03:42:56.423ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
101192024-12-14T03:42:56.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
101202024-12-14T03:42:56.424ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
101212024-12-14T03:42:56.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
101222024-12-14T03:42:56.425ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
101232024-12-14T03:42:56.425ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
101242024-12-14T03:42:56.425ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
101252024-12-14T03:42:56.425ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
101262024-12-14T03:42:56.425ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
101272024-12-14T03:42:56.425ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
101282024-12-14T03:42:56.425ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
101292024-12-14T03:42:56.425ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
101302024-12-14T03:42:56.426ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101312024-12-14T03:42:56.428ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
101322024-12-14T03:42:56.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
101332024-12-14T03:42:56.429ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
101342024-12-14T03:42:56.429ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
101352024-12-14T03:42:56.429ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
101362024-12-14T03:42:56.430ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
101372024-12-14T03:42:56.430ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
101382024-12-14T03:42:56.430ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
101392024-12-14T03:42:56.430ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
101402024-12-14T03:42:56.430ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1 original_time_created = 2024-12-14 03:34:51.368980 UTC target_id = eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1 time_created = 2024-12-14 03:34:51.368980 UTC
101412024-12-14T03:42:56.430ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 81.981532ms iteration = 49 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1","time_created":"2024-12-14T03:34:51.368980Z"}
101422024-12-14T03:42:56.430ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
101432024-12-14T03:42:56.430ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
101442024-12-14T03:42:56.430ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
101452024-12-14T03:42:56.431ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
101462024-12-14T03:42:56.431ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 51f6df17-b3b5-47fe-9a42-d8752f961c5e dns_zone_name = oxide.test found_so_far = 0 version = 2
101472024-12-14T03:42:56.431ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
101482024-12-14T03:42:56.432ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
101492024-12-14T03:42:56.432ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101502024-12-14T03:42:56.432ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
101512024-12-14T03:42:56.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
101522024-12-14T03:42:56.437ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
101532024-12-14T03:42:56.437ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
101542024-12-14T03:42:56.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
101552024-12-14T03:42:56.437ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
101562024-12-14T03:42:56.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
101572024-12-14T03:42:56.438ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101582024-12-14T03:42:56.441ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 8d70e61c-94ed-41ce-b36c-cb904f92c534, lookup_type: ById(8d70e61c-94ed-41ce-b36c-cb904f92c534) } result = Ok(())
101592024-12-14T03:42:56.441ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
101602024-12-14T03:42:56.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
101612024-12-14T03:42:56.442ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
101622024-12-14T03:42:56.442ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
101632024-12-14T03:42:56.442ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 94.354359ms iteration = 9 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
101642024-12-14T03:42:56.443ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 95.665856ms iteration = 17 status = 0
101652024-12-14T03:42:56.455ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
101662024-12-14T03:42:56.455ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
101672024-12-14T03:42:56.455ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
101682024-12-14T03:42:56.455ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
101692024-12-14T03:42:56.460ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 112.188537ms iteration = 19 status = {"physical_disks_added":0}
101702024-12-14T03:42:56.461ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
101712024-12-14T03:42:56.461ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 112.942823ms iteration = 17 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
101722024-12-14T03:42:56.469ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
101732024-12-14T03:42:56.470ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
101742024-12-14T03:42:56.471ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 122.382161ms iteration = 17 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
101752024-12-14T03:42:56.471ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101762024-12-14T03:42:56.473ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
101772024-12-14T03:42:56.473ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
101782024-12-14T03:42:56.474ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
101792024-12-14T03:42:56.475ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
101802024-12-14T03:42:56.476ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
101812024-12-14T03:42:56.476ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = c7a5bbe9-1af5-4e36-80b5-da9e0053b676 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
101822024-12-14T03:42:56.476ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
101832024-12-14T03:42:56.476ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
101842024-12-14T03:42:56.478ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101852024-12-14T03:42:56.481ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
101862024-12-14T03:42:56.481ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
101872024-12-14T03:42:56.481ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
101882024-12-14T03:42:56.482ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101892024-12-14T03:42:56.484ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = c7a5bbe9-1af5-4e36-80b5-da9e0053b676 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
101902024-12-14T03:42:56.484ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
101912024-12-14T03:42:56.484ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-14 03:35:40.104814 UTC dns_group = internal generation = 1
101922024-12-14T03:42:56.484ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 135.863521ms iteration = 10 status = {"generation":1}
101932024-12-14T03:42:56.484ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
101942024-12-14T03:42:56.484ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
101952024-12-14T03:42:56.484ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
101962024-12-14T03:42:56.486ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 51f6df17-b3b5-47fe-9a42-d8752f961c5e dns_zone_name = oxide.test found_so_far = 1 version = 2
101972024-12-14T03:42:56.486ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
101982024-12-14T03:42:56.486ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-14 03:35:40.905586 UTC dns_group = external generation = 2
101992024-12-14T03:42:56.486ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 138.557706ms iteration = 10 status = {"generation":2}
102002024-12-14T03:42:56.493ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
102012024-12-14T03:42:56.502ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
102022024-12-14T03:42:56.502ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
102032024-12-14T03:42:56.502ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 153.853732ms iteration = 17 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
102042024-12-14T03:42:56.510ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
102052024-12-14T03:42:56.510ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
102062024-12-14T03:42:56.511ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "de1e2293-6b42-4b93-bfe7-b58aaad55794", "content-length": "26", "date": "Sat, 14 Dec 2024 03:42:56 GMT"} })
102072024-12-14T03:42:56.511ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
102082024-12-14T03:42:56.512ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
102092024-12-14T03:42:56.513ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
102102024-12-14T03:42:56.513ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
102112024-12-14T03:42:56.513ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1641be26-b147-40e8-b135-2aa7f4e003c9", "content-length": "26", "date": "Sat, 14 Dec 2024 03:42:56 GMT"} })
102122024-12-14T03:42:56.513ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
102132024-12-14T03:42:56.516ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
102142024-12-14T03:42:56.517ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-14T03:34:54.541856Z, time_modified: 2024-12-14T03:34:54.541856Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, db_silo: Silo { identity: SiloIdentity { id: 578bc52c-ac81-41a6-a56b-dfc79805368e, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-14T03:35:40.848931Z, time_modified: 2024-12-14T03:35:40.848931Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "4dfc5e49ed154568e7a05c630983c79e7ad097d55e90f834bee8ffda0c5a5c9e" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, db_silo: Silo { identity: SiloIdentity { id: 578bc52c-ac81-41a6-a56b-dfc79805368e, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-14T03:35:40.848931Z, time_modified: 2024-12-14T03:35:40.848931Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "4dfc5e49ed154568e7a05c630983c79e7ad097d55e90f834bee8ffda0c5a5c9e" }] }) }
102152024-12-14T03:42:56.517ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 168.613168ms iteration = 10 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"578bc52c-ac81-41a6-a56b-dfc79805368e","tls_certs":["4dfc5e49ed154568e7a05c630983c79e7ad097d55e90f834bee8ffda0c5a5c9e"]}},"default_endpoint":{"silo_id":"578bc52c-ac81-41a6-a56b-dfc79805368e","tls_certs":["4dfc5e49ed154568e7a05c630983c79e7ad097d55e90f834bee8ffda0c5a5c9e"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
102162024-12-14T03:42:56.524ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
102172024-12-14T03:42:56.524ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
102182024-12-14T03:42:56.528ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
102192024-12-14T03:42:56.528ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 179.878983ms iteration = 9 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
102202024-12-14T03:42:56.552ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102212024-12-14T03:42:56.553ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
102222024-12-14T03:42:56.553ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
102232024-12-14T03:42:56.553ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
102242024-12-14T03:42:56.555ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102252024-12-14T03:42:56.557ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
102262024-12-14T03:42:56.557ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
102272024-12-14T03:42:56.557ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
102282024-12-14T03:42:56.643ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 zone_address = fd00:1122:3344:101::2
102292024-12-14T03:42:56.643ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
102302024-12-14T03:42:56.643ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e47e67f1-62d4-4806-9030-133c88549920", "content-length": "26", "date": "Sat, 14 Dec 2024 03:42:56 GMT"} })
102312024-12-14T03:42:56.643ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
102322024-12-14T03:42:56.645ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200
102332024-12-14T03:42:56.656ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
102342024-12-14T03:42:56.656ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "9bfa793d-66fa-4db1-ad40-cc8c6ec1dd52", "date": "Sat, 14 Dec 2024 03:42:56 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
102352024-12-14T03:42:56.656ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
102362024-12-14T03:42:56.659ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "5806bd69-51ee-4311-9443-11c0ce140d5c", "date": "Sat, 14 Dec 2024 03:42:56 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
102372024-12-14T03:42:56.659ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
102382024-12-14T03:42:56.660ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
102392024-12-14T03:42:56.660ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 312.031041ms iteration = 11 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
102402024-12-14T03:42:56.673ZINFOnexus (BackgroundTasks): VPC route manager sled 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
102412024-12-14T03:42:56.673ZDEBGnexus (BackgroundTasks): client request SledAgent = 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
102422024-12-14T03:42:56.674ZDEBGnexus (BackgroundTasks): client response SledAgent = 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "aef75546-a88c-4c15-8eb9-43deb20ed83a", "content-length": "372", "date": "Sat, 14 Dec 2024 03:42:56 GMT"} })
102432024-12-14T03:42:56.674ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
102442024-12-14T03:42:56.674ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
102452024-12-14T03:42:56.681ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 332.834058ms iteration = 17 status = {}
102462024-12-14T03:42:56.690ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
102472024-12-14T03:42:56.690ZDEBGnexus (BackgroundTasks): client request SledAgent = 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
102482024-12-14T03:42:56.691ZDEBGnexus (BackgroundTasks): client response SledAgent = 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "9f5c38f9-91af-4b9b-9efc-8c86319aeac8", "date": "Sat, 14 Dec 2024 03:42:56 GMT"} })
102492024-12-14T03:42:56.691ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
102502024-12-14T03:42:56.691ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
102512024-12-14T03:42:56.693ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
102522024-12-14T03:42:56.693ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
102532024-12-14T03:42:56.697ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
102542024-12-14T03:42:56.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
102552024-12-14T03:42:56.699ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
102562024-12-14T03:42:56.722ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
102572024-12-14T03:42:56.723ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "8f040d68-2d06-43fe-b922-e06d8e355a62", "content-length": "1", "date": "Sat, 14 Dec 2024 03:42:55 GMT"} })
102582024-12-14T03:42:56.724ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
102592024-12-14T03:42:56.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
102602024-12-14T03:42:56.821ZDEBGnexus (BackgroundTasks): client request SledAgent = 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
102612024-12-14T03:42:56.822ZDEBGnexus (BackgroundTasks): client response SledAgent = 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "240af74b-03ac-43ac-99e1-b777d2f26b57", "content-length": "691", "date": "Sat, 14 Dec 2024 03:42:56 GMT"} })
102622024-12-14T03:42:56.822ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
102632024-12-14T03:42:56.822ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
102642024-12-14T03:42:56.822ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
102652024-12-14T03:42:56.823ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 475.062677ms iteration = 17 status = {}
102662024-12-14T03:42:56.824ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 475.70042ms iteration = 17 status = null
102672024-12-14T03:42:56.825ZINFOnexus (BackgroundTasks): VPC route manager sled 8d70e61c-94ed-41ce-b36c-cb904f92c534 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
102682024-12-14T03:42:56.825ZDEBGnexus (BackgroundTasks): client request SledAgent = 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
102692024-12-14T03:42:56.825ZDEBGnexus (BackgroundTasks): client response SledAgent = 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "797ea0c0-8e4f-4a0f-b0ef-7854a8a1d94d", "date": "Sat, 14 Dec 2024 03:42:56 GMT"} })
102702024-12-14T03:42:56.827ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 479.145879ms iteration = 18 status = {}
102712024-12-14T03:42:56.847ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
102722024-12-14T03:42:56.847ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "2e5fab67-40d7-4fe3-862e-fc89f9ba8933", "date": "Sat, 14 Dec 2024 03:42:56 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
102732024-12-14T03:42:56.847ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
102742024-12-14T03:42:56.849ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "6ce4740c-eb53-4132-af28-496034f18f07", "date": "Sat, 14 Dec 2024 03:42:56 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
102752024-12-14T03:42:56.849ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
102762024-12-14T03:42:56.850ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "5cc5a61c-d36b-4c93-88c9-aace48fbc0ae", "date": "Sat, 14 Dec 2024 03:42:56 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
102772024-12-14T03:42:56.850ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
102782024-12-14T03:42:56.852ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
102792024-12-14T03:42:56.852ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 504.323623ms iteration = 11 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
102802024-12-14T03:42:56.866ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
102812024-12-14T03:42:56.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
102822024-12-14T03:42:56.868ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 45ca990e-42e9-4264-be3e-0adfed2cd99b, rack_id: a121ca05-bbee-41bf-b9db-9e03ff035200, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(811a570a-bdaf-4a1b-8eba-0c0e4977f7bb) } rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 switch_location = Switch0
102832024-12-14T03:42:56.868ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
102842024-12-14T03:42:56.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
102852024-12-14T03:42:56.877ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
102862024-12-14T03:42:56.878ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "4fb80ae5-1896-4937-9c83-ac0eda5c616f", "content-length": "134", "date": "Sat, 14 Dec 2024 03:42:56 GMT"} })
102872024-12-14T03:42:56.878ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
102882024-12-14T03:42:56.878ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 811a570a-bdaf-4a1b-8eba-0c0e4977f7bb
102892024-12-14T03:42:56.878ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
102902024-12-14T03:42:56.878ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
102912024-12-14T03:42:56.878ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
102922024-12-14T03:42:56.878ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
102932024-12-14T03:42:56.878ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
102942024-12-14T03:42:56.878ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
102952024-12-14T03:42:56.878ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
102962024-12-14T03:42:56.878ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
102972024-12-14T03:42:56.878ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200
102982024-12-14T03:42:56.878ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
102992024-12-14T03:42:56.879ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
103002024-12-14T03:42:56.881ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
103012024-12-14T03:42:56.881ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "a52dedcc-e6d8-4e79-ae79-ff8982f069ee", "content-length": "2", "date": "Sat, 14 Dec 2024 03:42:56 GMT"} })
103022024-12-14T03:42:56.881ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
103032024-12-14T03:42:56.881ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "c65dc2d2-ed34-4c7f-94dd-24c6937e3678", "content-length": "52", "date": "Sat, 14 Dec 2024 03:42:56 GMT"} })
103042024-12-14T03:42:56.881ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 switch_location = Switch0
103052024-12-14T03:42:56.881ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
103062024-12-14T03:42:56.974ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "f3bbb4aa-65f2-4c18-afd9-1b70be799bf2", "date": "Sat, 14 Dec 2024 03:42:56 GMT"} })
103072024-12-14T03:42:56.974ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 switch = Switch0
103082024-12-14T03:42:56.974ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
103092024-12-14T03:42:56.974ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "b6774b32-ef94-4a6d-8b8d-62899969ef6c", "content-length": "682", "date": "Sat, 14 Dec 2024 03:42:56 GMT"} })
103102024-12-14T03:42:56.974ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
103112024-12-14T03:42:56.974ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
103122024-12-14T03:42:56.977ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
103132024-12-14T03:42:56.977ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
103142024-12-14T03:42:56.979ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
103152024-12-14T03:42:56.980ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
103162024-12-14T03:42:56.982ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
103172024-12-14T03:42:56.982ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
103182024-12-14T03:42:56.989ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 641.037053ms iteration = 17 status = {}
103192024-12-14T03:42:57.270ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:38187
103202024-12-14T03:42:57.270ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:38187 req_id = 52991939-920f-4b86-a5e1-1e57bde53c6d roles = RoleSet { roles: {} } uri = /metrics/producers
103212024-12-14T03:42:57.270ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:38187 req_id = 52991939-920f-4b86-a5e1-1e57bde53c6d resource = Database result = Ok(()) uri = /metrics/producers
103222024-12-14T03:42:57.321ZINFOnexus: assigned collector to new producer collector_id = a321e00a-3126-4ea4-b26d-c0e3eea69166 file = nexus/src/app/oximeter.rs:76 producer_id = db02be0a-738a-45e5-a854-a5c5be80bed4
103232024-12-14T03:42:57.321ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 51246 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:38187 req_id = 52991939-920f-4b86-a5e1-1e57bde53c6d response_code = 201 uri = /metrics/producers
103242024-12-14T03:43:05.614ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1013 local_addr = [fd00:1122:3344:101::b]:56585 method = GET remote_addr = [fd00:1122:3344:101::d]:58979 req_id = 6e751d7a-5e58-4c49-8e84-c28f36c7b47d response_code = 200 uri = /5f2fe413-3c4a-4994-b4a0-995c1da486b1
103252024-12-14T03:43:06.348ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 50 reason = Timeout
103262024-12-14T03:43:06.348ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 50 reason = Timeout
103272024-12-14T03:43:06.348ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
103282024-12-14T03:43:06.348ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
103292024-12-14T03:43:06.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
103302024-12-14T03:43:06.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
103312024-12-14T03:43:06.350ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103322024-12-14T03:43:06.351ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
103332024-12-14T03:43:06.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
103342024-12-14T03:43:06.353ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
103352024-12-14T03:43:06.353ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
103362024-12-14T03:43:06.353ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
103372024-12-14T03:43:06.355ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
103382024-12-14T03:43:06.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
103392024-12-14T03:43:06.357ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103402024-12-14T03:43:06.360ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1, lookup_type: ById(eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1) } result = Ok(())
103412024-12-14T03:43:06.360ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
103422024-12-14T03:43:06.360ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
103432024-12-14T03:43:06.369ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1 original_time_created = 2024-12-14 03:34:51.368980 UTC target_id = eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1 time_created = 2024-12-14 03:34:51.368980 UTC
103442024-12-14T03:43:06.369ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.565072ms iteration = 50 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1","time_created":"2024-12-14T03:34:51.368980Z"}
103452024-12-14T03:43:06.380ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.785067ms iteration = 50 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
103462024-12-14T03:43:08.792ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:33952
103472024-12-14T03:43:08.792ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:33952 req_id = b4abcaae-bfb1-4088-bfdb-8237009017c4 roles = RoleSet { roles: {} } uri = /metrics/producers
103482024-12-14T03:43:08.793ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:33952 req_id = b4abcaae-bfb1-4088-bfdb-8237009017c4 resource = Database result = Ok(()) uri = /metrics/producers
103492024-12-14T03:43:08.827ZINFOnexus: assigned collector to new producer collector_id = a321e00a-3126-4ea4-b26d-c0e3eea69166 file = nexus/src/app/oximeter.rs:76 producer_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534
103502024-12-14T03:43:08.827ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 34980 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:33952 req_id = b4abcaae-bfb1-4088-bfdb-8237009017c4 response_code = 201 uri = /metrics/producers
103512024-12-14T03:43:10.603ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:56805 req_id = 72bf3210-12b9-4e36-9f87-b716cd44384c roles = RoleSet { roles: {} } uri = /metrics/collectors/a321e00a-3126-4ea4-b26d-c0e3eea69166/producers?sort_by=id_ascending
103522024-12-14T03:43:10.604ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:56805 req_id = 72bf3210-12b9-4e36-9f87-b716cd44384c resource = Database result = Ok(()) uri = /metrics/collectors/a321e00a-3126-4ea4-b26d-c0e3eea69166/producers?sort_by=id_ascending
103532024-12-14T03:43:10.607ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3171 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:56805 req_id = 72bf3210-12b9-4e36-9f87-b716cd44384c response_code = 200 uri = /metrics/collectors/a321e00a-3126-4ea4-b26d-c0e3eea69166/producers?sort_by=id_ascending
103542024-12-14T03:43:10.607ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:56805 req_id = 01a97a6b-a06e-4ce0-82b6-10ecae6013e7 roles = RoleSet { roles: {} } uri = /metrics/collectors/a321e00a-3126-4ea4-b26d-c0e3eea69166/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlOGQ5NjQ2Zi1hNTQxLTRjMTEtYjViMi1mOTUzNDI3Y2EyZjMifX0%3D
103552024-12-14T03:43:10.607ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:56805 req_id = 01a97a6b-a06e-4ce0-82b6-10ecae6013e7 resource = Database result = Ok(()) uri = /metrics/collectors/a321e00a-3126-4ea4-b26d-c0e3eea69166/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlOGQ5NjQ2Zi1hNTQxLTRjMTEtYjViMi1mOTUzNDI3Y2EyZjMifX0%3D
103562024-12-14T03:43:10.609ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2319 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:56805 req_id = 01a97a6b-a06e-4ce0-82b6-10ecae6013e7 response_code = 200 uri = /metrics/collectors/a321e00a-3126-4ea4-b26d-c0e3eea69166/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlOGQ5NjQ2Zi1hNTQxLTRjMTEtYjViMi1mOTUzNDI3Y2EyZjMifX0%3D
103572024-12-14T03:43:11.694ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
103582024-12-14T03:43:11.694ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::b]:12221
103592024-12-14T03:43:11.724ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
103602024-12-14T03:43:11.724ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::b]:65231
103612024-12-14T03:43:11.724ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:65231 req_id = c5ef481e-a273-45f1-8655-aefca7272c01 roles = RoleSet { roles: {} } uri = /metrics/producers
103622024-12-14T03:43:11.725ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:65231 req_id = c5ef481e-a273-45f1-8655-aefca7272c01 resource = Database result = Ok(()) uri = /metrics/producers
103632024-12-14T03:43:11.733ZINFOnexus: assigned collector to new producer collector_id = a321e00a-3126-4ea4-b26d-c0e3eea69166 file = nexus/src/app/oximeter.rs:76 producer_id = 5f2fe413-3c4a-4994-b4a0-995c1da486b1
103642024-12-14T03:43:11.733ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8416 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:65231 req_id = c5ef481e-a273-45f1-8655-aefca7272c01 response_code = 201 uri = /metrics/producers
103652024-12-14T03:43:11.733ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "c5ef481e-a273-45f1-8655-aefca7272c01", "content-length": "41", "date": "Sat, 14 Dec 2024 03:43:11 GMT"} })
103662024-12-14T03:43:11.734ZDEBGnexus (producer-registration-task): registered with nexus successfully
103672024-12-14T03:43:11.734ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
103682024-12-14T03:43:15.613ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1018 local_addr = [fd00:1122:3344:101::b]:56585 method = GET remote_addr = [fd00:1122:3344:101::d]:58979 req_id = e444e321-70e9-4b5e-83a4-d35a900d5536 response_code = 200 uri = /5f2fe413-3c4a-4994-b4a0-995c1da486b1
103692024-12-14T03:43:16.348ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 51 reason = Timeout
103702024-12-14T03:43:16.348ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
103712024-12-14T03:43:16.348ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 51 reason = Timeout
103722024-12-14T03:43:16.348ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
103732024-12-14T03:43:16.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
103742024-12-14T03:43:16.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
103752024-12-14T03:43:16.350ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
103762024-12-14T03:43:16.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
103772024-12-14T03:43:16.350ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103782024-12-14T03:43:16.351ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.533721ms iteration = 51 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
103792024-12-14T03:43:16.353ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
103802024-12-14T03:43:16.353ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
103812024-12-14T03:43:16.353ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
103822024-12-14T03:43:16.355ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
103832024-12-14T03:43:16.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
103842024-12-14T03:43:16.356ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103852024-12-14T03:43:16.358ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1, lookup_type: ById(eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1) } result = Ok(())
103862024-12-14T03:43:16.358ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
103872024-12-14T03:43:16.358ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
103882024-12-14T03:43:16.366ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1 original_time_created = 2024-12-14 03:34:51.368980 UTC target_id = eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1 time_created = 2024-12-14 03:34:51.368980 UTC
103892024-12-14T03:43:16.366ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.588272ms iteration = 51 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1","time_created":"2024-12-14T03:34:51.368980Z"}
103902024-12-14T03:43:22.080ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:55058
103912024-12-14T03:43:22.080ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:55058 req_id = d419e018-db60-4668-9ceb-0df35989254e roles = RoleSet { roles: {} } uri = /metrics/producers
103922024-12-14T03:43:22.081ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:55058 req_id = d419e018-db60-4668-9ceb-0df35989254e resource = Database result = Ok(()) uri = /metrics/producers
103932024-12-14T03:43:22.089ZINFOnexus: assigned collector to new producer collector_id = a321e00a-3126-4ea4-b26d-c0e3eea69166 file = nexus/src/app/oximeter.rs:76 producer_id = 232a98a5-5cb7-4d84-a629-b03087fbd5b7
103942024-12-14T03:43:22.089ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9056 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:55058 req_id = d419e018-db60-4668-9ceb-0df35989254e response_code = 201 uri = /metrics/producers
103952024-12-14T03:43:25.614ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1473 local_addr = [fd00:1122:3344:101::b]:56585 method = GET remote_addr = [fd00:1122:3344:101::d]:58979 req_id = 648a2ce4-8ba7-4f47-9bef-404c4100caf5 response_code = 200 uri = /5f2fe413-3c4a-4994-b4a0-995c1da486b1
103962024-12-14T03:43:26.348ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 18 reason = Timeout
103972024-12-14T03:43:26.348ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 18 reason = Timeout
103982024-12-14T03:43:26.348ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
103992024-12-14T03:43:26.348ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
104002024-12-14T03:43:26.348ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 19 reason = Timeout
104012024-12-14T03:43:26.348ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
104022024-12-14T03:43:26.348ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 18 reason = Timeout
104032024-12-14T03:43:26.348ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
104042024-12-14T03:43:26.348ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 20 reason = Timeout
104052024-12-14T03:43:26.348ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
104062024-12-14T03:43:26.348ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
104072024-12-14T03:43:26.348ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 18 reason = Timeout
104082024-12-14T03:43:26.348ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 18 reason = Timeout
104092024-12-14T03:43:26.348ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
104102024-12-14T03:43:26.348ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 18 reason = Timeout
104112024-12-14T03:43:26.348ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
104122024-12-14T03:43:26.348ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
104132024-12-14T03:43:26.348ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 18 reason = Timeout
104142024-12-14T03:43:26.348ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 18 reason = Timeout
104152024-12-14T03:43:26.348ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 52 reason = Timeout
104162024-12-14T03:43:26.348ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
104172024-12-14T03:43:26.348ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 52 reason = Timeout
104182024-12-14T03:43:26.348ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
104192024-12-14T03:43:26.348ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
104202024-12-14T03:43:26.348ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
104212024-12-14T03:43:26.348ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 18 reason = Timeout
104222024-12-14T03:43:26.348ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
104232024-12-14T03:43:26.348ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 18 reason = Timeout
104242024-12-14T03:43:26.348ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
104252024-12-14T03:43:26.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
104262024-12-14T03:43:26.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
104272024-12-14T03:43:26.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
104282024-12-14T03:43:26.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
104292024-12-14T03:43:26.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
104302024-12-14T03:43:26.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
104312024-12-14T03:43:26.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
104322024-12-14T03:43:26.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
104332024-12-14T03:43:26.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
104342024-12-14T03:43:26.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
104352024-12-14T03:43:26.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
104362024-12-14T03:43:26.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
104372024-12-14T03:43:26.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
104382024-12-14T03:43:26.349ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 18 reason = Timeout
104392024-12-14T03:43:26.349ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
104402024-12-14T03:43:26.349ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 18 reason = Timeout
104412024-12-14T03:43:26.349ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
104422024-12-14T03:43:26.349ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 18 reason = Timeout
104432024-12-14T03:43:26.349ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
104442024-12-14T03:43:26.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
104452024-12-14T03:43:26.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
104462024-12-14T03:43:26.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
104472024-12-14T03:43:26.351ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8d70e61c-94ed-41ce-b36c-cb904f92c534.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8d70e61c-94ed-41ce-b36c-cb904f92c534.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1612, tv_nsec: 667981168 } })
104482024-12-14T03:43:26.351ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
104492024-12-14T03:43:26.351ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104502024-12-14T03:43:26.352ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104512024-12-14T03:43:26.352ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.029231ms iteration = 18 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
104522024-12-14T03:43:26.353ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104532024-12-14T03:43:26.354ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
104542024-12-14T03:43:26.354ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
104552024-12-14T03:43:26.354ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
104562024-12-14T03:43:26.354ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
104572024-12-14T03:43:26.354ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
104582024-12-14T03:43:26.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
104592024-12-14T03:43:26.356ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
104602024-12-14T03:43:26.356ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
104612024-12-14T03:43:26.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
104622024-12-14T03:43:26.362ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8d70e61c-94ed-41ce-b36c-cb904f92c534.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8d70e61c-94ed-41ce-b36c-cb904f92c534.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1612, tv_nsec: 678840806 } })
104632024-12-14T03:43:26.362ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 12.609372ms iteration = 18 status = {"errors":[],"garbage_collect_requested":[]}
104642024-12-14T03:43:26.362ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
104652024-12-14T03:43:26.363ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104662024-12-14T03:43:26.363ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
104672024-12-14T03:43:26.363ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
104682024-12-14T03:43:26.364ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
104692024-12-14T03:43:26.364ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
104702024-12-14T03:43:26.365ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
104712024-12-14T03:43:26.365ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
104722024-12-14T03:43:26.365ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
104732024-12-14T03:43:26.365ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
104742024-12-14T03:43:26.365ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
104752024-12-14T03:43:26.383ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
104762024-12-14T03:43:26.383ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
104772024-12-14T03:43:26.383ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
104782024-12-14T03:43:26.384ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
104792024-12-14T03:43:26.385ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104802024-12-14T03:43:26.385ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 37.462581ms iteration = 52 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
104812024-12-14T03:43:26.387ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
104822024-12-14T03:43:26.387ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
104832024-12-14T03:43:26.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
104842024-12-14T03:43:26.387ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
104852024-12-14T03:43:26.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
104862024-12-14T03:43:26.389ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 40.691195ms iteration = 18 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
104872024-12-14T03:43:26.389ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104882024-12-14T03:43:26.389ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104892024-12-14T03:43:26.392ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
104902024-12-14T03:43:26.392ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
104912024-12-14T03:43:26.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
104922024-12-14T03:43:26.393ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
104932024-12-14T03:43:26.393ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
104942024-12-14T03:43:26.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
104952024-12-14T03:43:26.394ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104962024-12-14T03:43:26.396ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
104972024-12-14T03:43:26.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
104982024-12-14T03:43:26.396ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104992024-12-14T03:43:26.397ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
105002024-12-14T03:43:26.397ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
105012024-12-14T03:43:26.397ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
105022024-12-14T03:43:26.398ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
105032024-12-14T03:43:26.398ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
105042024-12-14T03:43:26.398ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
105052024-12-14T03:43:26.398ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
105062024-12-14T03:43:26.400ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
105072024-12-14T03:43:26.400ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
105082024-12-14T03:43:26.400ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
105092024-12-14T03:43:26.401ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8d70e61c-94ed-41ce-b36c-cb904f92c534.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8d70e61c-94ed-41ce-b36c-cb904f92c534.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1612, tv_nsec: 718687074 } })
105102024-12-14T03:43:26.402ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200
105112024-12-14T03:43:26.402ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
105122024-12-14T03:43:26.402ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
105132024-12-14T03:43:26.403ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
105142024-12-14T03:43:26.403ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
105152024-12-14T03:43:26.404ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
105162024-12-14T03:43:26.404ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
105172024-12-14T03:43:26.405ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 56.441971ms iteration = 18 status = {"errors":[],"records_set_to_done":[]}
105182024-12-14T03:43:26.408ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105192024-12-14T03:43:26.410ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
105202024-12-14T03:43:26.410ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
105212024-12-14T03:43:26.410ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
105222024-12-14T03:43:26.411ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105232024-12-14T03:43:26.414ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1, lookup_type: ById(eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1) } result = Ok(())
105242024-12-14T03:43:26.414ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
105252024-12-14T03:43:26.414ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
105262024-12-14T03:43:26.420ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
105272024-12-14T03:43:26.420ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
105282024-12-14T03:43:26.421ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a9df7a20-d7e7-4d9f-82c1-7ff82ae4c35d", "content-length": "26", "date": "Sat, 14 Dec 2024 03:43:26 GMT"} })
105292024-12-14T03:43:26.421ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
105302024-12-14T03:43:26.423ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
105312024-12-14T03:43:26.427ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
105322024-12-14T03:43:26.427ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
105332024-12-14T03:43:26.428ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
105342024-12-14T03:43:26.429ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
105352024-12-14T03:43:26.430ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105362024-12-14T03:43:26.433ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 8d70e61c-94ed-41ce-b36c-cb904f92c534, lookup_type: ById(8d70e61c-94ed-41ce-b36c-cb904f92c534) } result = Ok(())
105372024-12-14T03:43:26.433ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
105382024-12-14T03:43:26.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
105392024-12-14T03:43:26.434ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1 original_time_created = 2024-12-14 03:34:51.368980 UTC target_id = eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1 time_created = 2024-12-14 03:34:51.368980 UTC
105402024-12-14T03:43:26.434ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 86.448961ms iteration = 52 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1","time_created":"2024-12-14T03:34:51.368980Z"}
105412024-12-14T03:43:26.435ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 87.055763ms iteration = 18 status = 0
105422024-12-14T03:43:26.437ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
105432024-12-14T03:43:26.437ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
105442024-12-14T03:43:26.437ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
105452024-12-14T03:43:26.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
105462024-12-14T03:43:26.442ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
105472024-12-14T03:43:26.442ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 94.542373ms iteration = 18 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
105482024-12-14T03:43:26.445ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
105492024-12-14T03:43:26.445ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
105502024-12-14T03:43:26.445ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 97.296019ms iteration = 18 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
105512024-12-14T03:43:26.445ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8ecab20e-ac19-4222-ad4b-d15d373c8d91", "content-length": "26", "date": "Sat, 14 Dec 2024 03:43:26 GMT"} })
105522024-12-14T03:43:26.445ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
105532024-12-14T03:43:26.447ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 97.612325ms iteration = 18 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
105542024-12-14T03:43:26.448ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
105552024-12-14T03:43:26.453ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 105.32903ms iteration = 20 status = {"physical_disks_added":0}
105562024-12-14T03:43:26.464ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
105572024-12-14T03:43:26.464ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
105582024-12-14T03:43:26.464ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 116.488743ms iteration = 18 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
105592024-12-14T03:43:26.503ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 zone_address = fd00:1122:3344:101::2
105602024-12-14T03:43:26.503ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
105612024-12-14T03:43:26.504ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f9806719-1e78-45aa-94ff-aab23d6aaa08", "content-length": "26", "date": "Sat, 14 Dec 2024 03:43:26 GMT"} })
105622024-12-14T03:43:26.504ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
105632024-12-14T03:43:26.505ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200
105642024-12-14T03:43:26.543ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
105652024-12-14T03:43:26.543ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "7f444e34-0cf2-4a48-855e-6d610457e20a", "content-length": "1", "date": "Sat, 14 Dec 2024 03:43:26 GMT"} })
105662024-12-14T03:43:26.546ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
105672024-12-14T03:43:26.546ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
105682024-12-14T03:43:26.548ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 200.232901ms iteration = 18 status = null
105692024-12-14T03:43:26.591ZDEBGnexus (BackgroundTasks): client request SledAgent = 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
105702024-12-14T03:43:26.591ZDEBGnexus (BackgroundTasks): client response SledAgent = 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "22457eec-1e57-4a21-b4fb-73667575857b", "content-length": "691", "date": "Sat, 14 Dec 2024 03:43:26 GMT"} })
105712024-12-14T03:43:26.591ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
105722024-12-14T03:43:26.591ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
105732024-12-14T03:43:26.591ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
105742024-12-14T03:43:26.592ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 244.59547ms iteration = 18 status = {}
105752024-12-14T03:43:26.681ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 333.186164ms iteration = 18 status = {}
105762024-12-14T03:43:26.686ZINFOnexus (BackgroundTasks): VPC route manager sled 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
105772024-12-14T03:43:26.686ZDEBGnexus (BackgroundTasks): client request SledAgent = 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
105782024-12-14T03:43:26.686ZDEBGnexus (BackgroundTasks): client response SledAgent = 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "7400098e-72b2-493f-bdc1-fbec466d482f", "content-length": "372", "date": "Sat, 14 Dec 2024 03:43:26 GMT"} })
105792024-12-14T03:43:26.686ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
105802024-12-14T03:43:26.686ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
105812024-12-14T03:43:26.723ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
105822024-12-14T03:43:26.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
105832024-12-14T03:43:26.725ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 45ca990e-42e9-4264-be3e-0adfed2cd99b, rack_id: a121ca05-bbee-41bf-b9db-9e03ff035200, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(811a570a-bdaf-4a1b-8eba-0c0e4977f7bb) } rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 switch_location = Switch0
105842024-12-14T03:43:26.725ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
105852024-12-14T03:43:26.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
105862024-12-14T03:43:26.725ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
105872024-12-14T03:43:26.725ZDEBGnexus (BackgroundTasks): client request SledAgent = 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
105882024-12-14T03:43:26.725ZDEBGnexus (BackgroundTasks): client response SledAgent = 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "9ef7438e-6d6f-45b0-a523-9d08b44607b7", "date": "Sat, 14 Dec 2024 03:43:26 GMT"} })
105892024-12-14T03:43:26.725ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
105902024-12-14T03:43:26.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
105912024-12-14T03:43:26.727ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
105922024-12-14T03:43:26.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
105932024-12-14T03:43:26.730ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
105942024-12-14T03:43:26.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
105952024-12-14T03:43:26.732ZINFOnexus (BackgroundTasks): VPC route manager sled 8d70e61c-94ed-41ce-b36c-cb904f92c534 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
105962024-12-14T03:43:26.732ZDEBGnexus (BackgroundTasks): client request SledAgent = 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
105972024-12-14T03:43:26.733ZDEBGnexus (BackgroundTasks): client response SledAgent = 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "6fb1ad7b-9837-45db-b8f1-343d7a36d2b2", "date": "Sat, 14 Dec 2024 03:43:26 GMT"} })
105982024-12-14T03:43:26.735ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
105992024-12-14T03:43:26.735ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "1f9b848c-7806-4fc8-977b-4088ed990cae", "content-length": "134", "date": "Sat, 14 Dec 2024 03:43:26 GMT"} })
106002024-12-14T03:43:26.735ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
106012024-12-14T03:43:26.735ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 811a570a-bdaf-4a1b-8eba-0c0e4977f7bb
106022024-12-14T03:43:26.735ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 387.425051ms iteration = 19 status = {}
106032024-12-14T03:43:26.735ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
106042024-12-14T03:43:26.735ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
106052024-12-14T03:43:26.735ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
106062024-12-14T03:43:26.735ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
106072024-12-14T03:43:26.735ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
106082024-12-14T03:43:26.735ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
106092024-12-14T03:43:26.736ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
106102024-12-14T03:43:26.736ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
106112024-12-14T03:43:26.736ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200
106122024-12-14T03:43:26.736ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
106132024-12-14T03:43:26.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
106142024-12-14T03:43:26.738ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
106152024-12-14T03:43:26.738ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "27dcbad4-1fc5-49a9-94c1-6e603a2b9239", "content-length": "2", "date": "Sat, 14 Dec 2024 03:43:26 GMT"} })
106162024-12-14T03:43:26.738ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
106172024-12-14T03:43:26.738ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "6c3f07ef-28f7-4cbe-bb21-fd11181c773a", "content-length": "52", "date": "Sat, 14 Dec 2024 03:43:26 GMT"} })
106182024-12-14T03:43:26.738ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 switch_location = Switch0
106192024-12-14T03:43:26.738ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
106202024-12-14T03:43:26.834ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "39403f7d-5c6b-4699-8188-0ece25007f19", "date": "Sat, 14 Dec 2024 03:43:26 GMT"} })
106212024-12-14T03:43:26.834ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 switch = Switch0
106222024-12-14T03:43:26.834ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
106232024-12-14T03:43:26.834ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "25a3ea8c-bceb-4f1b-86fb-6f75e626193a", "content-length": "682", "date": "Sat, 14 Dec 2024 03:43:26 GMT"} })
106242024-12-14T03:43:26.834ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
106252024-12-14T03:43:26.834ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
106262024-12-14T03:43:26.837ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
106272024-12-14T03:43:26.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
106282024-12-14T03:43:26.841ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
106292024-12-14T03:43:26.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
106302024-12-14T03:43:26.843ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
106312024-12-14T03:43:26.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
106322024-12-14T03:43:26.850ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 502.215531ms iteration = 18 status = {}
106332024-12-14T03:43:35.614ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1017 local_addr = [fd00:1122:3344:101::b]:56585 method = GET remote_addr = [fd00:1122:3344:101::d]:58979 req_id = 597ad7c3-09ea-45eb-8cde-49d30aae8a0c response_code = 200 uri = /5f2fe413-3c4a-4994-b4a0-995c1da486b1
106342024-12-14T03:43:36.348ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 53 reason = Timeout
106352024-12-14T03:43:36.348ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 53 reason = Timeout
106362024-12-14T03:43:36.348ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
106372024-12-14T03:43:36.348ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
106382024-12-14T03:43:36.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
106392024-12-14T03:43:36.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
106402024-12-14T03:43:36.350ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106412024-12-14T03:43:36.351ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
106422024-12-14T03:43:36.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
106432024-12-14T03:43:36.352ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.299035ms iteration = 53 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
106442024-12-14T03:43:36.353ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
106452024-12-14T03:43:36.353ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
106462024-12-14T03:43:36.353ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
106472024-12-14T03:43:36.355ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
106482024-12-14T03:43:36.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
106492024-12-14T03:43:36.356ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106502024-12-14T03:43:36.359ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1, lookup_type: ById(eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1) } result = Ok(())
106512024-12-14T03:43:36.359ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
106522024-12-14T03:43:36.359ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
106532024-12-14T03:43:36.367ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1 original_time_created = 2024-12-14 03:34:51.368980 UTC target_id = eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1 time_created = 2024-12-14 03:34:51.368980 UTC
106542024-12-14T03:43:36.367ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.700524ms iteration = 53 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1","time_created":"2024-12-14T03:34:51.368980Z"}
106552024-12-14T03:43:40.603ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:56805 req_id = 6469efc0-5f36-4fca-b495-d5fb3f0def1c roles = RoleSet { roles: {} } uri = /metrics/collectors/a321e00a-3126-4ea4-b26d-c0e3eea69166/producers?sort_by=id_ascending
106562024-12-14T03:43:40.604ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:56805 req_id = 6469efc0-5f36-4fca-b495-d5fb3f0def1c resource = Database result = Ok(()) uri = /metrics/collectors/a321e00a-3126-4ea4-b26d-c0e3eea69166/producers?sort_by=id_ascending
106572024-12-14T03:43:40.606ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2977 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:56805 req_id = 6469efc0-5f36-4fca-b495-d5fb3f0def1c response_code = 200 uri = /metrics/collectors/a321e00a-3126-4ea4-b26d-c0e3eea69166/producers?sort_by=id_ascending
106582024-12-14T03:43:40.606ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:56805 req_id = 81f663f0-a756-4db9-b31a-78e598a1c33b roles = RoleSet { roles: {} } uri = /metrics/collectors/a321e00a-3126-4ea4-b26d-c0e3eea69166/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlOGQ5NjQ2Zi1hNTQxLTRjMTEtYjViMi1mOTUzNDI3Y2EyZjMifX0%3D
106592024-12-14T03:43:40.607ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:56805 req_id = 81f663f0-a756-4db9-b31a-78e598a1c33b resource = Database result = Ok(()) uri = /metrics/collectors/a321e00a-3126-4ea4-b26d-c0e3eea69166/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlOGQ5NjQ2Zi1hNTQxLTRjMTEtYjViMi1mOTUzNDI3Y2EyZjMifX0%3D
106602024-12-14T03:43:40.609ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2358 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:56805 req_id = 81f663f0-a756-4db9-b31a-78e598a1c33b response_code = 200 uri = /metrics/collectors/a321e00a-3126-4ea4-b26d-c0e3eea69166/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlOGQ5NjQ2Zi1hNTQxLTRjMTEtYjViMi1mOTUzNDI3Y2EyZjMifX0%3D
106612024-12-14T03:43:44.883ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:59815
106622024-12-14T03:43:44.883ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:59815 req_id = a282fc52-af61-462f-b527-a5c41d7fd2ff roles = RoleSet { roles: {} } uri = /metrics/producers
106632024-12-14T03:43:44.884ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:59815 req_id = a282fc52-af61-462f-b527-a5c41d7fd2ff resource = Database result = Ok(()) uri = /metrics/producers
106642024-12-14T03:43:44.924ZINFOnexus: assigned collector to new producer collector_id = a321e00a-3126-4ea4-b26d-c0e3eea69166 file = nexus/src/app/oximeter.rs:76 producer_id = b4254c81-0366-4d7b-a36b-86b73748c2f7
106652024-12-14T03:43:44.924ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 41117 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:59815 req_id = a282fc52-af61-462f-b527-a5c41d7fd2ff response_code = 201 uri = /metrics/producers
106662024-12-14T03:43:45.614ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1002 local_addr = [fd00:1122:3344:101::b]:56585 method = GET remote_addr = [fd00:1122:3344:101::d]:58979 req_id = 8173cbdf-6a34-4ec0-9af5-95a77cfa2ee7 response_code = 200 uri = /5f2fe413-3c4a-4994-b4a0-995c1da486b1
106672024-12-14T03:43:46.348ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 54 reason = Timeout
106682024-12-14T03:43:46.348ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
106692024-12-14T03:43:46.348ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 54 reason = Timeout
106702024-12-14T03:43:46.348ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
106712024-12-14T03:43:46.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
106722024-12-14T03:43:46.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
106732024-12-14T03:43:46.350ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106742024-12-14T03:43:46.353ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
106752024-12-14T03:43:46.353ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
106762024-12-14T03:43:46.353ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
106772024-12-14T03:43:46.356ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
106782024-12-14T03:43:46.357ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
106792024-12-14T03:43:46.358ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106802024-12-14T03:43:46.361ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1, lookup_type: ById(eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1) } result = Ok(())
106812024-12-14T03:43:46.361ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
106822024-12-14T03:43:46.361ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
106832024-12-14T03:43:46.376ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1 original_time_created = 2024-12-14 03:34:51.368980 UTC target_id = eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1 time_created = 2024-12-14 03:34:51.368980 UTC
106842024-12-14T03:43:46.376ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 27.952871ms iteration = 54 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1","time_created":"2024-12-14T03:34:51.368980Z"}
106852024-12-14T03:43:46.386ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
106862024-12-14T03:43:46.386ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
106872024-12-14T03:43:46.415ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 66.972422ms iteration = 54 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
106882024-12-14T03:43:55.603ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:56805 req_id = c8138cda-d12a-482e-8fb5-dbb96d191ea6 roles = RoleSet { roles: {} } uri = /metrics/collectors/a321e00a-3126-4ea4-b26d-c0e3eea69166/producers?sort_by=id_ascending
106892024-12-14T03:43:55.604ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:56805 req_id = c8138cda-d12a-482e-8fb5-dbb96d191ea6 resource = Database result = Ok(()) uri = /metrics/collectors/a321e00a-3126-4ea4-b26d-c0e3eea69166/producers?sort_by=id_ascending
106902024-12-14T03:43:55.606ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2452 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:56805 req_id = c8138cda-d12a-482e-8fb5-dbb96d191ea6 response_code = 200 uri = /metrics/collectors/a321e00a-3126-4ea4-b26d-c0e3eea69166/producers?sort_by=id_ascending
106912024-12-14T03:43:55.606ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:56805 req_id = 59dc462e-a55e-438c-b30e-529fc5d778c2 roles = RoleSet { roles: {} } uri = /metrics/collectors/a321e00a-3126-4ea4-b26d-c0e3eea69166/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlOGQ5NjQ2Zi1hNTQxLTRjMTEtYjViMi1mOTUzNDI3Y2EyZjMifX0%3D
106922024-12-14T03:43:55.606ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:56805 req_id = 59dc462e-a55e-438c-b30e-529fc5d778c2 resource = Database result = Ok(()) uri = /metrics/collectors/a321e00a-3126-4ea4-b26d-c0e3eea69166/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlOGQ5NjQ2Zi1hNTQxLTRjMTEtYjViMi1mOTUzNDI3Y2EyZjMifX0%3D
106932024-12-14T03:43:55.608ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2290 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:56805 req_id = 59dc462e-a55e-438c-b30e-529fc5d778c2 response_code = 200 uri = /metrics/collectors/a321e00a-3126-4ea4-b26d-c0e3eea69166/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlOGQ5NjQ2Zi1hNTQxLTRjMTEtYjViMi1mOTUzNDI3Y2EyZjMifX0%3D
106942024-12-14T03:43:55.614ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1050 local_addr = [fd00:1122:3344:101::b]:56585 method = GET remote_addr = [fd00:1122:3344:101::d]:58979 req_id = 2b0c3ca0-4324-426b-8ded-29281de70008 response_code = 200 uri = /5f2fe413-3c4a-4994-b4a0-995c1da486b1
106952024-12-14T03:43:56.348ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 21 reason = Timeout
106962024-12-14T03:43:56.348ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
106972024-12-14T03:43:56.348ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 11 reason = Timeout
106982024-12-14T03:43:56.348ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
106992024-12-14T03:43:56.348ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
107002024-12-14T03:43:56.348ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 55 reason = Timeout
107012024-12-14T03:43:56.348ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 19 reason = Timeout
107022024-12-14T03:43:56.348ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
107032024-12-14T03:43:56.348ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
107042024-12-14T03:43:56.348ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 10 reason = Timeout
107052024-12-14T03:43:56.348ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 19 reason = Timeout
107062024-12-14T03:43:56.348ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
107072024-12-14T03:43:56.348ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
107082024-12-14T03:43:56.348ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 11 reason = Timeout
107092024-12-14T03:43:56.348ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
107102024-12-14T03:43:56.348ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 19 reason = Timeout
107112024-12-14T03:43:56.348ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
107122024-12-14T03:43:56.348ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 10 reason = Timeout
107132024-12-14T03:43:56.348ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
107142024-12-14T03:43:56.348ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 10 reason = Timeout
107152024-12-14T03:43:56.348ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-14 03:33:56.348702366 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
107162024-12-14T03:43:56.348ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
107172024-12-14T03:43:56.348ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 10 reason = Timeout
107182024-12-14T03:43:56.348ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
107192024-12-14T03:43:56.348ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 55 reason = Timeout
107202024-12-14T03:43:56.348ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
107212024-12-14T03:43:56.348ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
107222024-12-14T03:43:56.348ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 19 reason = Timeout
107232024-12-14T03:43:56.348ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 19 reason = Timeout
107242024-12-14T03:43:56.348ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
107252024-12-14T03:43:56.348ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
107262024-12-14T03:43:56.348ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 12 reason = Timeout
107272024-12-14T03:43:56.349ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 11 reason = Timeout
107282024-12-14T03:43:56.349ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 19 reason = Timeout
107292024-12-14T03:43:56.349ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
107302024-12-14T03:43:56.349ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 10 reason = Timeout
107312024-12-14T03:43:56.349ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
107322024-12-14T03:43:56.349ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 11 reason = Timeout
107332024-12-14T03:43:56.349ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1
107342024-12-14T03:43:56.349ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 10.96\u{b5}s iteration = 11 status = {"enabled":false,"target_id":"eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1"}
107352024-12-14T03:43:56.349ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 11 reason = Timeout
107362024-12-14T03:43:56.349ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 19 reason = Timeout
107372024-12-14T03:43:56.349ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
107382024-12-14T03:43:56.349ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 20 reason = Timeout
107392024-12-14T03:43:56.349ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
107402024-12-14T03:43:56.349ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 5 reason = Timeout
107412024-12-14T03:43:56.349ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
107422024-12-14T03:43:56.349ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
107432024-12-14T03:43:56.349ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 19 reason = Timeout
107442024-12-14T03:43:56.349ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
107452024-12-14T03:43:56.349ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 11 reason = Timeout
107462024-12-14T03:43:56.349ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 19 reason = Timeout
107472024-12-14T03:43:56.349ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
107482024-12-14T03:43:56.349ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
107492024-12-14T03:43:56.349ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
107502024-12-14T03:43:56.349ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 12 reason = Timeout
107512024-12-14T03:43:56.349ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 19 reason = Timeout
107522024-12-14T03:43:56.349ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
107532024-12-14T03:43:56.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
107542024-12-14T03:43:56.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
107552024-12-14T03:43:56.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
107562024-12-14T03:43:56.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
107572024-12-14T03:43:56.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
107582024-12-14T03:43:56.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
107592024-12-14T03:43:56.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
107602024-12-14T03:43:56.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
107612024-12-14T03:43:56.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
107622024-12-14T03:43:56.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
107632024-12-14T03:43:56.349ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 19 reason = Timeout
107642024-12-14T03:43:56.349ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 19 reason = Timeout
107652024-12-14T03:43:56.349ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 19 reason = Timeout
107662024-12-14T03:43:56.349ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
107672024-12-14T03:43:56.349ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
107682024-12-14T03:43:56.349ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
107692024-12-14T03:43:56.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
107702024-12-14T03:43:56.349ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("3db8556d-0ae0-4824-8953-f38d8eef7409.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7b672843-049d-4d9c-b0a2-21d7b6323621.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("db39fe07-65c4-451a-a2bd-78fcdfc10040.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("db39fe07-65c4-451a-a2bd-78fcdfc10040.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1642, tv_nsec: 665968189 } })
107712024-12-14T03:43:56.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
107722024-12-14T03:43:56.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
107732024-12-14T03:43:56.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
107742024-12-14T03:43:56.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
107752024-12-14T03:43:56.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
107762024-12-14T03:43:56.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
107772024-12-14T03:43:56.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
107782024-12-14T03:43:56.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
107792024-12-14T03:43:56.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
107802024-12-14T03:43:56.349ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("28f528f1-3159-4fbc-9304-37b7e4a50ae8.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7274e15f-a5f6-4975-bcdd-a2ef890c0230.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("7274e15f-a5f6-4975-bcdd-a2ef890c0230.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1642, tv_nsec: 666067891 } })
107812024-12-14T03:43:56.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
107822024-12-14T03:43:56.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
107832024-12-14T03:43:56.349ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
107842024-12-14T03:43:56.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
107852024-12-14T03:43:56.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
107862024-12-14T03:43:56.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
107872024-12-14T03:43:56.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
107882024-12-14T03:43:56.349ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
107892024-12-14T03:43:56.349ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
107902024-12-14T03:43:56.349ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
107912024-12-14T03:43:56.349ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.103413ms iteration = 11 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
107922024-12-14T03:43:56.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
107932024-12-14T03:43:56.349ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
107942024-12-14T03:43:56.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
107952024-12-14T03:43:56.350ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
107962024-12-14T03:43:56.350ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.322616ms iteration = 11 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
107972024-12-14T03:43:56.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
107982024-12-14T03:43:56.350ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
107992024-12-14T03:43:56.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
108002024-12-14T03:43:56.351ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108012024-12-14T03:43:56.351ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108022024-12-14T03:43:56.352ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.47624ms iteration = 19 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
108032024-12-14T03:43:56.353ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
108042024-12-14T03:43:56.353ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
108052024-12-14T03:43:56.353ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
108062024-12-14T03:43:56.354ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
108072024-12-14T03:43:56.354ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
108082024-12-14T03:43:56.354ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
108092024-12-14T03:43:56.354ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
108102024-12-14T03:43:56.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
108112024-12-14T03:43:56.356ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108122024-12-14T03:43:56.357ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8d70e61c-94ed-41ce-b36c-cb904f92c534.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8d70e61c-94ed-41ce-b36c-cb904f92c534.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1642, tv_nsec: 673640523 } })
108132024-12-14T03:43:56.357ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
108142024-12-14T03:43:56.357ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-14 03:33:56.348702366 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
108152024-12-14T03:43:56.357ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 8.852168ms iteration = 10 status = {"expiration":"2024-12-14T03:33:56.348702366Z","pruned":[]}
108162024-12-14T03:43:56.357ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108172024-12-14T03:43:56.357ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108182024-12-14T03:43:56.358ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108192024-12-14T03:43:56.360ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
108202024-12-14T03:43:56.360ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
108212024-12-14T03:43:56.360ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
108222024-12-14T03:43:56.360ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
108232024-12-14T03:43:56.360ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
108242024-12-14T03:43:56.361ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
108252024-12-14T03:43:56.361ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
108262024-12-14T03:43:56.361ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
108272024-12-14T03:43:56.361ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
108282024-12-14T03:43:56.361ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
108292024-12-14T03:43:56.361ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
108302024-12-14T03:43:56.362ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
108312024-12-14T03:43:56.362ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
108322024-12-14T03:43:56.363ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
108332024-12-14T03:43:56.363ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8d70e61c-94ed-41ce-b36c-cb904f92c534.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8d70e61c-94ed-41ce-b36c-cb904f92c534.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1642, tv_nsec: 679609783 } })
108342024-12-14T03:43:56.363ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
108352024-12-14T03:43:56.363ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 15.160634ms iteration = 10 status = {"errors":[],"found_port_ok":[]}
108362024-12-14T03:43:56.364ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
108372024-12-14T03:43:56.364ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
108382024-12-14T03:43:56.365ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108392024-12-14T03:43:56.369ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
108402024-12-14T03:43:56.369ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
108412024-12-14T03:43:56.369ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
108422024-12-14T03:43:56.371ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108432024-12-14T03:43:56.375ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
108442024-12-14T03:43:56.375ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
108452024-12-14T03:43:56.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
108462024-12-14T03:43:56.375ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108472024-12-14T03:43:56.379ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
108482024-12-14T03:43:56.379ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
108492024-12-14T03:43:56.379ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
108502024-12-14T03:43:56.381ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
108512024-12-14T03:43:56.381ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
108522024-12-14T03:43:56.381ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
108532024-12-14T03:43:56.381ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
108542024-12-14T03:43:56.383ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108552024-12-14T03:43:56.385ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
108562024-12-14T03:43:56.385ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
108572024-12-14T03:43:56.385ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
108582024-12-14T03:43:56.385ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
108592024-12-14T03:43:56.387ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
108602024-12-14T03:43:56.387ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
108612024-12-14T03:43:56.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
108622024-12-14T03:43:56.393ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
108632024-12-14T03:43:56.393ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
108642024-12-14T03:43:56.393ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 44.694095ms iteration = 10 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
108652024-12-14T03:43:56.395ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108662024-12-14T03:43:56.398ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
108672024-12-14T03:43:56.406ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108682024-12-14T03:43:56.410ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
108692024-12-14T03:43:56.410ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
108702024-12-14T03:43:56.411ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
108712024-12-14T03:43:56.415ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108722024-12-14T03:43:56.416ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108732024-12-14T03:43:56.418ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 68.732527ms iteration = 19 status = {"errors":[],"records_set_to_done":[]}
108742024-12-14T03:43:56.418ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
108752024-12-14T03:43:56.418ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
108762024-12-14T03:43:56.418ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
108772024-12-14T03:43:56.418ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
108782024-12-14T03:43:56.419ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
108792024-12-14T03:43:56.419ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 70.600804ms iteration = 55 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
108802024-12-14T03:43:56.419ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 70.203527ms iteration = 19 status = {"errors":[],"garbage_collect_requested":[]}
108812024-12-14T03:43:56.419ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108822024-12-14T03:43:56.420ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
108832024-12-14T03:43:56.420ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
108842024-12-14T03:43:56.420ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
108852024-12-14T03:43:56.421ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
108862024-12-14T03:43:56.421ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
108872024-12-14T03:43:56.421ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
108882024-12-14T03:43:56.421ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
108892024-12-14T03:43:56.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
108902024-12-14T03:43:56.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
108912024-12-14T03:43:56.423ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
108922024-12-14T03:43:56.426ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108932024-12-14T03:43:56.426ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
108942024-12-14T03:43:56.426ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
108952024-12-14T03:43:56.426ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 77.38635ms iteration = 10 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
108962024-12-14T03:43:56.427ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108972024-12-14T03:43:56.428ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
108982024-12-14T03:43:56.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
108992024-12-14T03:43:56.428ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
109002024-12-14T03:43:56.428ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
109012024-12-14T03:43:56.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
109022024-12-14T03:43:56.430ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
109032024-12-14T03:43:56.430ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
109042024-12-14T03:43:56.430ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
109052024-12-14T03:43:56.431ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109062024-12-14T03:43:56.433ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
109072024-12-14T03:43:56.433ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 84.647356ms iteration = 19 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
109082024-12-14T03:43:56.434ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
109092024-12-14T03:43:56.434ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
109102024-12-14T03:43:56.434ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
109112024-12-14T03:43:56.437ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
109122024-12-14T03:43:56.441ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
109132024-12-14T03:43:56.441ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
109142024-12-14T03:43:56.441ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
109152024-12-14T03:43:56.441ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
109162024-12-14T03:43:56.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
109172024-12-14T03:43:56.448ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
109182024-12-14T03:43:56.449ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
109192024-12-14T03:43:56.457ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
109202024-12-14T03:43:56.457ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
109212024-12-14T03:43:56.457ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
109222024-12-14T03:43:56.457ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
109232024-12-14T03:43:56.457ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
109242024-12-14T03:43:56.459ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 110.875321ms iteration = 19 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
109252024-12-14T03:43:56.465ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
109262024-12-14T03:43:56.467ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
109272024-12-14T03:43:56.467ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
109282024-12-14T03:43:56.470ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
109292024-12-14T03:43:56.470ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
109302024-12-14T03:43:56.473ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109312024-12-14T03:43:56.476ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1, lookup_type: ById(eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1) } result = Ok(())
109322024-12-14T03:43:56.476ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
109332024-12-14T03:43:56.476ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
109342024-12-14T03:43:56.482ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
109352024-12-14T03:43:56.482ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
109362024-12-14T03:43:56.482ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "9dc791ff-70bd-4f40-987a-f370809cff8b", "content-length": "26", "date": "Sat, 14 Dec 2024 03:43:56 GMT"} })
109372024-12-14T03:43:56.482ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
109382024-12-14T03:43:56.485ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
109392024-12-14T03:43:56.491ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
109402024-12-14T03:43:56.491ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
109412024-12-14T03:43:56.492ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "de01c315-eaef-4aeb-8f1c-953dc5b813d8", "content-length": "26", "date": "Sat, 14 Dec 2024 03:43:56 GMT"} })
109422024-12-14T03:43:56.492ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
109432024-12-14T03:43:56.493ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
109442024-12-14T03:43:56.499ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
109452024-12-14T03:43:56.499ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
109462024-12-14T03:43:56.536ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 187.732041ms iteration = 21 status = {"physical_disks_added":0}
109472024-12-14T03:43:56.602ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
109482024-12-14T03:43:56.603ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "f2090e3d-f16c-4609-b4f7-c64658fe52c6", "date": "Sat, 14 Dec 2024 03:43:56 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
109492024-12-14T03:43:56.603ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
109502024-12-14T03:43:56.605ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "0a4af0da-9f28-465d-9af6-cd6d0df2da44", "date": "Sat, 14 Dec 2024 03:43:56 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
109512024-12-14T03:43:56.605ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
109522024-12-14T03:43:56.607ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
109532024-12-14T03:43:56.607ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 258.416617ms iteration = 12 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
109542024-12-14T03:43:56.659ZINFOnexus (BackgroundTasks): VPC route manager sled 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
109552024-12-14T03:43:56.659ZDEBGnexus (BackgroundTasks): client request SledAgent = 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
109562024-12-14T03:43:56.660ZDEBGnexus (BackgroundTasks): client response SledAgent = 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "b01bc31f-f3fd-4097-98d5-20cb954b225b", "content-length": "372", "date": "Sat, 14 Dec 2024 03:43:56 GMT"} })
109572024-12-14T03:43:56.660ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
109582024-12-14T03:43:56.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
109592024-12-14T03:43:56.660ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
109602024-12-14T03:43:56.660ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "af133a58-4c05-4b0f-b4e6-8b2d73ad13ff", "content-length": "1", "date": "Sat, 14 Dec 2024 03:43:55 GMT"} })
109612024-12-14T03:43:56.663ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
109622024-12-14T03:43:56.664ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
109632024-12-14T03:43:56.665ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 316.164794ms iteration = 5 status = {"nsuccess":5}
109642024-12-14T03:43:56.665ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109652024-12-14T03:43:56.665ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8d70e61c-94ed-41ce-b36c-cb904f92c534.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8d70e61c-94ed-41ce-b36c-cb904f92c534.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1642, tv_nsec: 982457860 } })
109662024-12-14T03:43:56.666ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200
109672024-12-14T03:43:56.666ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
109682024-12-14T03:43:56.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
109692024-12-14T03:43:56.668ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
109702024-12-14T03:43:56.668ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
109712024-12-14T03:43:56.669ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
109722024-12-14T03:43:56.669ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 320.509851ms iteration = 19 status = null
109732024-12-14T03:43:56.669ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109742024-12-14T03:43:56.675ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 8d70e61c-94ed-41ce-b36c-cb904f92c534, lookup_type: ById(8d70e61c-94ed-41ce-b36c-cb904f92c534) } result = Ok(())
109752024-12-14T03:43:56.675ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
109762024-12-14T03:43:56.676ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
109772024-12-14T03:43:56.678ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 329.503281ms iteration = 19 status = 0
109782024-12-14T03:43:56.679ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 330.369949ms iteration = 19 status = {}
109792024-12-14T03:43:56.679ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
109802024-12-14T03:43:56.687ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1 original_time_created = 2024-12-14 03:34:51.368980 UTC target_id = eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1 time_created = 2024-12-14 03:34:51.368980 UTC
109812024-12-14T03:43:56.687ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 339.369279ms iteration = 55 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1","time_created":"2024-12-14T03:34:51.368980Z"}
109822024-12-14T03:43:56.696ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109832024-12-14T03:43:56.697ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109842024-12-14T03:43:56.699ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 350.098334ms iteration = 19 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
109852024-12-14T03:43:56.699ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
109862024-12-14T03:43:56.699ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
109872024-12-14T03:43:56.699ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
109882024-12-14T03:43:56.699ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
109892024-12-14T03:43:56.699ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
109902024-12-14T03:43:56.699ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
109912024-12-14T03:43:56.701ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109922024-12-14T03:43:56.702ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
109932024-12-14T03:43:56.702ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
109942024-12-14T03:43:56.702ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
109952024-12-14T03:43:56.703ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
109962024-12-14T03:43:56.703ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
109972024-12-14T03:43:56.703ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
109982024-12-14T03:43:56.703ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
109992024-12-14T03:43:56.703ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
110002024-12-14T03:43:56.703ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
110012024-12-14T03:43:56.703ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110022024-12-14T03:43:56.706ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
110032024-12-14T03:43:56.706ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
110042024-12-14T03:43:56.706ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
110052024-12-14T03:43:56.710ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
110062024-12-14T03:43:56.710ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = c7a5bbe9-1af5-4e36-80b5-da9e0053b676 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
110072024-12-14T03:43:56.710ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
110082024-12-14T03:43:56.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
110092024-12-14T03:43:56.716ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
110102024-12-14T03:43:56.716ZDEBGnexus (BackgroundTasks): client request SledAgent = 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
110112024-12-14T03:43:56.717ZDEBGnexus (BackgroundTasks): client response SledAgent = 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "de95852b-c3f0-4f82-b490-7ef20d5a415d", "date": "Sat, 14 Dec 2024 03:43:56 GMT"} })
110122024-12-14T03:43:56.717ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
110132024-12-14T03:43:56.717ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
110142024-12-14T03:43:56.719ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
110152024-12-14T03:43:56.719ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
110162024-12-14T03:43:56.726ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
110172024-12-14T03:43:56.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
110182024-12-14T03:43:56.731ZINFOnexus (BackgroundTasks): VPC route manager sled 8d70e61c-94ed-41ce-b36c-cb904f92c534 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
110192024-12-14T03:43:56.731ZDEBGnexus (BackgroundTasks): client request SledAgent = 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
110202024-12-14T03:43:56.731ZDEBGnexus (BackgroundTasks): client response SledAgent = 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "40f35951-21f6-460a-a15e-a27970e60939", "date": "Sat, 14 Dec 2024 03:43:56 GMT"} })
110212024-12-14T03:43:56.731ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 zone_address = fd00:1122:3344:101::2
110222024-12-14T03:43:56.731ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
110232024-12-14T03:43:56.732ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d9ff48eb-120f-4a42-a72b-ee09178b5a79", "content-length": "26", "date": "Sat, 14 Dec 2024 03:43:56 GMT"} })
110242024-12-14T03:43:56.732ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
110252024-12-14T03:43:56.733ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200
110262024-12-14T03:43:56.734ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 385.255068ms iteration = 20 status = {}
110272024-12-14T03:43:56.741ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 392.575085ms iteration = 19 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
110282024-12-14T03:43:56.742ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-14T03:34:54.541856Z, time_modified: 2024-12-14T03:34:54.541856Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, db_silo: Silo { identity: SiloIdentity { id: 578bc52c-ac81-41a6-a56b-dfc79805368e, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-14T03:35:40.848931Z, time_modified: 2024-12-14T03:35:40.848931Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "4dfc5e49ed154568e7a05c630983c79e7ad097d55e90f834bee8ffda0c5a5c9e" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, db_silo: Silo { identity: SiloIdentity { id: 578bc52c-ac81-41a6-a56b-dfc79805368e, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-14T03:35:40.848931Z, time_modified: 2024-12-14T03:35:40.848931Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "4dfc5e49ed154568e7a05c630983c79e7ad097d55e90f834bee8ffda0c5a5c9e" }] }) }
110292024-12-14T03:43:56.742ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 393.81516ms iteration = 11 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"578bc52c-ac81-41a6-a56b-dfc79805368e","tls_certs":["4dfc5e49ed154568e7a05c630983c79e7ad097d55e90f834bee8ffda0c5a5c9e"]}},"default_endpoint":{"silo_id":"578bc52c-ac81-41a6-a56b-dfc79805368e","tls_certs":["4dfc5e49ed154568e7a05c630983c79e7ad097d55e90f834bee8ffda0c5a5c9e"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
110302024-12-14T03:43:56.746ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
110312024-12-14T03:43:56.746ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
110322024-12-14T03:43:56.746ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 397.678028ms iteration = 19 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
110332024-12-14T03:43:56.746ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
110342024-12-14T03:43:56.747ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "ffd10bee-b4f1-45e1-a7b6-a562a1960767", "date": "Sat, 14 Dec 2024 03:43:56 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
110352024-12-14T03:43:56.747ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
110362024-12-14T03:43:56.747ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
110372024-12-14T03:43:56.747ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 51f6df17-b3b5-47fe-9a42-d8752f961c5e dns_zone_name = oxide.test found_so_far = 0 version = 2
110382024-12-14T03:43:56.747ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
110392024-12-14T03:43:56.747ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
110402024-12-14T03:43:56.749ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "80f596aa-a672-465a-a4b9-6e8d9d0dd113", "date": "Sat, 14 Dec 2024 03:43:56 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
110412024-12-14T03:43:56.749ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
110422024-12-14T03:43:56.749ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110432024-12-14T03:43:56.750ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "98fa5247-81eb-4ab2-a67c-b4f335258798", "date": "Sat, 14 Dec 2024 03:43:56 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
110442024-12-14T03:43:56.750ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
110452024-12-14T03:43:56.752ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
110462024-12-14T03:43:56.752ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
110472024-12-14T03:43:56.752ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
110482024-12-14T03:43:56.752ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
110492024-12-14T03:43:56.752ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 403.83333ms iteration = 12 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
110502024-12-14T03:43:56.754ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = c7a5bbe9-1af5-4e36-80b5-da9e0053b676 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
110512024-12-14T03:43:56.754ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
110522024-12-14T03:43:56.754ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-14 03:35:40.104814 UTC dns_group = internal generation = 1
110532024-12-14T03:43:56.754ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 405.429523ms iteration = 11 status = {"generation":1}
110542024-12-14T03:43:56.764ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
110552024-12-14T03:43:56.764ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 416.003664ms iteration = 10 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
110562024-12-14T03:43:56.776ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110572024-12-14T03:43:56.778ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
110582024-12-14T03:43:56.778ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
110592024-12-14T03:43:56.779ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
110602024-12-14T03:43:56.780ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 51f6df17-b3b5-47fe-9a42-d8752f961c5e dns_zone_name = oxide.test found_so_far = 1 version = 2
110612024-12-14T03:43:56.780ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
110622024-12-14T03:43:56.780ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-14 03:35:40.905586 UTC dns_group = external generation = 2
110632024-12-14T03:43:56.780ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 432.242479ms iteration = 11 status = {"generation":2}
110642024-12-14T03:43:56.808ZDEBGnexus (BackgroundTasks): client request SledAgent = 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
110652024-12-14T03:43:56.808ZDEBGnexus (BackgroundTasks): client response SledAgent = 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "df7b7da2-a218-4e2c-aa35-7a4f655e984c", "content-length": "691", "date": "Sat, 14 Dec 2024 03:43:56 GMT"} })
110662024-12-14T03:43:56.808ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
110672024-12-14T03:43:56.808ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
110682024-12-14T03:43:56.808ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
110692024-12-14T03:43:56.809ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 461.067577ms iteration = 19 status = {}
110702024-12-14T03:43:56.839ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
110712024-12-14T03:43:56.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
110722024-12-14T03:43:56.842ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 45ca990e-42e9-4264-be3e-0adfed2cd99b, rack_id: a121ca05-bbee-41bf-b9db-9e03ff035200, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(811a570a-bdaf-4a1b-8eba-0c0e4977f7bb) } rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 switch_location = Switch0
110732024-12-14T03:43:56.842ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
110742024-12-14T03:43:56.842ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
110752024-12-14T03:43:56.851ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
110762024-12-14T03:43:56.852ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "5c1d3711-b9d0-439a-9d62-a266bacb7f3b", "content-length": "134", "date": "Sat, 14 Dec 2024 03:43:56 GMT"} })
110772024-12-14T03:43:56.852ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
110782024-12-14T03:43:56.852ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 811a570a-bdaf-4a1b-8eba-0c0e4977f7bb
110792024-12-14T03:43:56.852ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
110802024-12-14T03:43:56.852ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
110812024-12-14T03:43:56.852ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
110822024-12-14T03:43:56.852ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
110832024-12-14T03:43:56.852ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
110842024-12-14T03:43:56.852ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
110852024-12-14T03:43:56.852ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
110862024-12-14T03:43:56.852ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
110872024-12-14T03:43:56.852ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200
110882024-12-14T03:43:56.852ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
110892024-12-14T03:43:56.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
110902024-12-14T03:43:56.855ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
110912024-12-14T03:43:56.855ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "7262bac3-ea47-40be-b539-7881d70c3f20", "content-length": "2", "date": "Sat, 14 Dec 2024 03:43:56 GMT"} })
110922024-12-14T03:43:56.855ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
110932024-12-14T03:43:56.855ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "6896e3c7-a998-48c9-ae4a-8c91e47df3d6", "content-length": "52", "date": "Sat, 14 Dec 2024 03:43:56 GMT"} })
110942024-12-14T03:43:56.855ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 switch_location = Switch0
110952024-12-14T03:43:56.855ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
110962024-12-14T03:43:56.943ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "4f718cd0-b18b-44a4-902d-71fa3a24d9e2", "date": "Sat, 14 Dec 2024 03:43:56 GMT"} })
110972024-12-14T03:43:56.943ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 switch = Switch0
110982024-12-14T03:43:56.943ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
110992024-12-14T03:43:56.943ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "51def6c0-f9ff-46fd-94b0-e8f1eb01d132", "content-length": "682", "date": "Sat, 14 Dec 2024 03:43:56 GMT"} })
111002024-12-14T03:43:56.943ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
111012024-12-14T03:43:56.943ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
111022024-12-14T03:43:56.947ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
111032024-12-14T03:43:56.947ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
111042024-12-14T03:43:56.949ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
111052024-12-14T03:43:56.950ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
111062024-12-14T03:43:56.952ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
111072024-12-14T03:43:56.952ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
111082024-12-14T03:43:56.959ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 610.698795ms iteration = 19 status = {}
111092024-12-14T03:44:05.614ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1027 local_addr = [fd00:1122:3344:101::b]:56585 method = GET remote_addr = [fd00:1122:3344:101::d]:58979 req_id = 32bac18f-d754-4325-874c-e12dba85ccce response_code = 200 uri = /5f2fe413-3c4a-4994-b4a0-995c1da486b1
111102024-12-14T03:44:06.348ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 56 reason = Timeout
111112024-12-14T03:44:06.348ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
111122024-12-14T03:44:06.348ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 56 reason = Timeout
111132024-12-14T03:44:06.348ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
111142024-12-14T03:44:06.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
111152024-12-14T03:44:06.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
111162024-12-14T03:44:06.351ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
111172024-12-14T03:44:06.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
111182024-12-14T03:44:06.377ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 28.815557ms iteration = 56 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
111192024-12-14T03:44:06.378ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111202024-12-14T03:44:06.381ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
111212024-12-14T03:44:06.381ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
111222024-12-14T03:44:06.381ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
111232024-12-14T03:44:06.383ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
111242024-12-14T03:44:06.384ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
111252024-12-14T03:44:06.385ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111262024-12-14T03:44:06.388ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1, lookup_type: ById(eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1) } result = Ok(())
111272024-12-14T03:44:06.388ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
111282024-12-14T03:44:06.388ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
111292024-12-14T03:44:06.398ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1 original_time_created = 2024-12-14 03:34:51.368980 UTC target_id = eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1 time_created = 2024-12-14 03:34:51.368980 UTC
111302024-12-14T03:44:06.398ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 49.436901ms iteration = 56 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1","time_created":"2024-12-14T03:34:51.368980Z"}
111312024-12-14T03:44:15.614ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1218 local_addr = [fd00:1122:3344:101::b]:56585 method = GET remote_addr = [fd00:1122:3344:101::d]:58979 req_id = c5991eeb-5f16-4116-a107-17d1296c10d7 response_code = 200 uri = /5f2fe413-3c4a-4994-b4a0-995c1da486b1
111322024-12-14T03:44:16.348ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 57 reason = Timeout
111332024-12-14T03:44:16.349ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 57 reason = Timeout
111342024-12-14T03:44:16.349ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
111352024-12-14T03:44:16.349ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
111362024-12-14T03:44:16.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
111372024-12-14T03:44:16.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
111382024-12-14T03:44:16.351ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111392024-12-14T03:44:16.351ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
111402024-12-14T03:44:16.352ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
111412024-12-14T03:44:16.353ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
111422024-12-14T03:44:16.353ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
111432024-12-14T03:44:16.354ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
111442024-12-14T03:44:16.356ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
111452024-12-14T03:44:16.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
111462024-12-14T03:44:16.357ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111472024-12-14T03:44:16.360ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1, lookup_type: ById(eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1) } result = Ok(())
111482024-12-14T03:44:16.360ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
111492024-12-14T03:44:16.360ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
111502024-12-14T03:44:16.371ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1 original_time_created = 2024-12-14 03:34:51.368980 UTC target_id = eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1 time_created = 2024-12-14 03:34:51.368980 UTC
111512024-12-14T03:44:16.371ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.540032ms iteration = 57 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1","time_created":"2024-12-14T03:34:51.368980Z"}
111522024-12-14T03:44:16.381ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 32.378189ms iteration = 57 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
111532024-12-14T03:44:21.345ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:60953
111542024-12-14T03:44:21.345ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:60953 req_id = f9fdb488-381d-4999-a1c5-a12b15817368 roles = RoleSet { roles: {} } uri = /metrics/producers
111552024-12-14T03:44:21.346ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:60953 req_id = f9fdb488-381d-4999-a1c5-a12b15817368 resource = Database result = Ok(()) uri = /metrics/producers
111562024-12-14T03:44:21.378ZINFOnexus: assigned collector to new producer collector_id = a321e00a-3126-4ea4-b26d-c0e3eea69166 file = nexus/src/app/oximeter.rs:76 producer_id = c4ff451e-ab57-4adc-b747-11f26d0ffcfa
111572024-12-14T03:44:21.378ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 33059 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:60953 req_id = f9fdb488-381d-4999-a1c5-a12b15817368 response_code = 201 uri = /metrics/producers
111582024-12-14T03:44:25.604ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:56805 req_id = c294c97b-acbe-4cda-885f-d625f1bb30c8 roles = RoleSet { roles: {} } uri = /metrics/collectors/a321e00a-3126-4ea4-b26d-c0e3eea69166/producers?sort_by=id_ascending
111592024-12-14T03:44:25.604ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:56805 req_id = c294c97b-acbe-4cda-885f-d625f1bb30c8 resource = Database result = Ok(()) uri = /metrics/collectors/a321e00a-3126-4ea4-b26d-c0e3eea69166/producers?sort_by=id_ascending
111602024-12-14T03:44:25.609ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4729 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:56805 req_id = c294c97b-acbe-4cda-885f-d625f1bb30c8 response_code = 200 uri = /metrics/collectors/a321e00a-3126-4ea4-b26d-c0e3eea69166/producers?sort_by=id_ascending
111612024-12-14T03:44:25.609ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:56805 req_id = 0362a55b-8cae-44af-8ad3-abe802b9ca8c roles = RoleSet { roles: {} } uri = /metrics/collectors/a321e00a-3126-4ea4-b26d-c0e3eea69166/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlOGQ5NjQ2Zi1hNTQxLTRjMTEtYjViMi1mOTUzNDI3Y2EyZjMifX0%3D
111622024-12-14T03:44:25.609ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:56805 req_id = 0362a55b-8cae-44af-8ad3-abe802b9ca8c resource = Database result = Ok(()) uri = /metrics/collectors/a321e00a-3126-4ea4-b26d-c0e3eea69166/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlOGQ5NjQ2Zi1hNTQxLTRjMTEtYjViMi1mOTUzNDI3Y2EyZjMifX0%3D
111632024-12-14T03:44:25.612ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2615 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:56805 req_id = 0362a55b-8cae-44af-8ad3-abe802b9ca8c response_code = 200 uri = /metrics/collectors/a321e00a-3126-4ea4-b26d-c0e3eea69166/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlOGQ5NjQ2Zi1hNTQxLTRjMTEtYjViMi1mOTUzNDI3Y2EyZjMifX0%3D
111642024-12-14T03:44:25.614ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1004 local_addr = [fd00:1122:3344:101::b]:56585 method = GET remote_addr = [fd00:1122:3344:101::d]:58979 req_id = 02401390-aa25-4111-9293-5d83e715a610 response_code = 200 uri = /5f2fe413-3c4a-4994-b4a0-995c1da486b1
111652024-12-14T03:44:26.349ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 21 reason = Timeout
111662024-12-14T03:44:26.349ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
111672024-12-14T03:44:26.349ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 20 reason = Timeout
111682024-12-14T03:44:26.349ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
111692024-12-14T03:44:26.349ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 20 reason = Timeout
111702024-12-14T03:44:26.349ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
111712024-12-14T03:44:26.349ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 58 reason = Timeout
111722024-12-14T03:44:26.349ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 20 reason = Timeout
111732024-12-14T03:44:26.349ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
111742024-12-14T03:44:26.349ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 20 reason = Timeout
111752024-12-14T03:44:26.349ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
111762024-12-14T03:44:26.349ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
111772024-12-14T03:44:26.349ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
111782024-12-14T03:44:26.349ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 58 reason = Timeout
111792024-12-14T03:44:26.349ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
111802024-12-14T03:44:26.349ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 20 reason = Timeout
111812024-12-14T03:44:26.349ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
111822024-12-14T03:44:26.349ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 20 reason = Timeout
111832024-12-14T03:44:26.349ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 22 reason = Timeout
111842024-12-14T03:44:26.349ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
111852024-12-14T03:44:26.349ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 20 reason = Timeout
111862024-12-14T03:44:26.349ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
111872024-12-14T03:44:26.349ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
111882024-12-14T03:44:26.349ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 20 reason = Timeout
111892024-12-14T03:44:26.349ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
111902024-12-14T03:44:26.349ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 20 reason = Timeout
111912024-12-14T03:44:26.349ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 20 reason = Timeout
111922024-12-14T03:44:26.349ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
111932024-12-14T03:44:26.349ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
111942024-12-14T03:44:26.349ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 20 reason = Timeout
111952024-12-14T03:44:26.349ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
111962024-12-14T03:44:26.349ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 20 reason = Timeout
111972024-12-14T03:44:26.349ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
111982024-12-14T03:44:26.349ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 20 reason = Timeout
111992024-12-14T03:44:26.349ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
112002024-12-14T03:44:26.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
112012024-12-14T03:44:26.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
112022024-12-14T03:44:26.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
112032024-12-14T03:44:26.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
112042024-12-14T03:44:26.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
112052024-12-14T03:44:26.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
112062024-12-14T03:44:26.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
112072024-12-14T03:44:26.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
112082024-12-14T03:44:26.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
112092024-12-14T03:44:26.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
112102024-12-14T03:44:26.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
112112024-12-14T03:44:26.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
112122024-12-14T03:44:26.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
112132024-12-14T03:44:26.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
112142024-12-14T03:44:26.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
112152024-12-14T03:44:26.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
112162024-12-14T03:44:26.352ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112172024-12-14T03:44:26.352ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.588042ms iteration = 20 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
112182024-12-14T03:44:26.354ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
112192024-12-14T03:44:26.354ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
112202024-12-14T03:44:26.354ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
112212024-12-14T03:44:26.356ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112222024-12-14T03:44:26.359ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
112232024-12-14T03:44:26.359ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
112242024-12-14T03:44:26.359ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
112252024-12-14T03:44:26.359ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8d70e61c-94ed-41ce-b36c-cb904f92c534.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8d70e61c-94ed-41ce-b36c-cb904f92c534.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1672, tv_nsec: 675683245 } })
112262024-12-14T03:44:26.360ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
112272024-12-14T03:44:26.360ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8d70e61c-94ed-41ce-b36c-cb904f92c534.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8d70e61c-94ed-41ce-b36c-cb904f92c534.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1672, tv_nsec: 676740506 } })
112282024-12-14T03:44:26.360ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
112292024-12-14T03:44:26.361ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112302024-12-14T03:44:26.363ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 13.99177ms iteration = 20 status = {"errors":[],"records_set_to_done":[]}
112312024-12-14T03:44:26.363ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
112322024-12-14T03:44:26.363ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
112332024-12-14T03:44:26.363ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
112342024-12-14T03:44:26.365ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
112352024-12-14T03:44:26.365ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
112362024-12-14T03:44:26.369ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112372024-12-14T03:44:26.372ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1, lookup_type: ById(eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1) } result = Ok(())
112382024-12-14T03:44:26.372ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
112392024-12-14T03:44:26.372ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
112402024-12-14T03:44:26.389ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
112412024-12-14T03:44:26.390ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
112422024-12-14T03:44:26.392ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1 original_time_created = 2024-12-14 03:34:51.368980 UTC target_id = eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1 time_created = 2024-12-14 03:34:51.368980 UTC
112432024-12-14T03:44:26.392ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 43.620474ms iteration = 58 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1","time_created":"2024-12-14T03:34:51.368980Z"}
112442024-12-14T03:44:26.393ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 43.761707ms iteration = 58 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
112452024-12-14T03:44:26.394ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112462024-12-14T03:44:26.395ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
112472024-12-14T03:44:26.395ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
112482024-12-14T03:44:26.396ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112492024-12-14T03:44:26.396ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
112502024-12-14T03:44:26.396ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
112512024-12-14T03:44:26.397ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
112522024-12-14T03:44:26.397ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
112532024-12-14T03:44:26.397ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
112542024-12-14T03:44:26.397ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
112552024-12-14T03:44:26.397ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
112562024-12-14T03:44:26.398ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
112572024-12-14T03:44:26.398ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
112582024-12-14T03:44:26.398ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
112592024-12-14T03:44:26.401ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8d70e61c-94ed-41ce-b36c-cb904f92c534.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8d70e61c-94ed-41ce-b36c-cb904f92c534.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1672, tv_nsec: 717407001 } })
112602024-12-14T03:44:26.401ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
112612024-12-14T03:44:26.401ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 51.93672ms iteration = 20 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
112622024-12-14T03:44:26.401ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 51.821918ms iteration = 20 status = {"errors":[],"garbage_collect_requested":[]}
112632024-12-14T03:44:26.401ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200
112642024-12-14T03:44:26.401ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
112652024-12-14T03:44:26.401ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
112662024-12-14T03:44:26.401ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
112672024-12-14T03:44:26.401ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
112682024-12-14T03:44:26.401ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
112692024-12-14T03:44:26.401ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
112702024-12-14T03:44:26.402ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112712024-12-14T03:44:26.403ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112722024-12-14T03:44:26.404ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
112732024-12-14T03:44:26.404ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
112742024-12-14T03:44:26.405ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
112752024-12-14T03:44:26.405ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
112762024-12-14T03:44:26.405ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
112772024-12-14T03:44:26.405ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
112782024-12-14T03:44:26.406ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
112792024-12-14T03:44:26.406ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
112802024-12-14T03:44:26.406ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
112812024-12-14T03:44:26.406ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
112822024-12-14T03:44:26.407ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
112832024-12-14T03:44:26.407ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 58.572914ms iteration = 20 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
112842024-12-14T03:44:26.408ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
112852024-12-14T03:44:26.424ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 75.3543ms iteration = 20 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
112862024-12-14T03:44:26.428ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
112872024-12-14T03:44:26.429ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
112882024-12-14T03:44:26.430ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112892024-12-14T03:44:26.431ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
112902024-12-14T03:44:26.431ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
112912024-12-14T03:44:26.432ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
112922024-12-14T03:44:26.432ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
112932024-12-14T03:44:26.433ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
112942024-12-14T03:44:26.433ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
112952024-12-14T03:44:26.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
112962024-12-14T03:44:26.434ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
112972024-12-14T03:44:26.434ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
112982024-12-14T03:44:26.435ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "02d1ae10-8963-46be-88f8-c9646a95cf08", "content-length": "26", "date": "Sat, 14 Dec 2024 03:44:26 GMT"} })
112992024-12-14T03:44:26.435ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
113002024-12-14T03:44:26.437ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
113012024-12-14T03:44:26.438ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
113022024-12-14T03:44:26.438ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
113032024-12-14T03:44:26.438ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 89.445411ms iteration = 20 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
113042024-12-14T03:44:26.450ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
113052024-12-14T03:44:26.450ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
113062024-12-14T03:44:26.450ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "75c6a11e-76b7-4602-acb0-eb696cbe672e", "content-length": "26", "date": "Sat, 14 Dec 2024 03:44:26 GMT"} })
113072024-12-14T03:44:26.450ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
113082024-12-14T03:44:26.453ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
113092024-12-14T03:44:26.476ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113102024-12-14T03:44:26.477ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 127.907152ms iteration = 20 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
113112024-12-14T03:44:26.479ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 8d70e61c-94ed-41ce-b36c-cb904f92c534, lookup_type: ById(8d70e61c-94ed-41ce-b36c-cb904f92c534) } result = Ok(())
113122024-12-14T03:44:26.479ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
113132024-12-14T03:44:26.479ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
113142024-12-14T03:44:26.482ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 133.068595ms iteration = 20 status = 0
113152024-12-14T03:44:26.485ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
113162024-12-14T03:44:26.486ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
113172024-12-14T03:44:26.528ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 zone_address = fd00:1122:3344:101::2
113182024-12-14T03:44:26.528ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
113192024-12-14T03:44:26.528ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6b09b20d-ca95-4a5d-9717-3473702009be", "content-length": "26", "date": "Sat, 14 Dec 2024 03:44:26 GMT"} })
113202024-12-14T03:44:26.528ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
113212024-12-14T03:44:26.530ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200
113222024-12-14T03:44:26.532ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
113232024-12-14T03:44:26.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
113242024-12-14T03:44:26.535ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113252024-12-14T03:44:26.537ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
113262024-12-14T03:44:26.537ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "2e3fa972-c222-4729-96c7-9da7c07725ab", "content-length": "1", "date": "Sat, 14 Dec 2024 03:44:25 GMT"} })
113272024-12-14T03:44:26.537ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
113282024-12-14T03:44:26.537ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
113292024-12-14T03:44:26.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
113302024-12-14T03:44:26.539ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
113312024-12-14T03:44:26.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
113322024-12-14T03:44:26.553ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 204.506696ms iteration = 22 status = {"physical_disks_added":0}
113332024-12-14T03:44:26.575ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 226.622319ms iteration = 20 status = {}
113342024-12-14T03:44:26.588ZINFOnexus (BackgroundTasks): VPC route manager sled 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
113352024-12-14T03:44:26.588ZDEBGnexus (BackgroundTasks): client request SledAgent = 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
113362024-12-14T03:44:26.589ZDEBGnexus (BackgroundTasks): client response SledAgent = 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "d99c47a7-2954-40e8-b63b-d652b845cf51", "content-length": "372", "date": "Sat, 14 Dec 2024 03:44:26 GMT"} })
113372024-12-14T03:44:26.589ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
113382024-12-14T03:44:26.589ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
113392024-12-14T03:44:26.591ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113402024-12-14T03:44:26.592ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 243.252613ms iteration = 20 status = null
113412024-12-14T03:44:26.595ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
113422024-12-14T03:44:26.595ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
113432024-12-14T03:44:26.595ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
113442024-12-14T03:44:26.646ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
113452024-12-14T03:44:26.646ZDEBGnexus (BackgroundTasks): client request SledAgent = 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
113462024-12-14T03:44:26.647ZDEBGnexus (BackgroundTasks): client response SledAgent = 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "637207c0-6e1d-4c5d-a260-22cb16f27cc9", "date": "Sat, 14 Dec 2024 03:44:26 GMT"} })
113472024-12-14T03:44:26.647ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
113482024-12-14T03:44:26.647ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
113492024-12-14T03:44:26.647ZDEBGnexus (BackgroundTasks): client request SledAgent = 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
113502024-12-14T03:44:26.648ZDEBGnexus (BackgroundTasks): client response SledAgent = 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "9605a833-0f5c-4993-8351-208515712677", "content-length": "691", "date": "Sat, 14 Dec 2024 03:44:26 GMT"} })
113512024-12-14T03:44:26.648ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
113522024-12-14T03:44:26.648ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
113532024-12-14T03:44:26.648ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
113542024-12-14T03:44:26.650ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 301.268335ms iteration = 20 status = {}
113552024-12-14T03:44:26.651ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
113562024-12-14T03:44:26.651ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
113572024-12-14T03:44:26.655ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
113582024-12-14T03:44:26.656ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
113592024-12-14T03:44:26.661ZINFOnexus (BackgroundTasks): VPC route manager sled 8d70e61c-94ed-41ce-b36c-cb904f92c534 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
113602024-12-14T03:44:26.661ZDEBGnexus (BackgroundTasks): client request SledAgent = 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
113612024-12-14T03:44:26.661ZDEBGnexus (BackgroundTasks): client response SledAgent = 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "acc6a9eb-8a20-4c8b-8e1b-9d6637b943b5", "date": "Sat, 14 Dec 2024 03:44:26 GMT"} })
113622024-12-14T03:44:26.663ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 314.109632ms iteration = 21 status = {}
113632024-12-14T03:44:26.683ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
113642024-12-14T03:44:26.684ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
113652024-12-14T03:44:26.685ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 45ca990e-42e9-4264-be3e-0adfed2cd99b, rack_id: a121ca05-bbee-41bf-b9db-9e03ff035200, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(811a570a-bdaf-4a1b-8eba-0c0e4977f7bb) } rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 switch_location = Switch0
113662024-12-14T03:44:26.685ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
113672024-12-14T03:44:26.686ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
113682024-12-14T03:44:26.695ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
113692024-12-14T03:44:26.695ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "a0a2c29c-b11e-41aa-94d3-c7ad4c717ec1", "content-length": "134", "date": "Sat, 14 Dec 2024 03:44:25 GMT"} })
113702024-12-14T03:44:26.695ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
113712024-12-14T03:44:26.695ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 811a570a-bdaf-4a1b-8eba-0c0e4977f7bb
113722024-12-14T03:44:26.695ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
113732024-12-14T03:44:26.695ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
113742024-12-14T03:44:26.695ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
113752024-12-14T03:44:26.695ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
113762024-12-14T03:44:26.695ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
113772024-12-14T03:44:26.695ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
113782024-12-14T03:44:26.696ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
113792024-12-14T03:44:26.696ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
113802024-12-14T03:44:26.697ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200
113812024-12-14T03:44:26.697ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
113822024-12-14T03:44:26.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
113832024-12-14T03:44:26.699ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
113842024-12-14T03:44:26.699ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "f64b2b96-2118-4b07-97b7-c641de8eb6d5", "content-length": "2", "date": "Sat, 14 Dec 2024 03:44:25 GMT"} })
113852024-12-14T03:44:26.699ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
113862024-12-14T03:44:26.699ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "e75c65b5-31b2-4e36-b6db-d1760ed5bb7e", "content-length": "52", "date": "Sat, 14 Dec 2024 03:44:25 GMT"} })
113872024-12-14T03:44:26.699ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 switch_location = Switch0
113882024-12-14T03:44:26.699ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
113892024-12-14T03:44:26.794ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "dbfab23b-a09c-4b34-bc1c-9ca450b2ba7a", "date": "Sat, 14 Dec 2024 03:44:26 GMT"} })
113902024-12-14T03:44:26.794ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 switch = Switch0
113912024-12-14T03:44:26.794ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
113922024-12-14T03:44:26.794ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "e4bbb072-bc79-4429-9c5d-db421c963085", "content-length": "682", "date": "Sat, 14 Dec 2024 03:44:26 GMT"} })
113932024-12-14T03:44:26.794ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
113942024-12-14T03:44:26.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
113952024-12-14T03:44:26.798ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
113962024-12-14T03:44:26.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
113972024-12-14T03:44:26.801ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
113982024-12-14T03:44:26.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
113992024-12-14T03:44:26.804ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
114002024-12-14T03:44:26.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
114012024-12-14T03:44:26.811ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 462.303091ms iteration = 20 status = {}
114022024-12-14T03:44:35.615ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1038 local_addr = [fd00:1122:3344:101::b]:56585 method = GET remote_addr = [fd00:1122:3344:101::d]:58979 req_id = 36a99e36-87fd-4a1e-aadd-017b60400c4f response_code = 200 uri = /5f2fe413-3c4a-4994-b4a0-995c1da486b1
114032024-12-14T03:44:36.348ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 59 reason = Timeout
114042024-12-14T03:44:36.348ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 59 reason = Timeout
114052024-12-14T03:44:36.348ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
114062024-12-14T03:44:36.348ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
114072024-12-14T03:44:36.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
114082024-12-14T03:44:36.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
114092024-12-14T03:44:36.350ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
114102024-12-14T03:44:36.350ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
114112024-12-14T03:44:36.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
114122024-12-14T03:44:36.352ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.900868ms iteration = 59 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
114132024-12-14T03:44:36.353ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
114142024-12-14T03:44:36.353ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
114152024-12-14T03:44:36.353ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
114162024-12-14T03:44:36.355ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
114172024-12-14T03:44:36.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
114182024-12-14T03:44:36.356ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
114192024-12-14T03:44:36.359ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1, lookup_type: ById(eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1) } result = Ok(())
114202024-12-14T03:44:36.359ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
114212024-12-14T03:44:36.359ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
114222024-12-14T03:44:36.371ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1 original_time_created = 2024-12-14 03:34:51.368980 UTC target_id = eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1 time_created = 2024-12-14 03:34:51.368980 UTC
114232024-12-14T03:44:36.371ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.698515ms iteration = 59 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1","time_created":"2024-12-14T03:34:51.368980Z"}
114242024-12-14T03:44:45.614ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1006 local_addr = [fd00:1122:3344:101::b]:56585 method = GET remote_addr = [fd00:1122:3344:101::d]:58979 req_id = ab72ed2a-1626-4d0b-a06c-112feee1e0fd response_code = 200 uri = /5f2fe413-3c4a-4994-b4a0-995c1da486b1
114252024-12-14T03:44:46.348ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 60 reason = Timeout
114262024-12-14T03:44:46.349ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
114272024-12-14T03:44:46.349ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 60 reason = Timeout
114282024-12-14T03:44:46.349ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
114292024-12-14T03:44:46.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
114302024-12-14T03:44:46.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
114312024-12-14T03:44:46.351ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
114322024-12-14T03:44:46.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
114332024-12-14T03:44:46.351ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
114342024-12-14T03:44:46.353ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.128812ms iteration = 60 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
114352024-12-14T03:44:46.354ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
114362024-12-14T03:44:46.354ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
114372024-12-14T03:44:46.354ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
114382024-12-14T03:44:46.356ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
114392024-12-14T03:44:46.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
114402024-12-14T03:44:46.358ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
114412024-12-14T03:44:46.360ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1, lookup_type: ById(eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1) } result = Ok(())
114422024-12-14T03:44:46.360ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
114432024-12-14T03:44:46.361ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
114442024-12-14T03:44:46.368ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1 original_time_created = 2024-12-14 03:34:51.368980 UTC target_id = eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1 time_created = 2024-12-14 03:34:51.368980 UTC
114452024-12-14T03:44:46.368ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.999991ms iteration = 60 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1","time_created":"2024-12-14T03:34:51.368980Z"}
114462024-12-14T03:44:55.615ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1171 local_addr = [fd00:1122:3344:101::b]:56585 method = GET remote_addr = [fd00:1122:3344:101::d]:58979 req_id = 9ffc973c-07aa-46c2-aadb-1f2ed8fb25ee response_code = 200 uri = /5f2fe413-3c4a-4994-b4a0-995c1da486b1
114472024-12-14T03:44:56.089ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:42556
114482024-12-14T03:44:56.089ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:42556 req_id = ffd20514-d7c7-421e-a0a2-52ea96515af9 roles = RoleSet { roles: {} } uri = /metrics/producers
114492024-12-14T03:44:56.089ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:42556 req_id = ffd20514-d7c7-421e-a0a2-52ea96515af9 resource = Database result = Ok(()) uri = /metrics/producers
114502024-12-14T03:44:56.129ZINFOnexus: assigned collector to new producer collector_id = a321e00a-3126-4ea4-b26d-c0e3eea69166 file = nexus/src/app/oximeter.rs:76 producer_id = d278f717-338f-4586-9211-4636baa82004
114512024-12-14T03:44:56.129ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 40582 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:42556 req_id = ffd20514-d7c7-421e-a0a2-52ea96515af9 response_code = 201 uri = /metrics/producers
114522024-12-14T03:44:56.349ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 22 reason = Timeout
114532024-12-14T03:44:56.349ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
114542024-12-14T03:44:56.349ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 21 reason = Timeout
114552024-12-14T03:44:56.349ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
114562024-12-14T03:44:56.349ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 21 reason = Timeout
114572024-12-14T03:44:56.349ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
114582024-12-14T03:44:56.349ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
114592024-12-14T03:44:56.349ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 61 reason = Timeout
114602024-12-14T03:44:56.349ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
114612024-12-14T03:44:56.349ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 13 reason = Timeout
114622024-12-14T03:44:56.349ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 12 reason = Timeout
114632024-12-14T03:44:56.349ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
114642024-12-14T03:44:56.349ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
114652024-12-14T03:44:56.349ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 21 reason = Timeout
114662024-12-14T03:44:56.349ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 61 reason = Timeout
114672024-12-14T03:44:56.349ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
114682024-12-14T03:44:56.349ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 21 reason = Timeout
114692024-12-14T03:44:56.349ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
114702024-12-14T03:44:56.349ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
114712024-12-14T03:44:56.349ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 13 reason = Timeout
114722024-12-14T03:44:56.349ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 21 reason = Timeout
114732024-12-14T03:44:56.349ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 12 reason = Timeout
114742024-12-14T03:44:56.349ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 12 reason = Timeout
114752024-12-14T03:44:56.349ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
114762024-12-14T03:44:56.349ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 21 reason = Timeout
114772024-12-14T03:44:56.349ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
114782024-12-14T03:44:56.349ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
114792024-12-14T03:44:56.349ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 12 reason = Timeout
114802024-12-14T03:44:56.349ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 21 reason = Timeout
114812024-12-14T03:44:56.350ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
114822024-12-14T03:44:56.350ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
114832024-12-14T03:44:56.350ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
114842024-12-14T03:44:56.350ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 11 reason = Timeout
114852024-12-14T03:44:56.350ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
114862024-12-14T03:44:56.350ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 12 reason = Timeout
114872024-12-14T03:44:56.350ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1
114882024-12-14T03:44:56.350ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 16.16\u{b5}s iteration = 12 status = {"enabled":false,"target_id":"eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1"}
114892024-12-14T03:44:56.350ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 11 reason = Timeout
114902024-12-14T03:44:56.350ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
114912024-12-14T03:44:56.350ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
114922024-12-14T03:44:56.350ZDEBGnexus (BackgroundTasks): activating background_task = saga_recovery iteration = 2 reason = Timeout
114932024-12-14T03:44:56.350ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 11 reason = Timeout
114942024-12-14T03:44:56.350ZDEBGnexus (SagaRecoverer): listing candidate sagas for recovery
114952024-12-14T03:44:56.350ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-14 03:34:56.350038434 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
114962024-12-14T03:44:56.350ZDEBGnexus (SagaRecoverer): roles roles = RoleSet { roles: {} }
114972024-12-14T03:44:56.350ZDEBGnexus (BackgroundTasks): activating background_task = inventory_collection iteration = 3 reason = Timeout
114982024-12-14T03:44:56.350ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
114992024-12-14T03:44:56.350ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 21 reason = Timeout
115002024-12-14T03:44:56.350ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
115012024-12-14T03:44:56.350ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 11 reason = Timeout
115022024-12-14T03:44:56.350ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
115032024-12-14T03:44:56.350ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
115042024-12-14T03:44:56.350ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 3 reason = Timeout
115052024-12-14T03:44:56.350ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
115062024-12-14T03:44:56.350ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
115072024-12-14T03:44:56.350ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 21 reason = Timeout
115082024-12-14T03:44:56.350ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
115092024-12-14T03:44:56.350ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 11 reason = Timeout
115102024-12-14T03:44:56.350ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
115112024-12-14T03:44:56.350ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 21 reason = Timeout
115122024-12-14T03:44:56.350ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
115132024-12-14T03:44:56.350ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 23 reason = Timeout
115142024-12-14T03:44:56.350ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
115152024-12-14T03:44:56.350ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 12 reason = Timeout
115162024-12-14T03:44:56.350ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 21 reason = Timeout
115172024-12-14T03:44:56.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
115182024-12-14T03:44:56.350ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 21 reason = Timeout
115192024-12-14T03:44:56.350ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
115202024-12-14T03:44:56.350ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
115212024-12-14T03:44:56.350ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 21 reason = Timeout
115222024-12-14T03:44:56.350ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
115232024-12-14T03:44:56.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
115242024-12-14T03:44:56.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
115252024-12-14T03:44:56.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
115262024-12-14T03:44:56.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
115272024-12-14T03:44:56.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
115282024-12-14T03:44:56.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
115292024-12-14T03:44:56.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
115302024-12-14T03:44:56.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
115312024-12-14T03:44:56.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
115322024-12-14T03:44:56.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
115332024-12-14T03:44:56.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
115342024-12-14T03:44:56.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
115352024-12-14T03:44:56.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
115362024-12-14T03:44:56.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
115372024-12-14T03:44:56.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
115382024-12-14T03:44:56.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
115392024-12-14T03:44:56.350ZDEBGnexus (SagaRecoverer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000003a8a, .. }) resource = Database result = Ok(())
115402024-12-14T03:44:56.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
115412024-12-14T03:44:56.350ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("28f528f1-3159-4fbc-9304-37b7e4a50ae8.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7274e15f-a5f6-4975-bcdd-a2ef890c0230.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("7274e15f-a5f6-4975-bcdd-a2ef890c0230.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1702, tv_nsec: 666915239 } })
115422024-12-14T03:44:56.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
115432024-12-14T03:44:56.351ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("3db8556d-0ae0-4824-8953-f38d8eef7409.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7b672843-049d-4d9c-b0a2-21d7b6323621.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("db39fe07-65c4-451a-a2bd-78fcdfc10040.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("db39fe07-65c4-451a-a2bd-78fcdfc10040.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1702, tv_nsec: 666932719 } })
115442024-12-14T03:44:56.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
115452024-12-14T03:44:56.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
115462024-12-14T03:44:56.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
115472024-12-14T03:44:56.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
115482024-12-14T03:44:56.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
115492024-12-14T03:44:56.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
115502024-12-14T03:44:56.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
115512024-12-14T03:44:56.351ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
115522024-12-14T03:44:56.351ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.157263ms iteration = 12 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
115532024-12-14T03:44:56.351ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
115542024-12-14T03:44:56.351ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.534611ms iteration = 12 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
115552024-12-14T03:44:56.352ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115562024-12-14T03:44:56.354ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.315467ms iteration = 21 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
115572024-12-14T03:44:56.354ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
115582024-12-14T03:44:56.354ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
115592024-12-14T03:44:56.354ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
115602024-12-14T03:44:56.354ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115612024-12-14T03:44:56.354ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8d70e61c-94ed-41ce-b36c-cb904f92c534.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8d70e61c-94ed-41ce-b36c-cb904f92c534.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1702, tv_nsec: 670744486 } })
115622024-12-14T03:44:56.354ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
115632024-12-14T03:44:56.355ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
115642024-12-14T03:44:56.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
115652024-12-14T03:44:56.356ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
115662024-12-14T03:44:56.356ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115672024-12-14T03:44:56.357ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
115682024-12-14T03:44:56.357ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
115692024-12-14T03:44:56.357ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
115702024-12-14T03:44:56.357ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115712024-12-14T03:44:56.357ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
115722024-12-14T03:44:56.359ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115732024-12-14T03:44:56.359ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
115742024-12-14T03:44:56.359ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
115752024-12-14T03:44:56.359ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
115762024-12-14T03:44:56.360ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
115772024-12-14T03:44:56.360ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
115782024-12-14T03:44:56.360ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
115792024-12-14T03:44:56.362ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
115802024-12-14T03:44:56.362ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
115812024-12-14T03:44:56.362ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
115822024-12-14T03:44:56.362ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
115832024-12-14T03:44:56.362ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
115842024-12-14T03:44:56.362ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115852024-12-14T03:44:56.362ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
115862024-12-14T03:44:56.362ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
115872024-12-14T03:44:56.364ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
115882024-12-14T03:44:56.364ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
115892024-12-14T03:44:56.364ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
115902024-12-14T03:44:56.364ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
115912024-12-14T03:44:56.364ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
115922024-12-14T03:44:56.365ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 15.745766ms iteration = 11 status = {"errors":[],"found_port_ok":[]}
115932024-12-14T03:44:56.367ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8d70e61c-94ed-41ce-b36c-cb904f92c534.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8d70e61c-94ed-41ce-b36c-cb904f92c534.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1702, tv_nsec: 683408380 } })
115942024-12-14T03:44:56.367ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
115952024-12-14T03:44:56.367ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-14 03:34:56.350038434 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
115962024-12-14T03:44:56.367ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 17.856088ms iteration = 11 status = {"expiration":"2024-12-14T03:34:56.350038434Z","pruned":[]}
115972024-12-14T03:44:56.368ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115982024-12-14T03:44:56.370ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
115992024-12-14T03:44:56.370ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
116002024-12-14T03:44:56.370ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
116012024-12-14T03:44:56.376ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116022024-12-14T03:44:56.377ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116032024-12-14T03:44:56.379ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116042024-12-14T03:44:56.379ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
116052024-12-14T03:44:56.379ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
116062024-12-14T03:44:56.380ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
116072024-12-14T03:44:56.381ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
116082024-12-14T03:44:56.382ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
116092024-12-14T03:44:56.383ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
116102024-12-14T03:44:56.383ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
116112024-12-14T03:44:56.383ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
116122024-12-14T03:44:56.383ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
116132024-12-14T03:44:56.383ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
116142024-12-14T03:44:56.383ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
116152024-12-14T03:44:56.383ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
116162024-12-14T03:44:56.385ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8d70e61c-94ed-41ce-b36c-cb904f92c534.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8d70e61c-94ed-41ce-b36c-cb904f92c534.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1702, tv_nsec: 700940041 } })
116172024-12-14T03:44:56.385ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200
116182024-12-14T03:44:56.387ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
116192024-12-14T03:44:56.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
116202024-12-14T03:44:56.389ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
116212024-12-14T03:44:56.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
116222024-12-14T03:44:56.391ZDEBGnexus (BackgroundTasks): inventory_prune_one: eligible for removal background_task = inventory_collection candidates = [(4d99c1d3-3ed9-4e96-8a1e-fbb486858f71, 0), (685109b5-7be5-4359-9979-d56c9af49240, 0), (0b6b7861-d0fc-41e3-ad38-89d90540f360, 0), (0c1afe3f-64fc-4a70-bab2-386a5f289a1b, 0)] collection_id = 4d99c1d3-3ed9-4e96-8a1e-fbb486858f71
116232024-12-14T03:44:56.391ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
116242024-12-14T03:44:56.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
116252024-12-14T03:44:56.394ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
116262024-12-14T03:44:56.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
116272024-12-14T03:44:56.396ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116282024-12-14T03:44:56.401ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
116292024-12-14T03:44:56.401ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
116302024-12-14T03:44:56.401ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
116312024-12-14T03:44:56.403ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116322024-12-14T03:44:56.406ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
116332024-12-14T03:44:56.406ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
116342024-12-14T03:44:56.407ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1, lookup_type: ById(eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1) } result = Ok(())
116352024-12-14T03:44:56.407ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
116362024-12-14T03:44:56.407ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
116372024-12-14T03:44:56.409ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
116382024-12-14T03:44:56.410ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
116392024-12-14T03:44:56.412ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116402024-12-14T03:44:56.413ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
116412024-12-14T03:44:56.413ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
116422024-12-14T03:44:56.413ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 63.707426ms iteration = 11 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
116432024-12-14T03:44:56.413ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
116442024-12-14T03:44:56.413ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
116452024-12-14T03:44:56.414ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
116462024-12-14T03:44:56.414ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116472024-12-14T03:44:56.415ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
116482024-12-14T03:44:56.415ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
116492024-12-14T03:44:56.415ZINFOnexus (SagaRecoverer): listed in-progress sagas count = 0 file = nexus/src/app/background/tasks/saga_recovery.rs:438
116502024-12-14T03:44:56.415ZINFOnexus (BackgroundTasks): observed saga start background_task = saga_recovery file = nexus/saga-recovery/src/recovery.rs:76 saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1
116512024-12-14T03:44:56.415ZINFOnexus (BackgroundTasks): observed saga start background_task = saga_recovery file = nexus/saga-recovery/src/recovery.rs:76 saga_id = e1d583cf-78a1-4cd8-971c-17df5f9fc5bf
116522024-12-14T03:44:56.416ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
116532024-12-14T03:44:56.416ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 51f6df17-b3b5-47fe-9a42-d8752f961c5e dns_zone_name = oxide.test found_so_far = 0 version = 2
116542024-12-14T03:44:56.416ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
116552024-12-14T03:44:56.417ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
116562024-12-14T03:44:56.417ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116572024-12-14T03:44:56.417ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
116582024-12-14T03:44:56.417ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
116592024-12-14T03:44:56.417ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
116602024-12-14T03:44:56.419ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
116612024-12-14T03:44:56.419ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
116622024-12-14T03:44:56.419ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
116632024-12-14T03:44:56.421ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
116642024-12-14T03:44:56.421ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
116652024-12-14T03:44:56.422ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
116662024-12-14T03:44:56.422ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 72.40728ms iteration = 21 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
116672024-12-14T03:44:56.422ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
116682024-12-14T03:44:56.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
116692024-12-14T03:44:56.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
116702024-12-14T03:44:56.422ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116712024-12-14T03:44:56.423ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 72.925841ms iteration = 21 status = {"errors":[],"records_set_to_done":[]}
116722024-12-14T03:44:56.423ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
116732024-12-14T03:44:56.423ZINFOnexus (BackgroundTasks): observed saga start background_task = saga_recovery file = nexus/saga-recovery/src/recovery.rs:76 saga_id = 1e96253d-ab0a-405e-9d9e-175890ec20e6
116742024-12-14T03:44:56.423ZDEBGnexus (BackgroundTasks): found saga that may be done (will be sure on the next pass) background_task = saga_recovery saga_id = 1e96253d-ab0a-405e-9d9e-175890ec20e6
116752024-12-14T03:44:56.423ZDEBGnexus (BackgroundTasks): found saga that may be done (will be sure on the next pass) background_task = saga_recovery saga_id = a0b37f3b-74c0-46c4-8674-e043c1d3fea1
116762024-12-14T03:44:56.423ZDEBGnexus (BackgroundTasks): found saga that may be done (will be sure on the next pass) background_task = saga_recovery saga_id = e1d583cf-78a1-4cd8-971c-17df5f9fc5bf
116772024-12-14T03:44:56.423ZDEBGnexus (BackgroundTasks): activation complete background_task = saga_recovery elapsed = 73.293159ms iteration = 2 status = {"last_pass":{"Success":{"nfailed":0,"nfound":0,"nrecovered":0,"nremoved":0,"nskipped":0}},"ntotal_failures":0,"ntotal_finished":0,"ntotal_recovered":0,"ntotal_sec_errors_bad_state":0,"ntotal_sec_errors_missing":0,"ntotal_started":3,"recent_failures":[],"recent_recoveries":[]}
116782024-12-14T03:44:56.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
116792024-12-14T03:44:56.423ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 73.611555ms iteration = 21 status = {"errors":[],"garbage_collect_requested":[]}
116802024-12-14T03:44:56.425ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
116812024-12-14T03:44:56.425ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
116822024-12-14T03:44:56.426ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
116832024-12-14T03:44:56.426ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
116842024-12-14T03:44:56.426ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
116852024-12-14T03:44:56.427ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
116862024-12-14T03:44:56.427ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
116872024-12-14T03:44:56.428ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
116882024-12-14T03:44:56.428ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
116892024-12-14T03:44:56.428ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
116902024-12-14T03:44:56.428ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
116912024-12-14T03:44:56.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
116922024-12-14T03:44:56.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
116932024-12-14T03:44:56.429ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
116942024-12-14T03:44:56.429ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 79.315288ms iteration = 21 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
116952024-12-14T03:44:56.429ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
116962024-12-14T03:44:56.430ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
116972024-12-14T03:44:56.431ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116982024-12-14T03:44:56.431ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 51f6df17-b3b5-47fe-9a42-d8752f961c5e dns_zone_name = oxide.test found_so_far = 1 version = 2
116992024-12-14T03:44:56.431ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
117002024-12-14T03:44:56.431ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-14 03:35:40.905586 UTC dns_group = external generation = 2
117012024-12-14T03:44:56.431ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 81.432591ms iteration = 12 status = {"generation":2}
117022024-12-14T03:44:56.431ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
117032024-12-14T03:44:56.431ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
117042024-12-14T03:44:56.431ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
117052024-12-14T03:44:56.431ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
117062024-12-14T03:44:56.432ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1 original_time_created = 2024-12-14 03:34:51.368980 UTC target_id = eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1 time_created = 2024-12-14 03:34:51.368980 UTC
117072024-12-14T03:44:56.432ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
117082024-12-14T03:44:56.432ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 82.37469ms iteration = 61 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"eff0d72e-6ae2-477e-a1ad-1aa0c7f2bfe1","time_created":"2024-12-14T03:34:51.368980Z"}
117092024-12-14T03:44:56.432ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
117102024-12-14T03:44:56.434ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
117112024-12-14T03:44:56.436ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
117122024-12-14T03:44:56.436ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
117132024-12-14T03:44:56.436ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
117142024-12-14T03:44:56.436ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 8d70e61c-94ed-41ce-b36c-cb904f92c534, lookup_type: ById(8d70e61c-94ed-41ce-b36c-cb904f92c534) } result = Ok(())
117152024-12-14T03:44:56.436ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
117162024-12-14T03:44:56.436ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
117172024-12-14T03:44:56.438ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
117182024-12-14T03:44:56.438ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
117192024-12-14T03:44:56.438ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
117202024-12-14T03:44:56.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
117212024-12-14T03:44:56.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
117222024-12-14T03:44:56.438ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 89.160885ms iteration = 21 status = 0
117232024-12-14T03:44:56.440ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
117242024-12-14T03:44:56.440ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = c7a5bbe9-1af5-4e36-80b5-da9e0053b676 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
117252024-12-14T03:44:56.440ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
117262024-12-14T03:44:56.440ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
117272024-12-14T03:44:56.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
117282024-12-14T03:44:56.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
117292024-12-14T03:44:56.441ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
117302024-12-14T03:44:56.442ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
117312024-12-14T03:44:56.445ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
117322024-12-14T03:44:56.445ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
117332024-12-14T03:44:56.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
117342024-12-14T03:44:56.447ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
117352024-12-14T03:44:56.447ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
117362024-12-14T03:44:56.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
117372024-12-14T03:44:56.449ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 99.384151ms iteration = 61 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
117382024-12-14T03:44:56.449ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = c7a5bbe9-1af5-4e36-80b5-da9e0053b676 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
117392024-12-14T03:44:56.449ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
117402024-12-14T03:44:56.449ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-14 03:35:40.104814 UTC dns_group = internal generation = 1
117412024-12-14T03:44:56.449ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 100.107815ms iteration = 12 status = {"generation":1}
117422024-12-14T03:44:56.450ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
117432024-12-14T03:44:56.451ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
117442024-12-14T03:44:56.453ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
117452024-12-14T03:44:56.453ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
117462024-12-14T03:44:56.455ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
117472024-12-14T03:44:56.455ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
117482024-12-14T03:44:56.459ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
117492024-12-14T03:44:56.459ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
117502024-12-14T03:44:56.459ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 109.080435ms iteration = 21 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
117512024-12-14T03:44:56.459ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 109.596005ms iteration = 21 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
117522024-12-14T03:44:56.460ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
117532024-12-14T03:44:56.460ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
117542024-12-14T03:44:56.460ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
117552024-12-14T03:44:56.460ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
117562024-12-14T03:44:56.461ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
117572024-12-14T03:44:56.462ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
117582024-12-14T03:44:56.463ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
117592024-12-14T03:44:56.463ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 113.768799ms iteration = 23 status = {"physical_disks_added":0}
117602024-12-14T03:44:56.464ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
117612024-12-14T03:44:56.464ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
117622024-12-14T03:44:56.465ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
117632024-12-14T03:44:56.465ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
117642024-12-14T03:44:56.465ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
117652024-12-14T03:44:56.466ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
117662024-12-14T03:44:56.469ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
117672024-12-14T03:44:56.469ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
117682024-12-14T03:44:56.469ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
117692024-12-14T03:44:56.471ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
117702024-12-14T03:44:56.471ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
117712024-12-14T03:44:56.473ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
117722024-12-14T03:44:56.473ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
117732024-12-14T03:44:56.473ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 123.32798ms iteration = 11 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
117742024-12-14T03:44:56.473ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
117752024-12-14T03:44:56.473ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
117762024-12-14T03:44:56.473ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 123.34709ms iteration = 21 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
117772024-12-14T03:44:56.475ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
117782024-12-14T03:44:56.475ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
117792024-12-14T03:44:56.476ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
117802024-12-14T03:44:56.476ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
117812024-12-14T03:44:56.478ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
117822024-12-14T03:44:56.478ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
117832024-12-14T03:44:56.479ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
117842024-12-14T03:44:56.479ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
117852024-12-14T03:44:56.480ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
117862024-12-14T03:44:56.484ZINFOnexus (BackgroundTasks): removed inventory collection background_task = inventory_collection collection_id = 4d99c1d3-3ed9-4e96-8a1e-fbb486858f71 file = nexus/db-queries/src/db/datastore/inventory.rs:1442 ncabooses = 12 nclickhouse_keeper_membership = 0 ncollections = 1 ndatasets = 0 nerrors = 0 nnics = 0 nnvme_disk_firmware = 0 nphysical_disks = 0 nrot_pages = 8 nrots = 2 nsled_agent_zones = 0 nsled_agents = 0 nsps = 2 nzones = 0 nzpools = 0
117872024-12-14T03:44:56.484ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
117882024-12-14T03:44:56.485ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
117892024-12-14T03:44:56.486ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
117902024-12-14T03:44:56.486ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
117912024-12-14T03:44:56.487ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
117922024-12-14T03:44:56.488ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
117932024-12-14T03:44:56.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
117942024-12-14T03:44:56.490ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
117952024-12-14T03:44:56.490ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
117962024-12-14T03:44:56.492ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
117972024-12-14T03:44:56.495ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
117982024-12-14T03:44:56.495ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
117992024-12-14T03:44:56.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
118002024-12-14T03:44:56.496ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
118012024-12-14T03:44:56.497ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
118022024-12-14T03:44:56.497ZDEBGnexus (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(685109b5-7be5-4359-9979-d56c9af49240, 0), (0b6b7861-d0fc-41e3-ad38-89d90540f360, 0), (0c1afe3f-64fc-4a70-bab2-386a5f289a1b, 0)]
118032024-12-14T03:44:56.497ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
118042024-12-14T03:44:56.497ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-8d70e61c-94ed-41ce-b36c-cb904f92c534.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8d70e61c-94ed-41ce-b36c-cb904f92c534.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1702, tv_nsec: 813981635 } })
118052024-12-14T03:44:56.498ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
118062024-12-14T03:44:56.500ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
118072024-12-14T03:44:56.500ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
118082024-12-14T03:44:56.500ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
118092024-12-14T03:44:56.500ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b264a56a-59bb-424b-84de-aa6890e68e83", "content-length": "26", "date": "Sat, 14 Dec 2024 03:44:56 GMT"} })
118102024-12-14T03:44:56.500ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
118112024-12-14T03:44:56.500ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
118122024-12-14T03:44:56.500ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
118132024-12-14T03:44:56.501ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
118142024-12-14T03:44:56.501ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
118152024-12-14T03:44:56.501ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
118162024-12-14T03:44:56.502ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
118172024-12-14T03:44:56.503ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
118182024-12-14T03:44:56.503ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
118192024-12-14T03:44:56.505ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
118202024-12-14T03:44:56.505ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
118212024-12-14T03:44:56.508ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
118222024-12-14T03:44:56.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
118232024-12-14T03:44:56.510ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
118242024-12-14T03:44:56.510ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
118252024-12-14T03:44:56.511ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
118262024-12-14T03:44:56.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
118272024-12-14T03:44:56.512ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
118282024-12-14T03:44:56.513ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
118292024-12-14T03:44:56.513ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
118302024-12-14T03:44:56.513ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
118312024-12-14T03:44:56.515ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
118322024-12-14T03:44:56.518ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
118332024-12-14T03:44:56.518ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
118342024-12-14T03:44:56.519ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
118352024-12-14T03:44:56.520ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
118362024-12-14T03:44:56.520ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
118372024-12-14T03:44:56.522ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
118382024-12-14T03:44:56.522ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
118392024-12-14T03:44:56.523ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
118402024-12-14T03:44:56.527ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
118412024-12-14T03:44:56.527ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
118422024-12-14T03:44:56.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
118432024-12-14T03:44:56.530ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
118442024-12-14T03:44:56.530ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 179.932844ms iteration = 11 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
118452024-12-14T03:44:56.539ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {Name("nexus"): [NetworkInterface { id: 4f1fe649-79cb-49da-9215-8ff632ac6466, kind: Service { id: e8d9646f-a541-4c11-b5b2-f953427ca2f3 }, name: Name("nexus-e8d9646f-a541-4c11-b5b2-f953427ca2f3"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 170, 226])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 513aa8b2-d165-4db3-997f-2262204f1075, kind: Service { id: dc6862c8-90dd-40bf-a461-5b36c4239936 }, name: Name("nexus-dc6862c8-90dd-40bf-a461-5b36c4239936"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 182, 203])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 669bb0eb-969e-4430-94e4-187a825d1f3d, kind: Service { id: 5f2fe413-3c4a-4994-b4a0-995c1da486b1 }, name: Name("nexus-5f2fe413-3c4a-4994-b4a0-995c1da486b1"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 143, 224])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("external-dns"): [NetworkInterface { id: 0951ac68-a8db-47fb-ad0e-675cae6d693a, kind: Service { id: 28f528f1-3159-4fbc-9304-37b7e4a50ae8 }, name: Name("external-dns-28f528f1-3159-4fbc-9304-37b7e4a50ae8"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 140, 181])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cb55e4cb-e945-41d1-ba05-5e6f98df2e24, kind: Service { id: 7274e15f-a5f6-4975-bcdd-a2ef890c0230 }, name: Name("external-dns-7274e15f-a5f6-4975-bcdd-a2ef890c0230"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 190, 158])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })], Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })]} vpc_interfaces = {}
118462024-12-14T03:44:56.539ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
118472024-12-14T03:44:56.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
118482024-12-14T03:44:56.540ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
118492024-12-14T03:44:56.542ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
118502024-12-14T03:44:56.542ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-14T03:34:54.541856Z, time_modified: 2024-12-14T03:34:54.541856Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, db_silo: Silo { identity: SiloIdentity { id: 578bc52c-ac81-41a6-a56b-dfc79805368e, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-14T03:35:40.848931Z, time_modified: 2024-12-14T03:35:40.848931Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "4dfc5e49ed154568e7a05c630983c79e7ad097d55e90f834bee8ffda0c5a5c9e" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, db_silo: Silo { identity: SiloIdentity { id: 578bc52c-ac81-41a6-a56b-dfc79805368e, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-14T03:35:40.848931Z, time_modified: 2024-12-14T03:35:40.848931Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "4dfc5e49ed154568e7a05c630983c79e7ad097d55e90f834bee8ffda0c5a5c9e" }] }) }
118512024-12-14T03:44:56.542ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
118522024-12-14T03:44:56.542ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 192.923854ms iteration = 12 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"578bc52c-ac81-41a6-a56b-dfc79805368e","tls_certs":["4dfc5e49ed154568e7a05c630983c79e7ad097d55e90f834bee8ffda0c5a5c9e"]}},"default_endpoint":{"silo_id":"578bc52c-ac81-41a6-a56b-dfc79805368e","tls_certs":["4dfc5e49ed154568e7a05c630983c79e7ad097d55e90f834bee8ffda0c5a5c9e"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
118532024-12-14T03:44:56.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
118542024-12-14T03:44:56.544ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
118552024-12-14T03:44:56.544ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 0951ac68-a8db-47fb-ad0e-675cae6d693a, kind: Service { id: 28f528f1-3159-4fbc-9304-37b7e4a50ae8 }, name: Name("external-dns-28f528f1-3159-4fbc-9304-37b7e4a50ae8"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 140, 181])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cb55e4cb-e945-41d1-ba05-5e6f98df2e24, kind: Service { id: 7274e15f-a5f6-4975-bcdd-a2ef890c0230 }, name: Name("external-dns-7274e15f-a5f6-4975-bcdd-a2ef890c0230"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 190, 158])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 4f1fe649-79cb-49da-9215-8ff632ac6466, kind: Service { id: e8d9646f-a541-4c11-b5b2-f953427ca2f3 }, name: Name("nexus-e8d9646f-a541-4c11-b5b2-f953427ca2f3"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 170, 226])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 513aa8b2-d165-4db3-997f-2262204f1075, kind: Service { id: dc6862c8-90dd-40bf-a461-5b36c4239936 }, name: Name("nexus-dc6862c8-90dd-40bf-a461-5b36c4239936"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 182, 203])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 669bb0eb-969e-4430-94e4-187a825d1f3d, kind: Service { id: 5f2fe413-3c4a-4994-b4a0-995c1da486b1 }, name: Name("nexus-5f2fe413-3c4a-4994-b4a0-995c1da486b1"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 143, 224])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
118562024-12-14T03:44:56.544ZDEBGnexus (service-firewall-rule-progator): resolved 2 rules for sleds background_task = service_firewall_rule_propagation
118572024-12-14T03:44:56.596ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = [Sled { identity: SledIdentity { id: 8d70e61c-94ed-41ce-b36c-cb904f92c534, time_created: 2024-12-14T03:35:37.430597Z, time_modified: 2024-12-14T03:35:37.430597Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: a121ca05-bbee-41bf-b9db-9e03ff035200, is_scrimlet: true, serial_number: "buskin", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
118582024-12-14T03:44:56.596ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
118592024-12-14T03:44:56.596ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
118602024-12-14T03:44:56.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
118612024-12-14T03:44:56.598ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
118622024-12-14T03:44:56.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
118632024-12-14T03:44:56.600ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
118642024-12-14T03:44:56.603ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Sled { parent: Fleet, key: 8d70e61c-94ed-41ce-b36c-cb904f92c534, lookup_type: ById(8d70e61c-94ed-41ce-b36c-cb904f92c534) } result = Ok(())
118652024-12-14T03:44:56.612ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
118662024-12-14T03:44:56.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
118672024-12-14T03:44:56.614ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
118682024-12-14T03:44:56.616ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
118692024-12-14T03:44:56.616ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
118702024-12-14T03:44:56.616ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
118712024-12-14T03:44:56.617ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
118722024-12-14T03:44:56.619ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
118732024-12-14T03:44:56.619ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
118742024-12-14T03:44:56.619ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
118752024-12-14T03:44:56.627ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
118762024-12-14T03:44:56.627ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
118772024-12-14T03:44:56.627ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "454e696d-c040-4da9-97d1-48ece22350c2", "content-length": "26", "date": "Sat, 14 Dec 2024 03:44:56 GMT"} })
118782024-12-14T03:44:56.627ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
118792024-12-14T03:44:56.628ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
118802024-12-14T03:44:56.662ZINFOnexus (BackgroundTasks): VPC route manager sled 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
118812024-12-14T03:44:56.662ZDEBGnexus (BackgroundTasks): client request SledAgent = 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
118822024-12-14T03:44:56.662ZDEBGnexus (BackgroundTasks): client response SledAgent = 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "ef278a25-c1af-4e51-ada6-bf98f9c194e4", "content-length": "372", "date": "Sat, 14 Dec 2024 03:44:56 GMT"} })
118832024-12-14T03:44:56.662ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
118842024-12-14T03:44:56.662ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
118852024-12-14T03:44:56.703ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
118862024-12-14T03:44:56.703ZDEBGnexus (BackgroundTasks): client request SledAgent = 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
118872024-12-14T03:44:56.703ZDEBGnexus (BackgroundTasks): client response SledAgent = 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "bdc14206-8ad5-48c5-85e7-0af9cffaf304", "date": "Sat, 14 Dec 2024 03:44:56 GMT"} })
118882024-12-14T03:44:56.703ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
118892024-12-14T03:44:56.704ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
118902024-12-14T03:44:56.708ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 358.840428ms iteration = 21 status = {}
118912024-12-14T03:44:56.734ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 zone_address = fd00:1122:3344:101::2
118922024-12-14T03:44:56.734ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
118932024-12-14T03:44:56.734ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "34bf8fb5-5553-4dc4-a16d-c141c4e3d5ba", "content-length": "26", "date": "Sat, 14 Dec 2024 03:44:56 GMT"} })
118942024-12-14T03:44:56.734ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
118952024-12-14T03:44:56.736ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200
118962024-12-14T03:44:56.758ZDEBGnexus (BackgroundTasks): begin collection background_task = inventory_collection
118972024-12-14T03:44:56.758ZDEBGnexus (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[fd00:1122:3344:101::2]:12225
118982024-12-14T03:44:56.758ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/ignition
118992024-12-14T03:44:56.759ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "644a501c-aad9-4470-8fff-18621fae1340", "content-length": "476", "date": "Sat, 14 Dec 2024 03:44:56 GMT"} })
119002024-12-14T03:44:56.759ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0
119012024-12-14T03:44:56.759ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "aa2d382b-c94d-4b4e-87e8-02e18ae7ec6e", "content-length": "734", "date": "Sat, 14 Dec 2024 03:44:56 GMT"} })
119022024-12-14T03:44:56.759ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0
119032024-12-14T03:44:56.759ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "f2275d36-a213-4d8d-ad7e-e6de0d011615", "content-length": "111", "date": "Sat, 14 Dec 2024 03:44:56 GMT"} })
119042024-12-14T03:44:56.759ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1
119052024-12-14T03:44:56.760ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "ed80e5a0-a578-4fb6-a422-5bdd8a25a3fa", "content-length": "111", "date": "Sat, 14 Dec 2024 03:44:56 GMT"} })
119062024-12-14T03:44:56.760ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0
119072024-12-14T03:44:56.760ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "73551817-ac4b-4e03-966c-b0acb5fdf54b", "content-length": "167", "date": "Sat, 14 Dec 2024 03:44:56 GMT"} })
119082024-12-14T03:44:56.760ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1
119092024-12-14T03:44:56.760ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "d28f5ece-ec01-48a4-8ed6-86c1bcf8ea6f", "content-length": "167", "date": "Sat, 14 Dec 2024 03:44:56 GMT"} })
119102024-12-14T03:44:56.760ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0
119112024-12-14T03:44:56.760ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "90341e6d-849c-42eb-a408-f478e67915c0", "content-length": "175", "date": "Sat, 14 Dec 2024 03:44:56 GMT"} })
119122024-12-14T03:44:56.761ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1
119132024-12-14T03:44:56.761ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "d41a3d09-dffc-49f7-965f-8986490aac55", "content-length": "175", "date": "Sat, 14 Dec 2024 03:44:56 GMT"} })
119142024-12-14T03:44:56.761ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa
119152024-12-14T03:44:56.761ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "0174e3b5-cf37-4fa4-9585-a94f6703b476", "content-length": "702", "date": "Sat, 14 Dec 2024 03:44:56 GMT"} })
119162024-12-14T03:44:56.761ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
119172024-12-14T03:44:56.761ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "35f86483-0850-4048-98ff-4f908f09c45e", "content-length": "727", "date": "Sat, 14 Dec 2024 03:44:56 GMT"} })
119182024-12-14T03:44:56.761ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
119192024-12-14T03:44:56.761ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "a84529d8-a017-4238-b6b7-c5ce510475da", "content-length": "729", "date": "Sat, 14 Dec 2024 03:44:56 GMT"} })
119202024-12-14T03:44:56.761ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
119212024-12-14T03:44:56.761ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "192d6199-8d3d-41b9-ba93-8eaeef58878e", "content-length": "728", "date": "Sat, 14 Dec 2024 03:44:56 GMT"} })
119222024-12-14T03:44:56.761ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0
119232024-12-14T03:44:56.762ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "9a912ec7-ae58-4a1d-9038-34f55f0efec9", "content-length": "722", "date": "Sat, 14 Dec 2024 03:44:56 GMT"} })
119242024-12-14T03:44:56.762ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0
119252024-12-14T03:44:56.762ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "8ddbc628-ebef-4e67-ba67-135de18f1458", "content-length": "109", "date": "Sat, 14 Dec 2024 03:44:56 GMT"} })
119262024-12-14T03:44:56.762ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1
119272024-12-14T03:44:56.762ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "c5dd0e80-c80f-4f40-92c0-8212c9639b6b", "content-length": "109", "date": "Sat, 14 Dec 2024 03:44:56 GMT"} })
119282024-12-14T03:44:56.762ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0
119292024-12-14T03:44:56.762ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "f2a8018d-68dd-4108-9816-4e34299d7f84", "content-length": "169", "date": "Sat, 14 Dec 2024 03:44:56 GMT"} })
119302024-12-14T03:44:56.762ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1
119312024-12-14T03:44:56.762ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "37c18e88-649c-4fc4-bb21-43bdb9a1cb37", "content-length": "169", "date": "Sat, 14 Dec 2024 03:44:56 GMT"} })
119322024-12-14T03:44:56.762ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0
119332024-12-14T03:44:56.763ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "cdfd4a65-73cc-4612-8a8f-3d955925dc6b", "content-length": "178", "date": "Sat, 14 Dec 2024 03:44:56 GMT"} })
119342024-12-14T03:44:56.763ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1
119352024-12-14T03:44:56.763ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "20efc301-87db-45c4-9667-7769f47871cb", "content-length": "178", "date": "Sat, 14 Dec 2024 03:44:56 GMT"} })
119362024-12-14T03:44:56.763ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa
119372024-12-14T03:44:56.763ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "64a43d9d-f87a-4449-83f0-41923dcadb4b", "content-length": "702", "date": "Sat, 14 Dec 2024 03:44:56 GMT"} })
119382024-12-14T03:44:56.763ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
119392024-12-14T03:44:56.763ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "69ff34ba-5da7-471d-8bf0-a56a62072b08", "content-length": "727", "date": "Sat, 14 Dec 2024 03:44:56 GMT"} })
119402024-12-14T03:44:56.763ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
119412024-12-14T03:44:56.763ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "0aee653c-95d9-4f3e-9c98-63369d287e2d", "content-length": "729", "date": "Sat, 14 Dec 2024 03:44:56 GMT"} })
119422024-12-14T03:44:56.763ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
119432024-12-14T03:44:56.763ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "fed79694-393a-4a2f-a214-ea783165addc", "content-length": "728", "date": "Sat, 14 Dec 2024 03:44:56 GMT"} })
119442024-12-14T03:44:56.763ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
119452024-12-14T03:44:56.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
119462024-12-14T03:44:56.779ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
119472024-12-14T03:44:56.808ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
119482024-12-14T03:44:56.808ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "42234805-be5b-42b0-8fff-cb505121ae92", "content-length": "1", "date": "Sat, 14 Dec 2024 03:44:56 GMT"} })
119492024-12-14T03:44:56.810ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
119502024-12-14T03:44:56.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
119512024-12-14T03:44:56.840ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
119522024-12-14T03:44:56.841ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "6e9900e3-a0be-4187-9d32-3a2620a0b9f2", "date": "Sat, 14 Dec 2024 03:44:56 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
119532024-12-14T03:44:56.841ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
119542024-12-14T03:44:56.842ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "efd5742d-01a2-4417-af63-75f1cca79dec", "date": "Sat, 14 Dec 2024 03:44:56 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
119552024-12-14T03:44:56.842ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
119562024-12-14T03:44:56.844ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
119572024-12-14T03:44:56.844ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 494.776942ms iteration = 13 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
119582024-12-14T03:44:56.864ZDEBGnexus (service-firewall-rule-progator): client request SledAgent = 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = service_firewall_rule_propagation body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
119592024-12-14T03:44:56.865ZDEBGnexus (service-firewall-rule-progator): client response SledAgent = 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = service_firewall_rule_propagation result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "65d4e448-1a89-49d3-8522-7ce13c92a6f9", "date": "Sat, 14 Dec 2024 03:44:56 GMT"} })
119602024-12-14T03:44:56.867ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
119612024-12-14T03:44:56.867ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
119622024-12-14T03:44:56.867ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 518.12191ms iteration = 21 status = null
119632024-12-14T03:44:56.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
119642024-12-14T03:44:56.867ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 1 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
119652024-12-14T03:44:56.867ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 517.873294ms
119662024-12-14T03:44:56.867ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 517.886315ms iteration = 3 status = {}
119672024-12-14T03:44:56.868ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
119682024-12-14T03:44:56.868ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
119692024-12-14T03:44:56.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
119702024-12-14T03:44:56.880ZDEBGnexus (BackgroundTasks): client request SledAgent = 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
119712024-12-14T03:44:56.881ZDEBGnexus (BackgroundTasks): client response SledAgent = 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "99bef245-840a-4fbb-af7a-3884bac00d1e", "content-length": "691", "date": "Sat, 14 Dec 2024 03:44:56 GMT"} })
119722024-12-14T03:44:56.881ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
119732024-12-14T03:44:56.881ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
119742024-12-14T03:44:56.881ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
119752024-12-14T03:44:56.882ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
119762024-12-14T03:44:56.882ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 532.672271ms iteration = 21 status = {}
119772024-12-14T03:44:56.883ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
119782024-12-14T03:44:56.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
119792024-12-14T03:44:56.884ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
119802024-12-14T03:44:56.884ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
119812024-12-14T03:44:56.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
119822024-12-14T03:44:56.886ZINFOnexus (BackgroundTasks): VPC route manager sled 8d70e61c-94ed-41ce-b36c-cb904f92c534 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
119832024-12-14T03:44:56.886ZDEBGnexus (BackgroundTasks): client request SledAgent = 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
119842024-12-14T03:44:56.887ZDEBGnexus (BackgroundTasks): client response SledAgent = 8d70e61c-94ed-41ce-b36c-cb904f92c534 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "bab4a1eb-b215-49f2-9ed5-e7c0f16c359b", "date": "Sat, 14 Dec 2024 03:44:56 GMT"} })
119852024-12-14T03:44:56.888ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 539.272034ms iteration = 22 status = {}
119862024-12-14T03:44:56.897ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
119872024-12-14T03:44:56.898ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "0c411e1c-df44-4c5f-9acd-84c6a6b7812b", "date": "Sat, 14 Dec 2024 03:44:56 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
119882024-12-14T03:44:56.898ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
119892024-12-14T03:44:56.900ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "abf8ef48-b2aa-4272-9037-18ae31e6ec9a", "date": "Sat, 14 Dec 2024 03:44:56 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
119902024-12-14T03:44:56.900ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
119912024-12-14T03:44:56.901ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "7d89b40f-d489-4a29-bbc4-17de747273da", "date": "Sat, 14 Dec 2024 03:44:56 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
119922024-12-14T03:44:56.901ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
119932024-12-14T03:44:56.903ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
119942024-12-14T03:44:56.903ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 553.838425ms iteration = 13 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
119952024-12-14T03:44:56.954ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
119962024-12-14T03:44:56.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
119972024-12-14T03:44:56.956ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 45ca990e-42e9-4264-be3e-0adfed2cd99b, rack_id: a121ca05-bbee-41bf-b9db-9e03ff035200, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(811a570a-bdaf-4a1b-8eba-0c0e4977f7bb) } rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 switch_location = Switch0
119982024-12-14T03:44:56.956ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
119992024-12-14T03:44:56.957ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
120002024-12-14T03:44:56.965ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
120012024-12-14T03:44:56.966ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "34fdc09a-b53c-44cc-bd0c-402fd3c454f3", "content-length": "134", "date": "Sat, 14 Dec 2024 03:44:56 GMT"} })
120022024-12-14T03:44:56.966ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
120032024-12-14T03:44:56.966ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 811a570a-bdaf-4a1b-8eba-0c0e4977f7bb
120042024-12-14T03:44:56.966ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
120052024-12-14T03:44:56.966ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
120062024-12-14T03:44:56.966ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
120072024-12-14T03:44:56.966ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
120082024-12-14T03:44:56.966ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
120092024-12-14T03:44:56.966ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
120102024-12-14T03:44:56.966ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
120112024-12-14T03:44:56.966ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
120122024-12-14T03:44:56.966ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200
120132024-12-14T03:44:56.966ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
120142024-12-14T03:44:56.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
120152024-12-14T03:44:56.969ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
120162024-12-14T03:44:56.969ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "dfaa939e-6ec3-4c15-955a-1817094e876a", "content-length": "2", "date": "Sat, 14 Dec 2024 03:44:56 GMT"} })
120172024-12-14T03:44:56.969ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
120182024-12-14T03:44:56.969ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "182b05e9-2235-44c6-af35-14af7848b0d6", "content-length": "52", "date": "Sat, 14 Dec 2024 03:44:56 GMT"} })
120192024-12-14T03:44:56.969ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 switch_location = Switch0
120202024-12-14T03:44:56.969ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
120212024-12-14T03:44:56.977ZDEBGnexus (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[fd00:1122:3344:101::1]:12345
120222024-12-14T03:44:56.977ZDEBGnexus (BackgroundTasks): client request SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/inventory
120232024-12-14T03:44:57.063ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "99cc4a60-52ee-4b7d-a752-9c4387fb8906", "date": "Sat, 14 Dec 2024 03:44:56 GMT"} })
120242024-12-14T03:44:57.064ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 switch = Switch0
120252024-12-14T03:44:57.064ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
120262024-12-14T03:44:57.064ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = a121ca05-bbee-41bf-b9db-9e03ff035200 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "e4475996-18f4-4be6-944c-435133907efe", "content-length": "682", "date": "Sat, 14 Dec 2024 03:44:56 GMT"} })
120272024-12-14T03:44:57.064ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
120282024-12-14T03:44:57.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
120292024-12-14T03:44:57.068ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
120302024-12-14T03:44:57.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
120312024-12-14T03:44:57.072ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
120322024-12-14T03:44:57.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
120332024-12-14T03:44:57.075ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
120342024-12-14T03:44:57.075ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
120352024-12-14T03:44:57.083ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 733.478534ms iteration = 21 status = {}
120362024-12-14T03:44:57.288ZDEBGnexus (BackgroundTasks): client response SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "1f50e47b-1ec9-4a19-a352-3821c465235b", "content-length": "30427", "date": "Sat, 14 Dec 2024 03:44:57 GMT"} })
120372024-12-14T03:44:57.290ZDEBGnexus (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
120382024-12-14T03:44:57.290ZDEBGnexus (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
120392024-12-14T03:44:57.290ZDEBGnexus (BackgroundTasks): finished collection background_task = inventory_collection
120402024-12-14T03:44:57.293ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
120412024-12-14T03:44:57.293ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
120422024-12-14T03:44:57.295ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
120432024-12-14T03:44:57.299ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
120442024-12-14T03:44:57.299ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
120452024-12-14T03:44:57.299ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
120462024-12-14T03:44:57.536ZINFOnexus (BackgroundTasks): inserted inventory collection background_task = inventory_collection collection_id = cbc33876-0d01-4bf9-9c15-512de39f4e62 file = nexus/db-queries/src/db/datastore/inventory.rs:1010
120472024-12-14T03:44:57.537ZDEBGnexus (BackgroundTasks): inventory collection complete background_task = inventory_collection collection_id = cbc33876-0d01-4bf9-9c15-512de39f4e62 time_started = 2024-12-14 03:44:56.758601 UTC
120482024-12-14T03:44:57.537ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 1.18694552s iteration = 3 status = {"collection_id":"cbc33876-0d01-4bf9-9c15-512de39f4e62","time_done":"2024-12-14 03:44:57.290752 UTC","time_started":"2024-12-14 03:44:56.758601 UTC"}
120492024-12-14T03:44:57.537ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 24 reason = Dependency
120502024-12-14T03:44:57.537ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
120512024-12-14T03:44:57.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
120522024-12-14T03:44:57.539ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
120532024-12-14T03:44:57.542ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
120542024-12-14T03:44:57.542ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
120552024-12-14T03:44:57.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
120562024-12-14T03:44:57.545ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
120572024-12-14T03:44:57.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
120582024-12-14T03:44:57.547ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
120592024-12-14T03:44:57.550ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
120602024-12-14T03:44:57.550ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
120612024-12-14T03:44:57.550ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
120622024-12-14T03:44:57.656ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 119.2709ms iteration = 24 status = {"physical_disks_added":0}